A regeneratable dynamic differential evolution algorithm for neural networks with integer weights

来源 :Journal of Zhejiang University-Science C(Computers & Electro | 被引量 : 0次 | 上传用户:Moke_jlsf
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Neural networks with integer weights are more suited for embedded systems and hardware implementations than those with real weights. However, many learning algorithms, which have been proposed for training neural networks with float weights, are inefficient and difficult to train for neural networks with integer weights. In this paper, a novel regeneratable dynamic differential evolution algorithm (RDDE) is presented. This algorithm is efficient for training networks with integer weights. In comparison with the conventional differential evolution algorithm (DE), RDDE has introduced three new strategies: (1) A regeneratable strategy is introduced to ensure further evolution, when all the individuals are the same after several iterations such that they cannot evolve further. In other words, there is an escape from the local minima. (2) A dynamic strategy is designed to speed up convergence and simplify the algorithm by updating its population dynamically. (3) A local greedy strategy is introduced to improve local searching ability when the population approaches the global optimal solution. In comparison with other gradient based algorithms, RDDE does not need the gradient information, which has been the main obstacle for training networks with integer weights. The experiment results show that RDDE can train integer-weight networks more efficiently. Neural networks with integer weights are more suited for embedded systems and hardware implementations than those with real weights. However, many learning algorithms, which have been proposed for training neural networks with float weights, are inefficient and difficult to train for neural networks with integer weights . In this paper, a novel regeneratable dynamic differential evolution algorithm (RDDE) is presented. This algorithm is efficient for training networks with integer weights. (1) A regeneratable strategy is introduced to ensure further evolution, when all the individuals are the same after several iterations such that they can not evolve further. speed up convergence and simplify the algorithm by updating its population dynamically. (3) A local greedy strategy is i ntroduced to improve local searching ability when the population approaches the global optimal solution. In comparison with gradient based algorithms, RDDE does not need the gradient information, which has been the main obstacle for training networks with integer weights. can train integer-weight networks more efficiently.
其他文献
在机体的衰老过程中,皮肤的衰老最为明显。随着年龄的增长,皮肤的真皮层会变薄、弹性会降低,还会产生干燥、色斑、皱纹、松弛、下垂等一系列症状。胶原蛋白含量的减少及成纤维细胞增殖率的降低是引起皮肤衰老的主要原因。刺参(Stichopus japonicas)属于棘皮动物门,海参纲,刺参科。研究表明海参酶解物能促进成纤维细胞的生长,但其单一活性成分未能确定。因此,本文以新鲜刺参为原料,以小鼠成纤维细胞NI
目的:1、建立测定人血浆中氟罗沙星浓度的高效液相色谱法;2、以氟罗沙星片剂为参比制剂,研究氟罗沙星分散片在健康志愿者体内的药代动力学与相对生物利用度。 方法:18个健康受
马军,笔名马君,号锲斋、锐思堂,男,汉族,1970年出生。中国书法家协会会员,河北省书法家协会篆刻委员会委员。作品曾参加全国第五届篆刻艺术展、当代篆刻艺术大展、全国第六届
血脑屏障(Blood-brain barrier, BBB),是指位于中枢神经系统与外周血液循环之间由多种细胞与非细胞成分共同构成的血管组织结构,主要功能由脑微血管内皮细胞承载,其他种类细胞(如
申盛林,字子峰,别署金壁,斋号八荷屏堂。河北省硬笔书法家协会副主席,河北省书画研究会理事。工书、善画、喜诗文,尤擅作书画长卷巨制。2004年获“全国第二届民族美展”纪念
林伟,1968年生。中国书法家协会会员。河北省书法家协会主席团委员,河北省教育书法研究会副理事长,河北省省直书协副主席。从事书法、国画、油画创作与研究。 Lin Wei, born
刘现祥,号焜月、清虚道人、身边僧,河北任县人。毕业于中国人民解放军南京政治学院,先后结业于清华大学美术学院当代绘画艺术与创新研修班、上海青年报全国篆刻函授班。现为河北
印钮,印章之把柄,为印章上端雕饰之物。在我国,3000年之前,印章已广泛使用于社会,秦汉时期是印章和印钮艺术形成与发展的重要时期,其印章所用材料以金、银、铜、玉为主,或铸
一、目的 研究在健康人体内齐墩果酸对CYP1A2、CYP2E1及CYP3A4酶活性的影响,以预测齐墩果酸与临床药物的相互作用,为临床合理用药提供参考。 二、方法 1.给药方法
一次写生的机会,步入井陉县南障城镇临近山西的地方,幸遇这片隐藏在太行深处的神秘古村落——吕家村。rn山场·寨垴·洞宾奇峰rn吕家村位于井陉县南障城镇中部,井陉县城西南35公