초록 ▼

A method of evolving a neural network that includes a plurality of processing elements interconnected by a plurality of weighted connections includes the step of obtaining a definition for the neural network by evolving a plurality of weights for the plurality of weighted connections, and evolving a

A method of evolving a neural network that includes a plurality of processing elements interconnected by a plurality of weighted connections includes the step of obtaining a definition for the neural network by evolving a plurality of weights for the plurality of weighted connections, and evolving a plurality of activation function parameters associated with the plurality of processing elements. Another step of the method includes determining whether the definition for the neural network may be simplified based upon at least one activation function parameter of the plurality of activation function parameters. Yet another step of the method includes updating the definition for the neural network in response to determining that the definition for the neural network may be simplified. The method utilizes particle swarm optimization techniques to evolve the plurality of weights and the plurality of activation parameters. Moreover, the method simplifies activation functions of processing elements in response to corresponding activation parameters meeting certain criteria, and removes processing elements from the definition of the neural network in response to corresponding activation parameters satisfying certain criteria. Various apparatus are also disclosed for implementing network evolution and simplification.

대표청구항 ▼

A method of evolving a neural network that includes a plurality of processing elements interconnected by a plurality of weighted connections includes the step of obtaining a definition for the neural network by evolving a plurality of weights for the plurality of weighted connections, and evolving a

A method of evolving a neural network that includes a plurality of processing elements interconnected by a plurality of weighted connections includes the step of obtaining a definition for the neural network by evolving a plurality of weights for the plurality of weighted connections, and evolving a plurality of activation function parameters associated with the plurality of processing elements. Another step of the method includes determining whether the definition for the neural network may be simplified based upon at least one activation function parameter of the plurality of activation function parameters. Yet another step of the method includes updating the definition for the neural network in response to determining that the definition for the neural network may be simplified. The method utilizes particle swarm optimization techniques to evolve the plurality of weights and the plurality of activation parameters. Moreover, the method simplifies activation functions of processing elements in response to corresponding activation parameters meeting certain criteria, and removes processing elements from the definition of the neural network in response to corresponding activation parameters satisfying certain criteria. Various apparatus are also disclosed for implementing network evolution and simplification. 115, 19970900, Fraser, 705/037; US-5671363, 19970900, Cristofich et al., 395/237; US-5689650, 19971100, McClelland et al., 395/236; US-5704045, 19971200, King et al., 395/235; US-5710889, 19980100, Clark et al., 395/244; US-5724524, 19980300, Hunt et al., 395/237; US-5727161, 19980300, Purcell, Jr., 395/207; US-5729700, 19980300, Melnikoff, 395/236; US-5745706, 19980400, Wolfberg et al., 395/235; US-5749077, 19980500, Campbell, 705/036; US-5758097, 19980500, Debe et al., 395/235; US-5761441, 19980600, Bennett, 395/235; US-5761442, 19980600, Barr et al., 395/236; US-5765141, 19980600, Spector, 705/014; US-5774881, 19980600, Friend et al., 705/036; US-5784696, 19980700, Melnikoff, 705/036; US-5794219, 19980800, Brown, 705/037; US-5799287, 19980800, Dembo, 705/036; US-5806047, 19980900, Hackel et al., 705/036; US-5806049, 19980900, Petruzzi, 705/036; US-5812987, 19980900, Luskin et al., 705/036; US-5884283, 19990300, Manos, 705/030; US-5884287, 19990300, Edesess, 705/036; US-5918218, 19990600, Harris et al., 705/037; US-5930774, 19990700, Chennault, 705/036; US-5946666, 19990800, Nevo et al., 705/036; US-5978778, 19991100, O'Shaughnessy, 705/036; US-6021397, 20000200, Jones et al., 705/036; US-6035287, 20000300, Stallaert et al., 705/037; US-6161098, 20001200, Wallman, 705/036; US-2001/0014875, 20010800, Young et al., 705/037