SPICE-Modeling of the Processes of Associative Self Learning and Unconditional Discrimination in the Logic Unit of a Neuroprocessor

Tyumen State University Herald. Physical and Mathematical Modeling. Oil, Gas, Energy


Release:

2018, Vol. 4. №3

Title: 
SPICE-Modeling of the Processes of Associative Self Learning and Unconditional Discrimination in the Logic Unit of a Neuroprocessor


For citation: Pisarev A. D. 2018. “SPICE-Modeling of the Processes of Associative Self Learning and Unconditional Discrimination in the Logic Unit of a Neuroprocessor”. Tyumen State University Herald. Physical and Mathematical Modeling. Oil, Gas, Energy, vol. 4, no 3, pp. 132-145. DOI: 10.21684/2411-7978-2018-4-3-132-145

About the author:

Alexander D. Pisarev, Cand. Sci. (Tech.), Associate Professor, Department of Applied and Technical Physics, School of Natural Sciences, University of Tyumen, Tyumen, Russia; Senior Researcher, Memristive Materials Laboratory, Center for Nature-Inspired Engineering, University of Tyumen, Tyumen, Russia; spcb.doc@utmn.ru, https://orcid.org/0000-0002-5602-3880

Abstract:

This research relates to the industry of creating nanoelectronic blocks intended for the implementation of a neuroprocessor, which is a hardware platform of neural networks and complex biomorphic architectures, which may, for example, simulate the work of the cortical column of the brain. This article describes the scheme of the electronic logic block, which is the key node of the neuroprocessor, which performs, in particular, the functions of associative self-learning and unconditional unraveling of the neural network.

The logical block of the neuroprocessor consists of elementary cells, in the electrical circuit of which a memristor connected to a diode-transistor logic component is used as a memory element. The topology of the logic block has a 3D-periodic design, which is a composition of CMOS layers and crossbars with memristor material. The manufacturing process of the logical unit is simple enough and can be adapted to existing production lines of electronic devices, since it is based on typical physical and chemical production methods. Memristor crossbars are manufactured by the method of reactive magnetron sputtering, which is combined with common standard CMOS technology.

Based on the logic block, the author suggests an electrical circuit that performs the functions of the known Hodgkin — Huxley neuron model. As examples of the realization of the processes of associative self-learning and the unconditional “unlearning” of the electronic logic unit, the principles of interaction of neurons in living objects during the elaboration of a conditioned reflex were used.

The operation of the logic block in the basic modes was investigated by the computer SPICE simulation method. For this purpose, model schemes of control drivers were developed, which were connected to the crossbar lines of the logical unit to generate information signals and set the operating mode of the logical unit. As simulation results, the stress and current diagrams of the combined memristor crossbar are obtained in the specified modes of operation of the device.

The main result achieved is the model of the neuron synapse realized by the analog operation of the memristor as a memory element of the logical block when it is read and written pulse. The change in the resistance of the memristors of the logic block during the pulse recording is shown and stable functioning during reading in the processes of associative self-learning and unconditional raising of the three-layer neural network.

References:

  1. Pisarev A. D., Mayevskiy O. V., Busygin A. N., Udovichenko S. Yu. Invention Application of 27 June 2017 no 2017122704 “Mnogosloynaya logicheskaya matritsa na osnove memristornoy kommutatsionnoy yacheyki” [Multilayered Logic Matrix Based on Memristor Switching Cells]. Patent granted on 10 April 2018.
  2. Udovichenko S. Yu., Pisarev A. D., Busygin A. N., Mayevskiy O. V. 2017. “3D KMOP-memristornaya nanotekhnologiya sozdaniya logicheskoy i zapominayushchey matrits neyroprotsessora” [3D CMOS-Memristor Nanotechnology Creating a Logical and Memory Matrix of a Neuroprocessor]. Nanoindustriya, no 5, pp. 26-34.
  3. Baladron J., Hamker F. H. 2015. “A Spiking Neural Network Based on the Basal Ganglia Functional Anatomy”. Neural Networks, July, vol. 67, pp. 1-13.
  4. Bobylev A. N., Busygin A. N., Pisarev A. D., Udovichenko S. Yu., Filippov V. A. 2017. “Neuromorphic Coprocessor Prototype Based on Mixed Metal Oxide Memristors”. International journal of nanotechnology, vol. 14, no 7/8, pp. 698-704.
  5. Bobylev A. N., Udovichenko S. Yu. 2016. “The Electrical Properties of Memristor Devices TiN/Tix Al1–x Oy/TiN Produced by Magnetron Sputtering”. Russian Microelectronics, vol. 45, no 6, pp. 396-401.
  6. Brette R, Gerstner W. 2005. “Adaptive Exponential Integrate-and-Fire Model as an Effective Description of Neuronal Activity”. Journal of Neurophysiology, vol. 94, pp. 3637-3642.
  7. Hodgkin A. L., Huxley A. F. 1952. “A Quantitative Description of Membrane Current and its Application to Conduction and Excitation in Nerve”. Journal of Physiology, vol. 117, no 4, pp. 500-544.
  8. Levy Y., Bruck J., Cassuto Y., Friedman E. G. et al. 2014. “Logic Operations in Memory Using a Memristive Akers Array”. Microelectronics Journal, vol. 45, pp. 1429-1437.
  9. Li C., Hu M., Li Y., Jiang H. et al. 2018. “Analogue Signal and Image Processing with Large Memristor Crossbars”. Nature electronics, vol. 1, no 1, pp. 52-59.
  10. Maevsky O. V., Pisarev A. D., Busygin A. N., Udovichenko S. Yu. 2018. “Complementary Memristor-Diode Cell for a Memory Matrix in Neuromorphic Processor”. International Journal of Nanotechnology, vol. 15, no 4/5, pp. 388-393.
  11. Markham H. 2007. “The Blue Brain Project”. Nature Neuroscience, February, vol. 7, pp. 153-160.
  12. Markham H. 2012. “The Human Brain Project”. Scientific American, June, pp. 50-55.
  13. Merolla Р. А. et al. 2014. “A Million Spiking-Neuron Integrated Circuit with a Scalable Communication Network and Interface”. Science, vol. 345, pp. 668-672.
  14. Pisarev A., Busygin A, Udovichenko S, Maevsky O. 2018. “3D Memory Matrix Based on a Composite Memristor-Diode Crossbar for a Neuromorphic Processor”. Microelectronic Engineering, vol. 198, pp. 1-7. 
  15. Schmidhuber J. 2015. “Deep Learning in Neural Networks: An Overview”. Neural Networks, January, vol. 61, pp. 85-117.
  16. Silberberg G., Gupta A., Markram H. 2002. “Stereotypy in Neocortical Microcircuits”. TRENDS in Neurosciences, May, vol. 25, no 5.