跳至主要内容

Modeling Neuromorphic Persistent Firing Networks

Read  full  paper  at:
http://www.scirp.org/journal/PaperInformation.aspx?PaperID=53707#.VNBqASzQrzE

ABSTRACT
Neurons are believed to be the brain computational engines of the brain. A recent discovery in neurophysiology reveals that interneurons can slowly integrate spiking, share the output across a coupled network of axons and respond with persistent firing even in the absence of input to the soma or dendrites, which has not been understood and could be very important for exploring the mechanism of human cognition. The conventional models are incapable of simulating the important newly-discovered phenomenon of persistent firing induced by axonal slow integration. In this paper, we propose a computationally efficient model of neurons through modeling the axon as a slow leaky integrator, which captures almost all-known neural behaviors. The model controls the switching of axonal firing dynamics between passive conduction mode and persistent firing mode. The interplay between the axonal integrated potential and its multiple thresholds in axon precisely determines the persistent firing dynamics of neurons. We also present a persistent firing polychronous spiking network which exhibits asynchronous dynamics indicating that this computationally efficient model is not only bio-plausible, but also suitable for large scale spiking network simulations. The implications of this network and the analog circuit design for exploring the relationship between working memory and persistent firing enable developing a spiking network-based memory and bio-inspired computer systems.
 
Cite this paper
Ning, N. , Li, G. , He, W. , Huang, K. , Pan, L. , Ramanathan, K. , Zhao, R. and Shi, L. (2015) Modeling Neuromorphic Persistent Firing Networks. International Journal of Intelligence Science, 5, 89-101. doi: 10.4236/ijis.2015.52009.
 
References
[1]Lapicque, L. (1907) Recherches quantitatives sur l’excitation electrique des nerfs traitee comme une polarization. Journal of Physiol Pathol Générale, 9, 620-635.
 
[2]Sandberg, A. and Bostrom, N. (2008) Whole Brain Emulation: A Roadmap. Future of Humanity Institute, Oxford University, Technical Report #2008-3.
 
[3]Hodgkin, A.L. and Huxley, A.F. (1952) A Quantitative Description of Membrane Current and Its Application to Conduction and Excitation in Nerve. The Journal of Physiology, 117, 500-544.
http://dx.doi.org/10.1113/jphysiol.1952.sp004764
 
[4]Brette, R., Rudolph, M., Carnevale, T., Hines, M., Beeman, D., Bower, J.M., Diesmann, M., Morrison, A., Goodman, P.H., Harris Jr., F.C, et al. (2007) Simulation of Networks of Spiking Neurons: A Review of Tools and Strategies. Journal of Computational Neuroscience, 23, 349-398.
http://dx.doi.org/10.1007/s10827-007-0038-6
 
[5]Mihalas, S. and Niebur, E. (2009) A Generalized Linear Integrate-and-Fire Neural Model Produces Diverse Spiking Behaviors. Neural Computation, 21, 704-718.
http://dx.doi.org/10.1162/neco.2008.12-07-680
 
[6]Fitzhugh, R. (1961) Impulses and Physiological States in Theoretical Models of Nerve Membrane. Biophysical Journal, 1, 445-466.
http://dx.doi.org/10.1016/S0006-3495(61)86902-6
 
[7]Morris, C. and Lecar, H. (1981) Voltage Oscillations in the Barnacle Giant Muscle Fiber. Biophysical Journal, 35, 193-213.
http://dx.doi.org/10.1016/S0006-3495(81)84782-0
 
[8]Rose, R.M. and Hindmarsh, J.L. (1989) The Assembly of Ionic Currents in a Thalamic Neuron I. The Three-Dimensional Model. Proceedings of the Royal Society of London. Series B. Biological Sciences, 237, 267-288.
http://dx.doi.org/10.1098/rspb.1989.0049
 
[9]Wilson, H.R. (1999) Simplified Dynamics of Human and Mammalian Neocortical Neurons. Journal of Theoretical Biology, 200, 375-388.
http://dx.doi.org/10.1006/jtbi.1999.1002
 
[10]Izhikevich, E.M. (2001) Resonate-and-Fire Neurons. Neural Networks, 14, 883-894.
http://dx.doi.org/10.1016/S0893-6080(01)00078-8
 
[11]Izhikevich, E.M. (2003) Simple Model of Spiking Neurons. IEEE Transactions on Neural Networks, 14, 1569-1572.
http://dx.doi.org/10.1109/TNN.2003.820440
 
[12]Sheffield, M.E.J., Best, T.K., Mensh, B.D., Kath, W.L. and Spruston, N. (2011) Slow Integration Leads to Persistent Action Potential Firing in Distal Axons of Coupled Interneurons. Nature Neuroscience, 14, 200-207.
http://dx.doi.org/10.1038/nn.2728
 
[13]Izhikevich, E.M. (2006) Polychronization: Computation with Spikes. Neural Computation, 18, 245-282.
http://dx.doi.org/10.1162/089976606775093882
 
[14]Ning, N., Yi, K.J., Huang, K.J. and Shi, L.P. (2011) Axonal Slow Integration Induced Persistent Firing Neuron Model. Lecture Notes in Computer Science, 7062, 469-476.
http://dx.doi.org/10.1007/978-3-642-24955-6_56
 
[15]Izhikevich, E.M. (2007) Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting. The MIT Press, Cambridge.
 
[16]Wijekoon, J.H. and Dudek, P. (2008) Compact Silicon Neuron Circuit with Spiking and Bursting Behaviour. Neural Networks, 21, 524-534.
http://dx.doi.org/10.1016/j.neunet.2007.12.037
 
[17]Wijekoon, J.H. and Dudek, P. (2008) Integrated Circuit Implementation of a Cortical Neuron. Proceedings of the IEEE International Symposium on Circuits and Systems, Seattle, 18-21 May 2008, 1784-1787.
 
[18]Swadlow, H.A. (1985) Physiological Properties of Individual Cerebral Axons Studied in Vivo for as Long as One Year. Journal of Neurophysiology, 54, 1346-1362.
 
[19]Song, S., Miller, K.D. and Abbott, L.F. (2000) Competitive Hebbian Learning through Spike-Timing-Dependent Synaptic Plasticity. Nature Neuroscience, 3, 919-926.
http://dx.doi.org/10.1038/78829
 
[20]Bartos, M., Vida, I. and Jonas, P. (2007) Synaptic Mechanisms of Synchronized Gamma Oscillations in Inhibitory Interneuron Networks. Nature Reviews Neuroscience, 8, 45-56.
http://dx.doi.org/10.1038/nrn2044
 
[21]Baddeley, A. (1992) Working Memory. Science, 255, 556-559.
http://dx.doi.org/10.1126/science.1736359
 
[22]Durstewitz, D., Seamans, J.K. and Sejnowski, T.J. (2000) Neurocomputational Models of Working Memory. Nature Neuroscience, 3, 1184-1191.
http://dx.doi.org/10.1038/81460
 
[23]Egorov, A.V., Hamam, B.N., Fransen, E., Hasselmo, M.E. and Alonso, A.A. (2002) Graded Persistent Activity in Entorhinal Cortex Neurons. Nature, 420, 173-178.
http://dx.doi.org/10.1038/nature01171
 
[24]Miller, G.A. (1956) The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. Psychological Review, 63, 81-97.
http://dx.doi.org/10.1037/h0043158
 
[25]D’Esposito, M., Detre, J.A., Alsop, D.C., Shin, R.K., Atlas, S. and Grossman, M. (1995) The Neural Basis of the Central Executive System of Working Memory. Nature, 378, 279-281.
http://dx.doi.org/10.1038/378279a0
 
[26]Goldman-Rakic, P.S. (1995) Cellular Basis of Working Memory. Neuron, 14, 477-485.
http://dx.doi.org/10.1016/0896-6273(95)90304-6
 
[27]Miller, E.K., Erickson, C.A. and Desimone, R. (1996) Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque. The Journal of Neuroscience, 16, 5154-5167.
 
[28]Amit, D. and Mongillo, G. (2003) Spike-Driven Synaptic Dynamics Generating Working Memory States. Neural Computation, 15, 565-596.
http://dx.doi.org/10.1162/089976603321192086
 
[29]O’Reilly, R.C. and Frank, M.J. (2006) Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia. Neural Computation, 18, 283-328.
http://dx.doi.org/10.1162/089976606775093909
 
[30]Szatmary, B. and Izhikevich, E.M. (2010) Spike-Timing Theory of Working Memory. PLoS Computational Biology, 6, e1000879.
http://dx.doi.org/10.1371/journal.pcbi.1000879
 
[31]Ramanathan, K., Ning, N., Dhanasekar, D., Li, G., Shi, L.P. and Vadakkepat, P. (2012) Presynaptic Learning and Memory with a Persistent Firing Neuron and a Habituating Synapse: A Model of Short Term Persistent Habituation. International Journal of Neural Systems, 22, Article ID: 1250015. http://dx.doi.org/10.1142/S0129065712500153
 
[32]Shi, L.P., Yi, K.J., Ramanathan, K., Zhao, R., Ning, N., Ding, D. and Chong, T.C. (2011) Artificial Cognitive Memory—Changing from Density Driven to Functionality Driven. Applied Physics A, 102, 865-875.
http://dx.doi.org/10.1007/s00339-011-6297-0
 
[33]Ning, N., Huang, K.J. and Shi, L.P. (2012) Artificial Neuron with Somatic and Axonal Computation Units: Mathematical and Neuromorphic Models of Persistent Firing Neurons. Proceedings of the 2012 International Joint Conference on Neural Networks (IJCNN), Brisbane, 10-15 June 2012, 1-7.
 
[34]van Schaik, A., Jin, C., McEwan, A. and Hamilton, T.J. (2010) A Log-Domain Implementation of the Izhikevich Neuron Model. Proceedings of 2010 IEEE International Symposium on Circuits and Systems (ISCAS), Paris, 30 May-2 June 2010, 4253-4256.
 
[35]Li, G.Q., Ning, N., Ramanathan, K., Wei, H., Pan, L. and Shi, L.P. (2013) Behind the Magical Numbers: Hierarchical Chunking and the Human Working Memory Capacity. International Journal of Neural Systems, 23, Article ID: 1350019.
http://dx.doi.org/10.1142/S0129065713500196
 
[36]Li, G.Q., Wen, C.Y., Li, Z.G., Zhang, A.M., Yang, F. and Mao, K.Z. (2013) Model-Based Online Learning with Kernels. IEEE Transactions on Neural Networks and Learning Systems, 24, 356-369.
http://dx.doi.org/10.1109/TNNLS.2012.2229293                                                            eww150203lx
标签：

评论

发表评论

此博客中的热门博文

Does Immigration Promote the Investment of the Monopolistic Firm?

In the present paper, we examine the effect of increasing uncertainty of immigrants’ growth on the optimal timing of investment of a firm that has a monopolistic power over the labor market. It is revealed that when the uncertainty of immigrants’ growth is more than a threshold level, increasing uncertainty of immigrants’ growth accelerates the optimal timing of firms’ investment and enhances the economic growth, even if the uncertainty of immigrants’ growth is formulated by the geometric Brownian motion, which is in sharp contrast to the standard result that an increase in the uncertainty postpones the optimal timing. With an increase in the immigrants over the past ten years, workforces in the host countries have been growing significantly to the extent that the immigrants represent 70% of the increase in the workforce in Europe, and 47% in the United States as OECD indicates. In the present paper, we attempted to investigate the effect of increased uncertainty caused by the growi...
发表评论
阅读全文

Education Policy Implementation: A Mechanism for Enhancing Primary Education Development in Zanzibar

Education is one of the fundamental rights of individuals; therefore, the government of a country needs to develop and strengthen educational policy and quality as well as to ensure that everyone has equal access to basic education. The improvement of access and quality of education in the world is becoming as an essential factor in development, whereas the basic education (primary school), is acknowledged as a foundation of the higher educational development for every country. To fulfill this goal, governments introduce several policies and procedures; however, it requires some reforms and participation from the politician, policymakers, and other stakeholders to re-examine educational policy so that it can lead to multiplication and betterment of the reforms. Educational reforms actually focus on accountability. A positive educational development and reform is very challenging and needs more effort and strategy on how to use and utilize the resources effectively as such it can achie...
发表评论
阅读全文