[논문]Visual number sense in untrained deep neural networks

Kim, Gwangsu; Jang, Jaeson; Baek, Seungdae; Song, Min; Paik, Se-Bum

doi:10.1126/sciadv.abd6127

[해외논문] Visual number sense in untrained deep neural networks 원문보기

Science advances, v.7 no.1, 2021년, pp.eabd6127 -

Kim, Gwangsu (Department of Physics, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea.) , Jang, Jaeson (Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea.) , Baek, Seungdae (Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea.) , Song, Min (Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea.) , Paik, Se-Bum (Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea.)

Abstract ▼ AI-Helper

Visual number sense can arise spontaneously in untrained deep neural networks in the complete absence of learning.Number sense, the ability to estimate numerosity, is observed in naïve animals, but how this cognitive function emerges in the brain remains unclear. Here, using an artificial deep neural network that models the ventral visual stream of the brain, we show that number-selective neurons can arise spontaneously, even in the complete absence of learning. We also show that the responses of these neurons can induce the abstract number sense, the ability to discriminate numerosity independent of low-level visual cues. We found number tuning in a randomly initialized network originating from a combination of monotonically decreasing and increasing neuronal activities, which emerges spontaneously from the statistical properties of bottom-up projections. We confirmed that the responses of these number-selective neurons show the single- and multineuron characteristics observed in the brain and enable the network to perform number comparison tasks. These findings provide insight into the origin of innate cognitive functions.

참고문헌 (57)

1 Burr D. C. , Anobile G. , Arrighi R. , Psychophysical evidence for the number sense . Philos. Trans. R. Soc. B Biol. Sci. 373 , 20170045 ( 2018 ).
2 Halberda J. , Mazzocco M. M. M. , Feigenson L. , Individual differences in non-verbal number acuity correlate with maths achievement . Nature 455 , 665 – 668 ( 2008 ). 18776888

상세보기
3 Nieder A. , The neuronal code for number . Nat. Rev. Neurosci. 17 , 366 – 382 ( 2016 ). 27150407

상세보기
4 Izard V. , Sann C. , Spelke E. S. , Streri A. , Newborn infants perceive abstract numbers . Proc. Natl. Acad. Sci. U.S.A. 106 , 10382 – 10385 ( 2009 ). 19520833

상세보기
5 Rugani R. , Vallortigara G. , Priftis K. , Regolin L. , Number-space mapping in the newborn chick resembles humans’ mental number line . Science 347 , 534 – 536 ( 2015 ). 25635096

상세보기
6 Viswanathan P. , Nieder A. , Neuronal correlates of a visual “sense of number” in primate parietal and prefrontal cortices . Proc. Natl. Acad. Sci. U.S.A. 110 , 11187 – 11192 ( 2013 ). 23776242

상세보기
7 Wagener L. , Loconsole M. , Ditz H. M. , Nieder A. , Neurons in the endbrain of numerically naive crows spontaneously encode visual numerosity . Curr. Biol. 28 , 1090 – 1094.e4 ( 2018 ). 29551415
8 Krizhevsky A. , Sutskever I. , Hinton G. E. , ImageNet classification with deep convolutional neural networks . Adv. Neural Inf. Process. Syst. (NIPS) , 1097 – 1105 ( 2012 ).
9 Yamins D. L. K. , Hong H. , Cadieu C. F. , Solomon E. A. , Seibert D. , DiCarlo J. J. , Performance-optimized hierarchical models predict neural responses in higher visual cortex . Proc. Natl. Acad. Sci. U.S.A. 111 , 8619 – 8624 ( 2014 ). 24812127

상세보기
10 Ullman S. , Vidal-Naquet M. , Sali E. , Visual features of intermediate complexity and their use in classification . Nat. Neurosci. 5 , 682 – 687 ( 2002 ). 12055634

상세보기
11 Di Nuovo A. , McClelland J. L. , Developing the knowledge of number digits in a child-like robot . Nat. Mach. Intell. 1 , 594 – 605 ( 2019 ).

상세보기
12 Cadieu C. F. , Hong H. , Yamins D. L. K. , Pinto N. , Ardila D. , Solomon E. A. , Majaj N. J. , DiCarlo J. J. , Deep neural networks rival the representation of primate IT cortex for core visual object recognition . PLOS Comput. Biol. 10 , e1003963 ( 2014 ). 25521294

상세보기
13 Khaligh-Razavi S.-M. , Henriksson L. , Kay K. , Kriegeskorte N. , Fixed versus mixed RSA: Explaining visual representations by fixed and mixed feature sets from shallow and deep computational models . J. Math. Psychol. 76 ( Pt. B ), 184 – 197 ( 2017 ). 28298702
14 Cichy R. M. , Roig G. , Andonian A. , Dwivedi K. , Lahner B. , Lascelles A. , Mohsenzadeh Y. , Ramakrishnan K. , Oliva A. , The algonauts project: A platform for communication between the sciences of biological and artificial intelligence . arXiv 1905.05675 , ( 2019 ).
15 Bashivan P. , Kar K. , DiCarlo J. J. , Neural population control via deep image synthesis . Science 364 , eaav9436 ( 2019 ). 31048462

상세보기
16 Stoianov I. , Zorzi M. , Emergence of a ’visual number sense’ in hierarchical generative models . Nat. Neurosci. 15 , 194 – 196 ( 2012 ). 22231428

상세보기
17 Verguts T. , Fias W. , Representation of number in animals and humans: A neural model . J. Cogn. Neurosci. 16 , 1493 – 1504 ( 2004 ). 15601514

상세보기
18 Dehaene S. , Changeux J.-P. , Development of elementary numerical abilities: A neuronal model . J. Cogn. Neurosci. 5 , 390 – 407 ( 1993 ). 23964915

상세보기
19 Zorzi M. , Testolin A. , An emergentist perspective on the origin of number sense . Philos. Trans. R. Soc. B Biol. Sci. 373 , 20170043 ( 2018 ).
20 Testolin A. , Zou W. Y. , McClelland J. L. , Numerosity discrimination in deep neural networks: Initial competence, developmental refinement and experience statistics . Dev. Sci. 23 , e12940 ( 2020 ). 31977137
21 Nasr K. , Viswanathan P. , Nieder A. , Number detectors spontaneously emerge in a deep neural network designed for visual object recognition . Sci. Adv. 5 , eaav7903 ( 2019 ). 31086820

상세보기
22 Ullman S. , Harari D. , Dorfman N. , From simple innate biases to complex visual concepts . Proc. Natl. Acad. Sci. U.S.A. 109 , 18215 – 18220 ( 2012 ). 23012418

상세보기
23 Hannagan T. , Nieder A. , Viswanathan P. , Dehaene S. , A random-matrix theory of the number sense . Philos. Trans. R. Soc. B Biol. Sci. 373 , 20170253 ( 2018 ).
24 Ulyanov D. , Vedaldi A. , Lempitsky V. , Deep image prior . Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR) , 9446 – 9454 ( 2018 ).
25 Ramanujan V. , Wortsman M. , Kembhavi A. , Farhadi A. , Rastegari M. , What’s hidden in a randomly weighted neural network? arXiv 1911.13299 , ( 2019 ).
26 Chen Q. , Verguts T. , Spontaneous summation or numerosity-selective coding? Front. Hum. Neurosci. 7 , 886 ( 2013 ). 24391574

상세보기
27 Nieder A. , Merten K. , A labeled-line code for small and large numerosities in the monkey prefrontal cortex . J. Neurosci. 27 , 5986 – 5993 ( 2007 ). 17537970

상세보기
28 He K. , Zhang X. , Ren S. , Sun J. , Delving deep into rectifiers: Surpassing human-level performance on imageNet classification . Proc. IEEE Int. Conf. Comput. Vis. (ICCV) , 1026 – 1034 ( 2015 ).
29 Y. A. LeCun, L. Bottou, G. B. Orr, K.-R. Müller, Efficient Backprop (Springer, Berlin, Heidelberg, 2012), pp. 9–48.
30 M. Bekoff, C. Allen, G. M. Burghardt, The Cognitive Animal: Empirical and Theoretical Perspectives on Animal Cognition (MIT Press, Cambridge, MA, 2002).
31 Cantlon J. F. , Brannon E. M. , Semantic congruity affects numerical judgments similarly in monkeys and humans . Proc. Natl. Acad. Sci. U.S.A. 102 , 16507 – 16511 ( 2005 ). 16260752

상세보기
32 Cantlon J. F. , Brannon E. M. , Shared system for ordering small and large numbers in monkeys and humans . Psychol. Sci. 17 , 401 – 406 ( 2006 ). 16683927

상세보기
33 Roitman J. D. , Brannon E. M. , Platt M. L. , Monotonic coding of numerosity in macaque lateral intraparietal area . PLOS Biol. 5 , e208 ( 2007 ). 17676978

상세보기
34 Nieder A. , Freedman D. J. , Miller E. K. , Representation of the quantity of visual items in the primate prefrontal cortex . Science 297 , 1708 – 1711 ( 2002 ). 12215649

상세보기
35 Leibovich T. , Katzin N. , Harel M. , Henik A. , From “sense of number” to “sense of magnitude”: The role of continuous magnitudes in numerical cognition . Behav. Brain Sci. 40 , e164 ( 2017 ). 27530053

상세보기
36 Burr D. C. , Evidence for a number sense . Behav. Brain Sci. 40 , e167 ( 2017 ). 29342625

상세보기
37 Lourenco S. F. , Aulet L. S. , Ayzenberg V. , Cheung C.-N. , Holmes K. J. , Right idea, wrong magnitude system . Behav. Brain Sci. 40 , e177 ( 2017 ). 29342631

상세보기
38 Nieder A. , Number faculty is alive and kicking: On number discriminations and number neurons . Behav. Brain Sci. 40 , e181 ( 2017 ). 29342639

상세보기
39 Park J. , DeWind N. K. , Brannon E. M. , Direct and rapid encoding of numerosity in the visual stream . Behav. Brain Sci. 40 , e185 ( 2017 ). 29342634

상세보기
40 Stoianov I. P. , Zorzi M. , Computational foundations of the visual number sense . Behav. Brain Sci. 40 , e191 ( 2017 ). 29342650

상세보기
41 Van Rinsveld A. , Guillaume M. , Kohler P. J. , Schiltz C. , Gevers W. , Content A. , The neural signature of numerosity by separating numerical and continuous magnitude extraction in visual cortex with frequency-tagged EEG . Proc. Natl. Acad. Sci. U.S.A. 117 , 5726 – 5732 ( 2020 ). 32123113

상세보기
42 Testolin A. , Dolfi S. , Rochus M. , Zorzi M. , Visual sense of number vs . sense of magnitude in humans and machines . Sci. Rep. 10 , 10045 ( 2020 ). 32572067

상세보기
43 Paik S.-B. , Ringach D. L. , Retinal origin of orientation maps in visual cortex . Nat. Neurosci. 14 , 919 – 925 ( 2011 ). 21623365

상세보기
44 Jang J. , Paik S.-B. , Interlayer repulsion of retinal ganglion cell mosaics regulates spatial organization of functional maps in the visual cortex . J. Neurosci. 37 , 12141 – 12152 ( 2017 ). 29114075

상세보기
45 Jang J. , Song M. , Paik S.-B. , Retino-cortical mapping ratio predicts columnar and salt-and-pepper organization in mammalian visual cortex . Cell Rep. 30 , 3270 – 3279.e3 ( 2020 ). 32160536

상세보기
46 Paik S.-B. , Ringach D. L. , Link between orientation and retinotopic maps in primary visual cortex . Proc. Natl. Acad. Sci. U.S.A. 109 , 7091 – 7096 ( 2012 ). 22509015

상세보기
47 Kim J. , Song M. , Jang J. , Paik S.-B. , Spontaneous retinal waves can generate long-range horizontal connectivity in visual cortex . J. Neurosci. 40 , 6584 – 6599 ( 2020 ). 32680939

상세보기
48 Park Y. , Choi W. , Paik S.-B. , Symmetry of learning rate in synaptic plasticity modulates formation of flexible and stable memories . Sci. Rep. 7 , 5671 ( 2017 ). 28720795

상세보기
49 Lee H. , Choi W. , Park Y. , Paik S.-B. , Distinct role of flexible and stable encodings in sequential working memory . Neural Netw. 121 , 419 – 429 ( 2020 ). 31606611

상세보기
50 Siegler R. S. , Opfer J. E. , The development of numerical estimation: Evidence for multiple representations of numerical quantity . Psychol. Sci. 14 , 237 – 243 ( 2003 ). 12741747

상세보기
51 Nieder A. , Miller E. K. , Coding of cognitive magnitude . Neuron 37 , 149 – 157 ( 2003 ). 12526780
52 Friedman H. R. , Goldman-Rakic P. S. , Coactivation of prefrontal cortex and inferior parietal cortex in working memory tasks revealed by 2DG functional mapping in the rhesus monkey . J. Neurosci. 14 , 2775 – 2788 ( 1994 ). 8182439
53 Swaminathan S. K. , Freedman D. J. , Preferential encoding of visual categories in parietal cortex compared with prefrontal cortex . Nat. Neurosci. 15 , 315 – 320 ( 2012 ). 22246435
54 Lukoševiius M. , Jaeger H. , Reservoir computing approaches to recurrent neural network training . Comput. Sci. Rev. 3 , 127 – 149 ( 2009 ).
55 Tanaka G. , Yamane T. , Héroux J. B. , Nakane R. , Kanazawa N. , Takeda S. , Numata H. , Nakano D. , Hirose A. , Recent advances in physical reservoir computing: A review . Neural Netw. 115 , 100 – 123 ( 2019 ). 30981085

상세보기
56 Zhang M. , Feng J. , Ma K. T. , Lim J. H. , Zhao Q. , Kreiman G. , Finding any Waldo with zero-shot invariant and efficient visual search . Nat. Commun. 9 , 3730 ( 2018 ). 30213937

상세보기
57 Palatucci M. , Pomerleau D. , Hinton G. , Mitchell T. M. , Zero-shot learning with semantic output codes . Adv. Neural Inf. Process. Syst. (NIPS) , 1410 – 1418 ( 2009 ).

LOADING...

활용도 분석정보

상세보기

다운로드

내보내기

활용도 Top5 논문

해당 논문의 주제분야에서 활용도가 높은 상위 5개 콘텐츠를 보여줍니다.
더보기 버튼을 클릭하시면 더 많은 관련자료를 살펴볼 수 있습니다.

표제어: PCR

동의어: Packet Collision Rate

용어 설명 출처 목록 (6)

용어 설명: PCR은 세균 특이성이 있는 primer를 이용하여 적은 수의 세균이 있을지라도 쉽게 검출할 수 있는 유용한 방법이며, 이를 이용하여 구강 내 치면세균막이나 타액에서 직접 세균을 검출할 수 있게 되었다[8].

내보내기 구분	파일저장 인쇄 메일전송
구성항목	기본정보 상세정보 관리번호, 논문명, 저널/프로시딩명, 저자 , 발행년, 권, 호, 시작페이지, 끝페이지, 발행기관 관리번호, 논문명, 대등논문명, 저자 , 저널/프로시딩명, 발행기관, 발행년, 발행언어, 권, 호, 시작페이지, 끝페이지, ISBN, ISSN, 주제분야, 키워드, 초록(한글), 초록(영문), 저자(소속기관)
저장형식	Text(ASCII format) Excel format RefWorks Direct Export RIS format (for Reference Manager, ProCite, EndNote), Scholar's Aids, Mendeley
메일정보	받는사람 (필수) @ 보내는사람 (선택) @ 제목 내용 KISTI 검색결과 이메일 서비스
안내	총 건의 자료가 검색되었습니다. 다운받으실 자료의 인덱스를 입력하세요. (1-10,000) 검색결과의 순서대로 최대 10,000건 까지 다운로드가 가능합니다. 데이타가 많을 경우 속도가 느려질 수 있습니다.(최대 2~3분 소요) 다운로드 파일은 UTF-8 형태로 저장됩니다. 파일의 내용이 제대로 보이지 않을실 때는 웹브라우저 상단의 보기 -> 인코딩 -> 자동선택 여부를 확인하십시오. ~ Text(ASCII format) Excel format

연합인증