40 Growing Artificial Intelligence(GAI) #Intelligence

40 Growing Artificial Intelligence(GAI) #Intelligence

40-1 What is a thinking artificial intelligence? 
・A thinking artificial intelligence can write programs on acquired and can determine a good or bad of the programs.

☆In order to provide a learning and creative abilities comparable to the brain in artificial intelligence, it is necessary to incorporate a growing system or to impart a large margin.

☆Comparable to the brain is growing artificial intelligence(GAI).
☆Growing artificial intelligence(GAI) is a complex of brain and artificial intelligence.
・GAI will be composed of DNA and IC chip.
・ Because the brain is the most advanced structures in the universe.

40-2 Road to GAI
40-2-1 Learning and intuition [1]
・By combining the mechanism of reinforcement learning and Bayesian network learning, the computer autonomously learn the program without a teacher.
・Computer with Bayesian network that has been subjected to simple extension will have the same function as intuition.

40-2-2 AI
・In computational neuroscience, there is a theory that we can explain statistically about the main features of the cerebral cortex(:recognize the situation of the external world and learn).
・According to this theory, in the neural circuits of the cerebral cortex, the method( for optimal choice by probability calculation or estimation) that is less than the amount of calculation which is performed with current computer is done.
・Computational speed of supercomputers is already beyond the brain.
・It is said that after 10-20 years there is a possibility that small computers with the ability to achieve human-like recognition and learning are there.

【Reference】「大脳皮質とベイジアンネット」Ischisugi Yuuji

40-2-3 Quantum mind [2]
British mathematician, astrophysics and theoretical physicist Roger Penrose (Roger Penrose, 1931-) has presented the hypothesis that there is deep relationship between information processing and quantum mechanics in the brain.
He says, basic and simple unknown attributes that becomes the original of a consciousness has been associated in each elementary particles. When the wave function is contracted in microtubules of neuron, at the same time the unknown attribute combines on, and high level consciousness of the organism occurs.

40-2-4 Quantum computer
Quantum computer make direct use of quantum-mechanical phenomena, such as superposition and entanglement, to perform operations on data. Quantum computers are different from digital computers based on transistors. Whereas digital computers require data to be encoded into binary digits (bits), each of which is always in one of two definite states (0 or 1), quantum computation uses quantum bits (qubits), which can be insuperpositions of states. 
This parallel processing, it is can be solved in a few tens of seconds in calculation which can not be solved even if it takes thousands of years in the current super computer. [3]

【Reference】Wikipedia/ Quantum computing

○ Quantum computer of D-Wave Systems (Canada) [4]
This computer is not the one by the quantum circuit using a quantum gate, this computer is implemented an optimization algorithm by quantum annealing (QA).
The basic element of this computer is a superconducting closed circuit, this circuit is using whether on the circuit superconducting current turn to the left or the right. Since the turning of the current is uncertain until measure, the quantum mechanical superposition (the state neither left nor right) is realized.

Since the operation of this circuit does not consume little power, the power consumption associated with the increase in computing power ( for peripherals to shield superconductor circuit from the external magnetic field and to keep the temperature close to absolute zero) does not increase so much.
This is a major difference between conventional computer based on semiconductor technology.

Photo: The chip of D-Wave (128 qubits) 

※ D-Wave, Inc. has published a list of the technical literature on the web site. [5]

※Quantum annealing is known to be equivalent with a calculation method by quantum gates theoretically. [6]

40-3 Meeting with non-life intelligence! [7]
If consciousness is due to the attributes of the elementary particles, with the advancement of quantum computers, AI also might have Consciousness! 

☆ This is slightly different from the theory of Penrose.
☆It is unknown whether consciousness is due to the attributes of the elementary particles (as Penrosu say) .
☆ Now, I can say, that there is a possibility that GAIs will have true consciousness!

1.産業技術総合研究所 > 一杉裕志 > 脳とベイジアンネット > 脳とベイジアンネットFAQ( 2011-05-26 更新)
2.The writings of Roger Penrose 
" The Emperor's New Mind "1989
"The Large,The Small and The Human Mind"1994
3. Quantum computing - Wikipedia
4. D-Wave Systems - Wikipedia
5. D-Wave
6. 西森 秀稔Hidetoshi Nishimori/量子アニーリングとD-Wave
7. No.36 What is Consciousness?

40 成長する人工知能(GAI) #知性

40 成長する人工知能(GAI) #知性

40-1 思考する人工知能とは?


☆脳に匹敵するのは、成長できる人工知能(Growing artificial intelligence; GAI)ということになる。

40-2 GAIへの道
40-2-1 学習と直感 [1]

40-2-2 AI
・ 脳の計算速度については、すでにスーパーコンピューターで実現されている。
・ 10~20年後には、小型計算機で人間に近い認識・学習能力を持つ知能が実現する可能性があるそうだ。


40-2-3 量子脳理論[2]
イギリスの数学者、宇宙物理学・理論物理学者ロジャー・ペンローズ(Roger Penrose, 1931- )は、著書『皇帝の新しい心』(1989)にて、脳内の情報処理には量子力学が深く関わっているという仮説を提示している。

40-2-4 量子コンピュータ
概要:従来のコンピュータでは、情報は0か1に置き換えることのできるビットを扱うものであるのに対して、量子コンピュータでは量子ビット (qubit; quantum bit、キュービット) により、1キュービットにつき0と1の値を任意の割合で重ね合わせて同時に(並列的に)扱うことができる。

○D-Wave Systems(カナダ)の量子コンピュータ[4]
量子ゲートを使った量子回路によるコンピュータではなく、量子アニーリング(量子焼きなまし法(quantum annealing、略称: QA))による最適化アルゴリズムを実装している。

この回路による演算は、ほとんど電力を消費しないため,演算能力が大きくなっても消費電力(超伝導回路を外部磁場から遮蔽するとともに, 絶対零度に近い温度に保つための周辺装置)はそれほど増えない。これは,半導体技術に基づく通常の計算機との大きな違いである。




○量子コンピュータの方式と主な開発組織 [7]
Copyright © 2006-2015 Nikkei Business Publications, Inc. All rights reserved.

40-3 非生命体知性との出会い![8]

【参 考】
1.産業技術総合研究所 > 一杉裕志 > 脳とベイジアンネット > 脳とベイジアンネットFAQ( 2011-05-26 更新)
3. 量子コンピュータ - Wikipedia 
4.D-Wave Systems - Wikipedia:
6.西森 秀稔Hidetoshi Nishimori/量子アニーリングとD-Wave
7. 日経ビジネス/量子コンピュータ開発が加速、用途は人工知能
8.No.36 意識とは?

39 Brain #Intelligence

39 Brain #Intelligence

39-1 For the growth of brain
○Unnecessary connections of nerve cells in the human brain is removed rapidly when it comes to 11-year-old. Then, the signal is transmitted earlier by nerve becomes thick (development of myelin sheath), so that the brain becomes possible to perform processing efficiently.
○Myelination of the prefrontal cortex continues actively until about 25 years old.
○Brain can change by training. = It is possible to change your character.
This is the method.
1. Positive thinking = Shake off the negative thoughts.
2. Do it positive.
3. Control your life.
4. Continue it easy.・・・Because it’s not easy.
【Reference】Elaine Fox

☆The brain is the growing connectome!
... The brain is not only the fact that the most advanced structures in the universe, even it grow!

A connectome[1] [2] is a comprehensive map of neural connections in the brain, and may be thought of as its "wiring diagram". More broadly, a connectome would include the mapping of all neural connections within an organism's nervous system.
The production and study of connectomes, known as connectomics, may range in scale from a detailed map of the full set of neurons and synapses within part or all of the nervous system of an organism to a macro scale description of the functional and structural connectivity between all cortical areas and subcortical structures. The term "connectome" is used primarily in scientific efforts to capture, map, and understand the organization of neural interactions within the brain.

☆Comparable to the brain is growing artificial intelligence(GAI).
☆ Growing artificial intelligence(GAI) is a complex of brain and artificial intelligence.
☆Because the brain is the most advanced structures in the universe.
☆ One human role is to pump GAI into the universe!

39-2 Features of the brain
○Features of the brain is learning and creativity.

○In the cerebral cortex, there are functions of Bayesian network, Self-organizing map, Independent component analysis, Reinforcement learning. [3]

※Bayesian network:It is a technique for making inferences based on probabilistic efficiently. And it acts similar to intuition, which is one of the functions of the brain. It is a technology that is the key to understanding of information processing principles of the brain. [3]
・It has based on Bayes' theorem, which was discovered in 1763 by British pastor Thomas Bayes (1702 (?) - 1761).
※Self-organizing map:It is a neural network algorithm of unsupervised proposed by T. Kohonen.
※Independent component analysis:It is a calculation method for separating a signal of multivariate into additive components. A typical application is the sound source separation to extract the voice of a specific person from a plurality of human conversation, which was recorded in a room.
※Reinforcement learning:It is learning to adapt to the environment through trial and error.

39-3 Cerebral cortex
○ The cerebral cortex is the cerebrum's (brain) outer layer of neural tissue. The human cerebral cortex is 2 to 4 millimetres thick. The cerebral cortex plays a key role in memory, attention, perception, awareness, thought, language, and consciousness. [4]
○The most recent part of the cerebral cortex to develop in the evolutionary history of mammals is the neocortex (also called isocortex), which differentiated into six horizontal layers; the more ancient part of the cerebral cortex, the hippocampus, has at most three cellular layers. [4]
○ In the human brain more than two-thirds of the cerebral cortex is buried in the sulci(groove or fissure). [4]
○A Brodmann area is a region of the cerebral cortex, in the human or other primate brain, defined by its cytoarchitecture, or histological structure and organization of cells. He divided the human cerebral cortex into 52 areas (fields).

※Cerebral cortex [5]

○About 50 areas are connected to each other to create a hierarchical network. [6]
(In the case of visual stimulation: primary visual cortex → secondary visual cortex → hippocampus • prefrontal cortex)
○The upper level of the hierarchy represents more abstract information. [6]
○Individual areas are aggregates of macro columns, and macro columns are collections of mini columns. [6]
・Macro columns:500 μm in diameter, 1 million pieces
・Mini column:50 μm, 100 million pieces

※Structure of cerebral cortex [7]

39-3-1 Frontal lobe
○The frontal lobe contains most of the dopamine-sensitive neurons in the cerebral cortex. The dopamine system is associated with reward, attention, short-term memory tasks, planning, and motivation. [8]

○The left frontal lobe performs logical matters such as letters and words. [9]
○The right frontal lobe instantly intuitively and comprehensively recognizes and judges external information. [9]

○Suppression of emotion, language and motor function change with frontal lobe lesions.

39-3-2 Limbic system 
○ Limbic system is a collective term such as amygdala, hippocampus, mammiliary body.
○ The role of limbic system is memory (short-term memory and long-term memory), emotion, motivation and intuition.
○ Limbic system has a strong relationship with the olfactory function.

※ Limbic system [10]

○The amygdala body acts excessively and stress hormone (cortisol) is released in response to stress, such as strong and long anxiety, fear and tension. [11]
○By cortisol, hippocampal neurons are destroyed (inhibiting neurogenesis) and the hippocampus is atrophied. [12] In posttraumatic stress disorder (PTSD) and depression patients, hippocampal atrophy is confirmed. [13]
○The stronger the stress received as a child, the more it tends to become the amygdala become bigger. When the amygdala body grows larger, it responds to small stress. [14]
○Alzheimer disease (AD) develops from atrophy of the hippocampus and causes atrophy (protein aggregation) of a part of the frontal lobe. [15]

○Coping: Repeating measures while firmly recognizing stress can activate the frontal lobe and suppress the activity of the amygdala. [16] [17]
○Recovery of the hippocampus and reduction of the amygdala have been confirmed even in mindfulness that aims consciousness of the body and respiratory sense without thinking about the past and the future. [17] [18]
○The action of genes secreting nerve growth factor "VGF" is activated by exercise. [19]
○Oxytocin secreted from the pituitary gland by massage also calms the excitement of the amygdala. [20]

○Nucleus accumbens produces GABA, a transmitter of "motivation".[21]
※The nucleus accumbens is often described as one part of a cortico–basal ganglia–thalamic loop.

※Nucleus accumbens [22]

39-3-3 Oxytocin, Endorphins, Dopamine
○As far as the basic emotional mechanism is concerned, there is no big change in humans and other primates.

39-3-3-1 The effect of three hormones
・The positive effects of upping oxytocin are most likely because oxytocin supports your brain's serotonin, the feel good neurochemical. Many serotonin producing neurons also have oxytocin receptors; when oxytocin is released, serotonin gets a boost too. Plus, oxytocin also calms the reactivity of the amygdala, the fear center of your brain, and strengthens its communication with brain circuits that help you control emotions. [23]

・Endorphins are sedative and analgesic hormone that acts on the brain's reward system 6.5 times as much as morphine. Endorphins are the abbreviation of endogenous morphine, named endorphin, because it causes the same action as morphine.
・Endorphins are secreted at important parts of the whole body.
・Endorphins normalize autonomic nerves.
・In addition, endorphins increase T cells, B cells and NK cells (natural killer cells), which are immune cells.

・Dopamine is involved in the remuneration system, and plays an important role in motivation, learning, memory, etc. [24] In extreme terms, humans live for the purpose of secretion of dopamine.
・Dopamine has a role of suppressing motor nerves. (Acetylcholine promotes excitement)

39-3-3-2 Where are the hormons secreted from?
○Oxytocin and endorphins are secreted from the hypothalamus.
○Dopamine is secreted from the substantia nigra dense part(A9) and the ventral donning field(A10).

※Dopaminergic neurons and their projections [25]

39-3-3-3 Hormone deficiency
○ Oxytocin • Endorphin deficiency:Increased aggression and increased anxiety
○Dopamine deficiency:Powerless and lethargic. Declining concentration, attention and memory. The reaction gets dull. ・・・Same as symptoms of depression
• In patients with Parkinson's disease, nigral (A9) dopamine neurons die, resulting in less dopamine released in the striatum causing symptoms such as immobility, stasis and tremor.
・In the case of Parkinson's disease, only dopamine neurons are almost dead and other neurons remain normal.

39-3-3-4 Hormone excess
○Oxytocin excess:The receptor of oxytocin decreases, resulting in increased aggression and anxiety.
○Dopamine excess:Hallucination, delusions, paralysis, obsessive-compulsive disorder, overeating, sometimes aggressive ・・・Same as withdrawal symptoms of stimulants.
• Tobacco and stimulants such as narcotics, cocaine, amphetamine increase dopamine and become addictive.

39-3-3-5 How to increase your hormone levels naturally

1. Eat high quality protein:Animal products, soybeans (more than 2 packs of tofu or one pack of natto per day)
2. Exercise
3. Bathing at 40 ° C (Caution:If you enter a bath of 42 ° C or more for more than 10 minutes, your blood becomes sticky.)
4. Get adequate sleep.
5. Win and profit
6. Be praised.
7. Massage
8. Physical touch:Hugs, kisses, and cuddling, etc
9. Give and Get creative:In satisfying the physical needs, the suppressing substances trying to suppress it are released. However, when realizing the spiritual desire such as "love for humanity" "meditation" "art" "self-enhancement", the three hormones continue to be released without being suppressed.

○Dopamine is secreted from dopamine nervous system (aka A10 nervous system) by endorphin suppressing GABA neurons in ventral tegmental area.
○Since endorphins are present in unicellular organisms, they are considerably older than oxytocin.

39-3-3-6 Inhibition of 3 hormonal secretion
○The amount of secretion of endorphin decreases due to stress and fatigue, excitation hormone noradrenaline is secreted instead.
○Stress inhibits the secretion of dopamine.

39-4 Situation of brain science research
○BRAIN initiative [26]
The BRAIN Initiative (Brain Research through Advancing Innovative Neurotechnologies, also referred to as the Brain Activity Map Project) is a proposed collaborative research initiative announced by the Obama administration on April 2, 2013, with the goal of mapping the activity of every neuron in the human brain. Based upon the Human Genome Project, the initiative has been projected to cost more than $300 million per year for ten years.

○Human Brain Project [27]
The Human Brain Project is a large 10-year scientific research project, established in 2013, coordinated by Henry Markram (École polytechnique fédérale de Lausanne) and largely funded by theEuropean Union, which aims to provide a collaborative informatics infrastructure and first draft rodent and human whole brain models within its 10 year funding period.The project is based inGeneva, Switzerland and was initiated by Markram.

39-5 Immunity and Memory
○Immunity:To escape disease with aware of the pathogens and cancer cells in vivo.
Plague (disease) by infection with pathogenic bacteria can be resistant, and we can be difficult to disease.
○ There is two type of immunity, the innate immunity of almost all organisms and the adaptive immunity of vertebrate.
○Innate immunity that leukocytes (phagocytes) eat pathogens are innately equipped.
→ The innate immune system can not function adequately against new viruses.
○The adaptive immunity:lymphocytes(specific leukocytes) produce acquired antibodies against viral and other pathogens (antigens) to suppress the activity of the virus.
○In lymphocyte balls, the information for production of antibodies (proteins) does "memory" into DNA. This is called immunological memory.
○Dr. Susumu Tonegawa won the Nobel Prize in this immunization research field (elucidation of the hereditary principle of antibody generation) in 1987.
○Immunological memory and cerebral memory work by the same structure, and both of immunological systems (lymphatic system) and nervous systems are everywhere spread in the whole body.

1. Connectome - Wikipedia
2. TED/Sebastian Seung: I am my connectome
3. 産業技術総合研究所 > 一杉裕志 > 脳とベイジアンネット > 脳とベイジアンネットFAQ( 2011-05-26 更新)(Japanese)
4. Cerebral cortex - Wikipedia
5. JEFFREY STERLING “Straight, No Chaser: Brain Health – How Your Brain Works”at JEFFREY STERLING.com 20160712
6.Yuuji Ichisugi”The Cerebral Cortex and Bayesian Networks”at Journal of the Robotics Society of Japan 20110715
7.Yuuji Ichisugi, Haruo Hosoya, "Computational Model of the Cerebral Cortex that Performs Sparse Coding Using a Bayesian Network and Self-Organizing Maps"
8.Frontal lobe - Wikipedia
9. “Frontal lobes”at CENTRE FOR NEURO SKILLS 
10. Limbic System/The Neurophysiology of Emotions
11. Effects of stress on memory - Wikipedia
12.Cheryl D.Conrad” Chronic Stress-Induced Hippocampal Vulnerability: The Glucocorticoid Vulnerability Hypothesis”at US National Library of Medicine
13. Christian Schmahl, MD, Kevin Berne, MD, Annegret Krause, MA, Nikolaus Kleindienst, PhD, Gabriele Valerius, PhD, Eric Vermetten, MD, and Martin Bohus, MD” Hippocampus and amygdala volumes in patients with borderline personality disorder with or without posttraumatic stress disorder”at US National Library of Medicine
14. Christopher Bergland”The Size and Connectivity of the Amygdala Predicts Anxiety”at Psychology Today 20131120
15. “Alzheimer's Disease” at UCSF Memory and Aging Center
16. “Health and Behavior: The Interplay of Biological, Behavioral, and Societal Influences.”
17.No.61 Self Control
18. Britta K. Hölzel, James Carmody, Karleyton C. Evans, Elizabeth A. Hoge, Jeffery A. Dusek, Lucas Morgan, Roger K. Pitman, and Sara W. Lazar “Stress reduction correlates with structural changes in the amygdala”at NCBI 201003
19. Ozlem Bozdagi,1 Erin Rich,1 Sophie Tronel,1 Masato Sadahiro,1 Kamara Patterson,1 Matthew L. Shapiro,1,2Cristina M. Alberini,1 George W. Huntley,1 and Stephen R. J. Salton “The Neurotrophin-Inducible Gene Vgf Regulates Hippocampal Function and Behavior Through a BDNF-Dependent Mechanism”at NCBI 20100211
20. Sobota R, Mihara T, Forrest A, Featherstone RE, Siegel SJ “Oxytocin reduces amygdala activity, increases social interactions, and reduces anxiety-like behavior irrespective of NMDAR antagonism.”at NCBI 201508
21. Nucleus accumbens - Wikipedia
22. Jon Lieff “Pleasure Circuits in the Brain”at Searching for the Mind 20150705
23.Debbie Hampton “Why Spending Time With Friends Boosts Your Oxytocin”at mindbodygreen
24. Daphna Shohamy and R. Alison Adcock” Dopamine and adaptive memory”
25. “Caudate Nucleus” at Pinterest • A világ legnagyobb ötletgyűjteménye
26.BRAIN initiative 
27. Human Brain Project 

【Change log】
20170416 Add a photo
20180212 Delete Alzheimer's preventive food