image:
(a) Diagram illustrating the ion channel activity in post-synaptic neurons. AMPA receptors are involved in the activation of post-synaptic neurons, while NMDA receptors are blocked by magnesium ions (Mg) but induce synaptic plasticity through the influx of calcium ions (Ca) when the post-synaptic neuron is sufficiently activated. (b) Flow diagram representing the computational process within the Transformer AI model. Information is processed sequentially through stages such as feed-forward layers, layer normalization, and self-attention layers. The graph depicting the current-voltage relationship of the NMDA receptors is very similar to the nonlinearity of the feed-forward layer. The input-output graph, based on the concentration of magnesium (), shows the changes in the nonlinearity of the NMDA receptors.
Credit: Institute for Basic Science
An interdisciplinary team consisting of researchers from the Center for Cognition and Sociality and the Data Science Group within the Institute for Basic Science (IBS) revealed a striking similarity between the memory processing of artificial intelligence (AI) models and the hippocampus of the human brain. This new finding provides a novel perspective on memory consolidation, which is a process that transforms short-term memories into long-term ones, in AI systems.
In the race towards developing Artificial General Intelligence (AGI), with influential entities like OpenAI and Google DeepMind leading the way, understanding and replicating human-like intelligence has become an important research interest. Central to these technological advancements is the Transformer model [Figure 1], whose fundamental principles are now being explored in new depth.
The key to powerful AI systems is grasping how they learn and remember information. The team applied principles of human brain learning, specifically concentrating on memory consolidation through the NMDA receptor in the hippocampus, to AI models.
The NMDA receptor is like a smart door in your brain that facilitates learning and memory formation. When a brain chemical called glutamate is present, the nerve cell undergoes excitation. On the other hand, a magnesium ion acts as a small gatekeeper blocking the door. Only when this ionic gatekeeper steps aside, substances are allowed to flow into the cell. This is the process that allows the brain to create and keep memories, and the gatekeeper's (the magnesium ion) role in the whole process is quite specific.
The team made a fascinating discovery: the Transformer model seems to use a gatekeeping process similar to the brain's NMDA receptor [see Figure 1]. This revelation led the researchers to investigate if the Transformer's memory consolidation can be controlled by a mechanism similar to the NMDA receptor's gating process.
In the animal brain, a low magnesium level is known to weaken memory function. The researchers found that long-term memory in Transformer can be improved by mimicking the NMDA receptor. Just like in the brain, where changing magnesium levels affect memory strength, tweaking the Transformer's parameters to reflect the gating action of the NMDA receptor led to enhanced memory in the AI model. This breakthrough finding suggests that how AI models learn can be explained with established knowledge in neuroscience.
C. Justin LEE, who is a neuroscientist director at the institute, said, This research makes a crucial step in advancing AI and neuroscience. It allows us to delve deeper into the brain's operating principles and develop more advanced AI systems based on these insights.
CHA Meeyoung, who is a data scientist in the team and at KAIST, notes, The human brain is remarkable in how it operates with minimal energy, unlike the large AI models that need immense resources. Our work opens up new possibilities for low-cost, high-performance AI systems that learn and remember information like humans.
What sets this study apart is its initiative to incorporate brain-inspired nonlinearity into an AI construct, signifying a significant advancement in simulating human-like memory consolidation. The convergence of human cognitive mechanisms and AI design not only holds promise for creating low-cost, high-performance AI systems but also provides valuable insights into the workings of the brain through AI models.
Experimental study
Not applicable
Disclaimer: AAAS and EurekAlert! are not responsible for the accuracy of news releases posted to EurekAlert! by contributing institutions or for the use of any information through the EurekAlert system.
Read the original:
AI's memory-forming mechanism found to be strikingly similar to that of the brain - EurekAlert
- Neuroscience Says Music Is an Emotion Regulation Machine. Heres What to Play for Happiness, Productivity, or Deep Thinking - Inc.com - April 19th, 2025 [April 19th, 2025]
- Early Maternal Affection Shapes Key Personality Traits for Life - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- Elons new neuroscience major highlighted by Greensboro News & Record - Elon University - April 19th, 2025 [April 19th, 2025]
- Brain Blast event at St. Lawrence University teaches local students neuroscience - North Country Now - April 19th, 2025 [April 19th, 2025]
- AI Reveals What Keeps People Committed to Exercise - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- The "Holy Grail" of Neuroscience? Researchers Create Stunningly Accurate Digital Twin of the Brain - The Debrief - April 19th, 2025 [April 19th, 2025]
- Annenberg School Vice Dean Emily Falk publishes book on the neuroscience of decision-making - The Daily Pennsylvanian - April 19th, 2025 [April 19th, 2025]
- Music-Induced Chills Trigger Natural Opioids in the Brain - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- What We Value: The Neuroscience of Choice and Change - think.kera.org - April 19th, 2025 [April 19th, 2025]
- Kile takes top neuroscience post at Sutter Health as system pushes to align care, expand trials - The Business Journals - April 19th, 2025 [April 19th, 2025]
- A Grain of Brain, 523 Million Synapses, and the Most Complicated Neuroscience Experiment Ever Attempted - SciTechDaily - April 19th, 2025 [April 19th, 2025]
- Mild Brain Stimulation Alters Decision-Making Speed and Flexibility - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- Cannabis studies were informing fundamental neuroscience in the 1970s - Nature - April 10th, 2025 [April 10th, 2025]
- To make a meaningful contribution to neuroscience, fMRI must break out of its silo - The Transmitter - April 10th, 2025 [April 10th, 2025]
- Steve Jobss Unexpected Secret to Being More Creative (Backed by Neuroscience) - Inc.com - April 10th, 2025 [April 10th, 2025]
- Challenging Decades of Neuroscience: Brain Cells Are More Plastic Than Previously Thought - SciTechDaily - April 10th, 2025 [April 10th, 2025]
- Q&A: Lundbecks head of R&D on letting biology speak in neuroscience - Endpoints News - April 10th, 2025 [April 10th, 2025]
- Why it's hard to study the neuroscience of psychedelics : Short Wave - NPR - April 10th, 2025 [April 10th, 2025]
- Fear Sync: How Males and Females Respond to Stress Together - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- Chemotherapy Disrupts Brain Connectivity - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- Newly awarded NIH grants for neuroscience lag 77 percent behind previous nine-year average - The Transmitter - April 10th, 2025 [April 10th, 2025]
- Wittstein interviewed by The Times News about new neuroscience major - Elon University - April 10th, 2025 [April 10th, 2025]
- Alto Neuroscience initiated with a Buy at H.C. Wainwright - Yahoo Finance - April 10th, 2025 [April 10th, 2025]
- New map of brain hailed as watershed for neuroscience - The Times - April 10th, 2025 [April 10th, 2025]
- GSK Ramps Up Neuroscience Investment With ABL Brain Shuttle Deal - insights.citeline.com - April 10th, 2025 [April 10th, 2025]
- ADHD and Music: Why Background Beats May Boost Study Focus - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- Brains Rewire Themselves to Survive Deadly Infection - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- AbbVie Hold Rating: Balancing Strong Immunology Growth with Challenges in Aesthetics, Neuroscience, and Oncology - TipRanks - April 10th, 2025 [April 10th, 2025]
- Want to Feel Better and Be More Mindful? Neuroscience Says This Habit Might Be Holding You Back - Inc.com - April 10th, 2025 [April 10th, 2025]
- How One Bad Meal Rewires the Brain to Avoid That Food Forever - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- Marcus Neuroscience Institute to Host Brain and Spine Symposium - South Florida Hospital News - March 30th, 2025 [March 30th, 2025]
- Elon University to launch neuroscience major in fall 2025 - Today at Elon - March 30th, 2025 [March 30th, 2025]
- The brains stalwart sentinels express an unexpected gene - The Transmitter: Neuroscience News and Perspectives - March 30th, 2025 [March 30th, 2025]
- Video catches microglia in the act of synaptic pruning - The Transmitter: Neuroscience News and Perspectives - March 30th, 2025 [March 30th, 2025]
- Null and Noteworthy: Reexamining registered reports - The Transmitter: Neuroscience News and Perspectives - March 30th, 2025 [March 30th, 2025]
- Accepting the bitter lesson and embracing the brains complexity - The Transmitter: Neuroscience News and Perspectives - March 30th, 2025 [March 30th, 2025]
- NIH neurodevelopmental assessment system now available as iPad app - The Transmitter: Neuroscience News and Perspectives - March 30th, 2025 [March 30th, 2025]
- Stronger Bonds Before Birth Shape Healthier Mother-Child Futures - Neuroscience News - March 30th, 2025 [March 30th, 2025]
- How Emotionally Intelligent People Learn to Control Their Inner Voice, Backed by Neuroscience - Inc. - March 30th, 2025 [March 30th, 2025]
- Gabriele Scheler reflects on the interplay between language, thought and AI - The Transmitter: Neuroscience News and Perspectives - March 30th, 2025 [March 30th, 2025]
- Worlds first crowd-sourced neuroscience study aims to understand how our brains predict the future - EurekAlert - March 15th, 2025 [March 15th, 2025]
- Rewriting Neuroscience: Possible Foundations of Human Intelligence Observed for the First Time - SciTechDaily - March 15th, 2025 [March 15th, 2025]
- Calculating neurosciences carbon cost: Q&A with Stefan Pulver and William Smith - The Transmitter: Neuroscience News and Perspectives - March 15th, 2025 [March 15th, 2025]
- The future of neuroscience research at U.S. minority-serving institutions is in danger - The Transmitter: Neuroscience News and Perspectives - March 15th, 2025 [March 15th, 2025]
- Dopamine and social media: Why you cant stop scrolling, according to neuroscience - PsyPost - March 15th, 2025 [March 15th, 2025]
- Neuroscience Discovered a Clever Trick for Squeezing More Joy Out of Everyday Pleasures - Inc. - March 15th, 2025 [March 15th, 2025]
- The limits of neuroscience - The Transmitter: Neuroscience News and Perspectives - March 15th, 2025 [March 15th, 2025]
- BPOM Explains The Benefits Of Fasting From The Health And Neuroscience Side - VOI English - March 15th, 2025 [March 15th, 2025]
- How tiny tardigrades could help tackle systems neuroscience questions - The Transmitter: Neuroscience News and Perspectives - March 15th, 2025 [March 15th, 2025]
- Alison Preston explains how our brains form mental frameworks for interpreting the world - The Transmitter: Neuroscience News and Perspectives - March 15th, 2025 [March 15th, 2025]
- The Mystical Mind Meets Neuroscience: Seeking the Roots of Consciousness - Next Big Idea Club Magazine - March 15th, 2025 [March 15th, 2025]
- Myosin Therapeutics Closes Second Seed Round to Advance Clinical Trials for Innovative Cancer and Neuroscience Therapies - PR Newswire - March 5th, 2025 [March 5th, 2025]
- Neuroscience Ph.D. programs adjust admissions in response to U.S. funding uncertainty - The Transmitter: Neuroscience News and Perspectives - March 5th, 2025 [March 5th, 2025]
- New tools help make neuroimaging accessible to more researchers - The Transmitter: Neuroscience News and Perspectives - March 5th, 2025 [March 5th, 2025]
- Future Thinking Training Reduces Impulsivity - Neuroscience News - March 5th, 2025 [March 5th, 2025]
- Null and Noteworthy, relaunched: Probing a schizophrenia biomarker - The Transmitter: Neuroscience News and Perspectives - March 5th, 2025 [March 5th, 2025]
- How to communicate the value of curiosity-driven research - The Transmitter: Neuroscience News and Perspectives - March 5th, 2025 [March 5th, 2025]
- Cognitive neuroscience approach to explore the impact of wind turbine noise on various mental functions - Nature.com - March 5th, 2025 [March 5th, 2025]
- Football on the Brain: Helping coaches embed neuroscience knowledge - Training Ground Guru - March 5th, 2025 [March 5th, 2025]
- Taking Control: Using Neuroscience to Build Better Lives - theLoop - March 5th, 2025 [March 5th, 2025]
- Creating a pipeline of talent to feed the growth of Neuroscience: Lessons from Ghana - Myjoyonline - March 5th, 2025 [March 5th, 2025]
- Exclusive: NIH appears to archive policy requiring female animals in studies - The Transmitter: Neuroscience News and Perspectives - February 25th, 2025 [February 25th, 2025]
- Roll On Down The Highway 2025 Tour coming to Neuroscience Group Field - WeAreGreenBay.com - February 25th, 2025 [February 25th, 2025]
- STEM organizations host Neuroscience Outreach Fair for local K-12 students - University of Virginia The Cavalier Daily - February 25th, 2025 [February 25th, 2025]
- Adapt or die: Safeguarding the future of diversity and inclusion funding in neuroscience - The Transmitter: Neuroscience News and Perspectives - February 25th, 2025 [February 25th, 2025]
- The last two-author neuroscience paper? - The Transmitter: Neuroscience News and Perspectives - February 25th, 2025 [February 25th, 2025]
- Gate Neurosciences Strengthens Focus on the Synapse as a Therapeutic Target with Acquisition of Boost Neuroscience - Business Wire - February 25th, 2025 [February 25th, 2025]
- Why Firefly Neuroscience, Inc. (AIFF) Is Soaring This Year So Far - Yahoo Finance - February 25th, 2025 [February 25th, 2025]
- Breaking the barrier between theorists and experimentalists - The Transmitter: Neuroscience News and Perspectives - February 25th, 2025 [February 25th, 2025]
- Preserving Brain Health and Advancing Neuroscience - University of Miami - February 25th, 2025 [February 25th, 2025]
- Science must step away from nationally managed infrastructure - The Transmitter: Neuroscience News and Perspectives - February 25th, 2025 [February 25th, 2025]
- Repurposed Blood Pressure Drug May Treat ADHD - Neuroscience News - February 25th, 2025 [February 25th, 2025]
- How to teach students about science funding - The Transmitter: Neuroscience News and Perspectives - February 25th, 2025 [February 25th, 2025]
- Reflecting on 2024: Advancing Neuroscience Research to Improve Neurological Health - National Institute of Neurological Disorders and Stroke - February 25th, 2025 [February 25th, 2025]
- Brains Hidden Circuitry for Risk and Reward Uncovered - Neuroscience News - February 25th, 2025 [February 25th, 2025]
- Why We Keep Exploring Even After Learning the Best Strategy - Neuroscience News - February 25th, 2025 [February 25th, 2025]
- Unlocking Cellular Youth: The Protein That Reverses Aging - Neuroscience News - February 25th, 2025 [February 25th, 2025]
- This paper changed my Life: Bill Newsome reflects on a quadrilogy of classic visual perception studies - The Transmitter: Neuroscience News and... - February 25th, 2025 [February 25th, 2025]
- Roundup: The false association between vaccines and autism - The Transmitter: Neuroscience News and Perspectives - February 3rd, 2025 [February 3rd, 2025]
- Static pay, shrinking prospects fuel neuroscience postdoc decline - The Transmitter: Neuroscience News and Perspectives - February 3rd, 2025 [February 3rd, 2025]