Opening the eyes immediately provides a visual perception of the world and it seems so easy. But the process that starts with photons stimulating the retina and ends with seeing is far from simple. The brains fundamental task in seeing is to reconstruct relevant information about the world from the light that enters the eyes. Because this process is rather complex, nerve cells in the brain neurons also react to images in complex ways.
Experimental approaches to characterize the responses of neurons to images have proven challenging in part because the number of possible images is endless. In the past, seminal insights often resulted from stimuli that neurons in the brain liked. Finding them relied on the intuition of the scientists and a good portion of luck, said senior author Dr. Andreas Tolias, professor and Brown Foundation Endowed Chair of Neuroscience at Baylor College of Medicine.
We want to understand how vision works. We approached this study by developing an artificial neural network that predicts the neural activity produced when an animal looks at images. If we can build a virtual avatar of the visual system, we can perform essentially unlimited experiments on it. Then we can go back and test in real brains with a method we named inception loops, said first author Dr. Edgar Y. Walker, former graduate student in the Tolias lab and now a postdoctoral scientist at University of Tbingen and Baylor.
To make the avatar learn how neurons respond, the researchers first recorded a large amount of brain activity using a mesoscope, a recently developed large scale functional imaging microscope. First, the researchers showed mice about 5,000 natural images and recorded the neural activity from thousands of neurons as they were seeing the images. Then, they used these images and the corresponding recordings of brain activity to train a deep artificial neural network to mimic how real neurons responded to visual stimuli.
To test whether the network had indeed learned to predict neural responses to visual images like a living mouse brain would do, we showed the network images it had not seen during learning and saw that it predicted the biological neuronal responses with high accuracy, said co-first author Dr. Fabian Sinz, adjunct assistant professor of neuroscience at Baylor and group leader at the University of Tbingen.
Experimenting with these networks revealed some aspects of vision we didnt expect, said Tolias, founder and director of the Center for Neuroscience and Artificial Intelligence at Baylor.
For instance, we found that the optimal stimulus for some neurons in the early stages of processing in the neocortex were checkerboards, or sharp corners as opposed to simple edges which is what we would have expected according to the current dogma in the field.
We think that this framework of fitting highly accurate artificial neural networks, performing computational experiments on them, and verifying the resulting predictions in physiological experiments can be used to investigate how neurons represent information throughout the brain. This will eventually give us a better idea of how the complex neurophysiological processes in the brain allow us to see, Sinz said.
Find all the details of this study in the journal Nature Neuroscience.
Other contributors to this work include Erick Cobos, Taliah Muhammad, Emmanouil Froudarakis, Paul G. Fahey, Alexander S. Ecker, Jacob Reimer and Xaq Pitkow.
Follow this link to find the complete list of author affiliations and financial support for this project.
By Ana Mara Rodrguez, Ph.D.
The rest is here:
Virtual avatar reveals what the brain likes to see - Baylor College of Medicine News
- Elusive Cures: Why Neuroscience Hasnt Solved Brain Disordersand How We Can Change That, an excerpt - The Transmitter - June 10th, 2025 [June 10th, 2025]
- Nanowire Retinal Implant Restores Vision and Sees Infrared - Neuroscience News - June 10th, 2025 [June 10th, 2025]
- KLOTHO NEUROSCIENCE, INC. ANNOUNCES AN APPROACH TO INCREASE LONGEVITY AND HEALTHY LIFE SPAN - REPLACE A SILENCED GENE CALLED ALPHA-KLOTHO... - June 10th, 2025 [June 10th, 2025]
- Obeying Orders Lowers Moral Responsibility Perception in the Brain - Neuroscience News - June 10th, 2025 [June 10th, 2025]
- Family Time and Parental Bonding Linked to Better Sleep in Preteens - Neuroscience News - June 10th, 2025 [June 10th, 2025]
- Study Links Gut Bacteria to MS Risk and Reveals Key Triggers - Neuroscience News - June 10th, 2025 [June 10th, 2025]
- Alto Neuroscience Announces Acquisition of Novel Dopamine Agonist Combination Product Candidate, Adding Late-Stage Readout in Treatment Resistant... - June 10th, 2025 [June 10th, 2025]
- Sleep-Wake Perception Intact in Many With Insomnia - Neuroscience News - June 10th, 2025 [June 10th, 2025]
- Cannabis Use Among U.S. Seniors Has Surged 46% in Just Two Years - Neuroscience News - June 10th, 2025 [June 10th, 2025]
- Anoki Integrates With Magnite While Seedtag Adds Neuroscience To Find Emotional Connections - TVREV - June 10th, 2025 [June 10th, 2025]
- Neuroscience: Knowing People's Names Makes You Empathize With Them Better. (By the Way, My Name Is Bill) - Inc.com - June 1st, 2025 [June 1st, 2025]
- Kindness Sparks Cooperation by Boosting Social Connectedness - Neuroscience News - June 1st, 2025 [June 1st, 2025]
- Neuroscience and Genetics of ADHD and Neurodevelopment - Neuroscience News - June 1st, 2025 [June 1st, 2025]
- The Neuroscience of Cancer - Harvard Medicine Magazine - June 1st, 2025 [June 1st, 2025]
- Singing to Infants Boosts Mood and Bonding - Neuroscience News - June 1st, 2025 [June 1st, 2025]
- Neuroscience: Go Swimming and Your Brain Will Thank You - Inc.com - June 1st, 2025 [June 1st, 2025]
- Blood Fat Links Found Between Heart Risk and Alzheimers - Neuroscience News - June 1st, 2025 [June 1st, 2025]
- Tiny Brain Cell Cluster Found to Drive Obesity and Overeating - Neuroscience News - June 1st, 2025 [June 1st, 2025]
- New Neuroscience Shows Why Its So Important to Read Aloud to Your Kids - Inc.com - June 1st, 2025 [June 1st, 2025]
- Cats Can Recognize Their Owners by Smell Alone - Neuroscience News - June 1st, 2025 [June 1st, 2025]
- St. Lukes Center for Neuroscience Helps Those with Same Illness as Billy Joel - TAPinto - June 1st, 2025 [June 1st, 2025]
- These triplets who graduated from Georgia Tech with neuroscience degrees head to medical school - 11Alive.com - June 1st, 2025 [June 1st, 2025]
- Gabe Newell co-founded a neuroscience company in 2019 and its first brain chip is expected to ship later this year - PC Gamer - June 1st, 2025 [June 1st, 2025]
- Next-Gen Painkiller Blocks Pain Without the High - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Inflammation Triggers Repetitive Behaviors in ASD and OCD - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Astrocytes Take Center Stage in Brain Function and Behavior - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Setting the SCENE for Neuroscience Breakthroughs - Mellon College of Science - Carnegie Mellon University - May 21st, 2025 [May 21st, 2025]
- Long COVID Brain Fog Linked to Inflammation and Stress Markers - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Warren Buffett Says Youre Too Focused on the Negative. Heres the Neuroscience Showing Hes Right - Inc.com - May 21st, 2025 [May 21st, 2025]
- Reading Fiction Boosts Empathy and Fights Loneliness - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Astrocytes, Not Neurons, Drive Brains Attention and Alertness - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Mapping Young Minds: The Neuroscience Behind Babilou Family Singapore's Revolutionary Education Model - PR Newswire - May 21st, 2025 [May 21st, 2025]
- Loneliness Linked to 24% Higher Risk of Hearing Loss - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Eureka Moments Double Memory by Rewiring the Brain - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- Scientists use brain activity to predict StarCraft II skill in fascinating new neuroscience research - psypost.org - May 21st, 2025 [May 21st, 2025]
- Stress of Long Work Hours May Physically Alter the Brain - Neuroscience News - May 21st, 2025 [May 21st, 2025]
- The Neuroscience of Dopamine: How to Triumph Over Constant Wanting - Next Big Idea Club - May 12th, 2025 [May 12th, 2025]
- Verbal Abuse in Childhood Rewires the Developing Brain - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Heavy Social Media Use Linked to Believing and Spreading Fake News - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Brain Cells That Predict What Comes Next, Even When Its New - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- The Temperature | Better happiness through neuroscience - The Colorado Sun - May 12th, 2025 [May 12th, 2025]
- Genes Strongly Influence When Babies Take Their First Steps - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Using Music to Detect Concussion in Kids - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Boosting Klotho Protein Slows Aging and Enhances Health - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Eye Movements Set the Speed Limit for What You Can See - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Seeing Is Believing: How We Judge AI as Creative or Not - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Exercise Boosts Stem Cell Therapy for Parkinsons - Neuroscience News - May 12th, 2025 [May 12th, 2025]
- Aspen Neuroscience Announces 6-Month ASPIRO Phase 1/2a Clinical Trial Results of Personalized Cell Therapy for Parkinson's Disease - BioSpace - May 12th, 2025 [May 12th, 2025]
- Sheffield Lab: Understanding the neuroscience of memories - University of Chicago News - April 27th, 2025 [April 27th, 2025]
- Prenatal Stress Leaves Lasting Molecular Imprints on Babies - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- Dean Buonomano explores the concept of time in neuroscience and physics - The Transmitter - April 27th, 2025 [April 27th, 2025]
- Psychedelics May Reset Brain-Immune Link Driving Fear and Anxiety - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- Infant Social Skills Thrive Despite Hardship - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- From Cologne to Country Roads: One scientist's interdisciplinary journey to build bridges (and robotic insects) between neuroscience and engineering -... - April 27th, 2025 [April 27th, 2025]
- Eyes Reveal Intentions Faster Than We Think - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- Immune Resilience Identified as Key to Healthy Aging and Longevity - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- Energy Starvation Triggers Dangerous Glutamate Surges in the Brain - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- WVU Rockefeller Neuroscience Institute first in U.S. to successfully test innovative brain-computer interface technology to decode speech and language... - April 27th, 2025 [April 27th, 2025]
- Microglia Reprogrammed to Deliver Precision Alzheimers Therapies - Neuroscience News - April 27th, 2025 [April 27th, 2025]
- Neuroscience Says Music Is an Emotion Regulation Machine. Heres What to Play for Happiness, Productivity, or Deep Thinking - Inc.com - April 19th, 2025 [April 19th, 2025]
- Early Maternal Affection Shapes Key Personality Traits for Life - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- Elons new neuroscience major highlighted by Greensboro News & Record - Elon University - April 19th, 2025 [April 19th, 2025]
- Brain Blast event at St. Lawrence University teaches local students neuroscience - North Country Now - April 19th, 2025 [April 19th, 2025]
- AI Reveals What Keeps People Committed to Exercise - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- The "Holy Grail" of Neuroscience? Researchers Create Stunningly Accurate Digital Twin of the Brain - The Debrief - April 19th, 2025 [April 19th, 2025]
- Annenberg School Vice Dean Emily Falk publishes book on the neuroscience of decision-making - The Daily Pennsylvanian - April 19th, 2025 [April 19th, 2025]
- Music-Induced Chills Trigger Natural Opioids in the Brain - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- What We Value: The Neuroscience of Choice and Change - think.kera.org - April 19th, 2025 [April 19th, 2025]
- Kile takes top neuroscience post at Sutter Health as system pushes to align care, expand trials - The Business Journals - April 19th, 2025 [April 19th, 2025]
- A Grain of Brain, 523 Million Synapses, and the Most Complicated Neuroscience Experiment Ever Attempted - SciTechDaily - April 19th, 2025 [April 19th, 2025]
- Mild Brain Stimulation Alters Decision-Making Speed and Flexibility - Neuroscience News - April 19th, 2025 [April 19th, 2025]
- Cannabis studies were informing fundamental neuroscience in the 1970s - Nature - April 10th, 2025 [April 10th, 2025]
- To make a meaningful contribution to neuroscience, fMRI must break out of its silo - The Transmitter - April 10th, 2025 [April 10th, 2025]
- Steve Jobss Unexpected Secret to Being More Creative (Backed by Neuroscience) - Inc.com - April 10th, 2025 [April 10th, 2025]
- Challenging Decades of Neuroscience: Brain Cells Are More Plastic Than Previously Thought - SciTechDaily - April 10th, 2025 [April 10th, 2025]
- Q&A: Lundbecks head of R&D on letting biology speak in neuroscience - Endpoints News - April 10th, 2025 [April 10th, 2025]
- Why it's hard to study the neuroscience of psychedelics : Short Wave - NPR - April 10th, 2025 [April 10th, 2025]
- Fear Sync: How Males and Females Respond to Stress Together - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- Chemotherapy Disrupts Brain Connectivity - Neuroscience News - April 10th, 2025 [April 10th, 2025]
- Newly awarded NIH grants for neuroscience lag 77 percent behind previous nine-year average - The Transmitter - April 10th, 2025 [April 10th, 2025]