Google Maps Fruit Fly Brain, Engineers Teach It to Play Games

In a remarkable advancement for neuroscience, Google has unveiled a comprehensive 3D map of an adult male fruit fly's central nervous system. This achievement, celebrated by scientists, has sparked the interest of software engineers who have taken the dataset a step further by teaching the fly to play popular video games such as Doom and Super Mario 64.

The mapping project, a collaboration between Google Research and the Howard Hughes Medical Institute's Janelia Research Campus, represents a decade-long effort to create the largest and most detailed brain map of a fruit fly. Known as MaleCNS v1.0 connectome, this digital representation includes over 166,000 neurons and approximately 125 million synaptic connections, surpassing previous mapping efforts significantly. Researchers meticulously sliced the fly's nervous system into millions of thin sections, using high-powered electron microscopes and AI algorithms to trace every neural pathway in three dimensions, aiming to provide insights into sensory processing and neural function.

Shortly after the release of the open-source dataset, developers began to recognize the potential of the mapped neural network as a sophisticated computational engine. Alex Wormuth, a software engineer, gained attention for transforming the fly's connectome into an active neural simulator capable of playing the 1993 version of Doom. By linking the game's frames to the fly's virtual sensory neurons, Wormuth created a system where the fly's neural activity dictated its movements, using dopamine-releasing cells to reinforce successful actions and discourage mistakes.

Following Wormuth's success, other developers joined in, with Jessica Paquette creating a framework that allowed the fly to navigate Super Mario 64. Footage of the simulated fly attempting to maneuver through the game showcased the challenges of 3D platforming from the perspective of a fruit fly's brain. Additionally, other programmers adapted the connectome for rhythm games like Beat Saber and even Minecraft, further exploring the capabilities of this biological mapping.

While these gaming demonstrations may seem lighthearted, they underscore the practical applications of a mapped biological brain. By illustrating how a biological brain can interpret sensory data and make decisions, these initiatives validate the utility of the fruit fly brain map. Looking ahead, Google is setting its sights on mapping the brains of larger animals, including fish and mice, to expand the understanding of neural processing across species.