Researchers harness virtual reality, motion capture to study neurological disorders
Neuroscientists at the University of Rochester Medical Center, URMC have a powerful new state-of-the-art tool to study diseases like Autism, Alzheimer’s, and traumatic brain injury.
The Mobile Brain/Body Imaging system, or MoBI, combines virtual reality, brain monitoring, and Hollywood-inspired motion capture technology, enabling researchers to study the movement difficulties that often accompany neurological disorders and why our brains sometimes struggle while multitasking.
| UR Medicine. Youtube Sep 5, 2018 |
Mark Michaud, University of Rochester Medical Center, URMC September 05, 2018
“Many studies of brain activity occur in controlled environments where study subjects are sitting in a sound proof room staring at a computer screen,” said John Foxe PhD, director of the URMC Del Monte Institute for Neuroscience. “The MoBI system allows us to get people walking, using their senses, and solving the types of tasks you face every day, all the while measuring brain activity and tracking how the processes associated with cognition and movement interact.”
The MoBI platform – which is located in the Del Monte Institute’s Cognitive Neurophysiology Lab – brings together several high tech systems. Using the same technology that is employed by movie studios to produce CGI special effects, study participants wear a black body suite that is fitted with reflective markers. Participants are then asked to walk on a treadmill or manipulate objects at a table in a room fitted out with 16 high speed cameras that record the position of the markers with millimeter precision. This data is mapped to a computer generated 3D model that tracks movement.
While they are walking, a virtual environment – a cityscape, for example – is projected on the screen in front of them which they must navigate. They can also be asked to perform task and make decisions in response to what is being projected on the screen. While this occurring, the brains of study participants are monitored via a high-density electroencephalogram (EEG) that detects electrical activity using small metal electrodes attached to the scalp.
The motion tracking and EEG data are synchronized, allowing researchers to track which areas of the brain are being activated when walking or performing task and study how the brain responds while moving, performing tasks, or doing both at the same time.
This information could provide new insight into developmental diseases like Autism, which is often characterized with difficulty in processing sensory information from multiple sources. Individuals with Autism also often have an abnormal gait. People with Alzheimer’s, dementia, and sports concussions also experience movement difficulties.
“There is competition between the processes that allow you to walk well and the processes that allow you to think well,” said Ed Freedman PhD, an associate professor in the Del Monte Institute and principal investigator in the Cognitive Neurophysiology Lab. “We don’t fall when we are sitting at a desk performing a task, we fall when we are walking down the street, avoiding traffic and other people, checking our phone, and thinking about what we are going to cook for dinner. We can use the MoBI to reveal underlying problems in the allocation of cognitive resources in individuals with neurological disorders because we are essentially stressing the system by asking them to perform task while on the treadmill.”
The researchers are currently using MoBI to establish a set of data with healthy individuals. This baseline of brain activity can then be compared to people with neurological disorders to identify new “signatures” of disease and brain processes that can be employed during clinical trials.
“When you get good measurements of how the brain works and contrast that activity with people who are depressed or suffer from Autism or dementia, you can develop biomarkers – or neuro-markers – of disease,” said Foxe. “Using these neuro-markers we can then test whether a given intervention or therapeutic is actually working.”
Source University of Rochester Medical Center, URMC
via Medical Xpress
| References |
MoBI-Box: A next generation Mobile Brain-Body Imaging Platform, Ying Choon Wu, Jeffery Wang, Andrew Tran, Alex Schperberg, John Caldwell, Tzyy-Pmg Jung, Po-Chih Kuo. 2016 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support (CogSIMA) San Diego CA, USA 21-25 March 2016. DOI: 10.1109/COGSIMA.2016.7497793
A mobile brain-body imaging dataset recorded during treadmill walking with a brain-computer interface, Trieu Phat Luu, Sho Nakagome, Yongtian He & Jose L. Contreras-Vidal. Scientific Data volume 5, Article number: 180074 (2018) http://dx.doi.org/10.1038/sdata.2018.74
Mobile Brain/Body Imaging (MoBI) of Physical Interaction with Dynamically Moving Objects, Evelyn Jungnickel and Klaus Gramann. Front Hum Neurosci. 2016; 10: 306. Published online 2016 Jun 27.DOI: 10.3389/fnhum.2016.00306
Also see
Neuroscientist harnesses the power of virtual reality to unlock the mysteries of memory UCLA Health
