Browsing by Subject "Neural speech decoding"
Now showing 1 - 2 of 2
- Results Per Page
- Sort Options
Item Neural speech decoding from segregated brain regions' neuromagnetic signature(2022-05-10) Tsang, Brian Yinbok; Wang, Jun, Ph. D.Locked-in syndrome (LIS) is a condition in which patients are in full-body paralysis but retain cognitive function. Improving the ability of these patients to communicate with others may significantly increase their quality of life. Since motor control is almost completely gone for LIS patients, a brain-computer interface (BCI) using neural speech decoding may be the only method to restore communication ability. As a non-invasive neuroimaging modality, magnetoencephalography (MEG) offers several strong attributes for potential speech-BCI usage. Its high spatial and temporal resolutions make it suitable for potential real-time speech decoding, and its non-invasive quality is crucial for accessibility. Neural speech decoding using MEG is a relatively new field, and there is little research on how different regions of the brain contribute to speech decoding. Additionally, the contributions of different brainwaves from individual brain regions towards MEG speech decoding hasn’t been studied. Such information may be helpful for future MEG speech-BCI studies regarding feature selection and sensor placement. This dissertation investigates the degree in which MEG signals from the eight individual brain regions corresponding to the lobes of the brain (left- and right- frontal, parietal, temporal, and occipital lobes) contribute towards neural speech decoding, as well as how individual brainwaves from these areas influence decoding performance. Both imagined and overt speech phrases were decoded using MEG signals collected from seven healthy participants. Results indicated that almost all regions provided neuromagnetic signals helpful for speech decoding. Additionally, both temporal regions offered relatively high individual decoding performances, and when combined, speech decoding performance was almost on-par with whole-brain performance. Lastly, frequency-specific analysis showed signs that helpful MEG signals for speech decoding may be encoded similarly across brain regions, with the delta band (0.3-4Hz) consistently providing the best information for speech decoding. Possessing flexibility in sensor count and placements, optically pumped magnetometer (OPM) MEG systems may find the results of this dissertation useful in determining sensor placements and reducing overall sensor count, which would lower the cost of the system.Item Neural speech decoding with magnetoencephalography(2021-11-16) Dash, Debadatta; Wang, Junmin, 1974-; Tewfik, Ahmed; Ferrari, Paul; Millan, Jose del R.; Hamilton, Liberty; Tamir, Jon ISevere brain damage or amyotrophic lateral sclerosis (ALS) may lead the patients to a locked-in state where the patients are motorically paralyzed otherwise being cognitively normal. The brain might be the only source of communication for these patients. Current commercially available brain-computer interface (BCI) spellers can help these patients communicate to a level but at a very slow communication rate (less than 10 words/min). Neural speech decoding paradigm attempts to decode speech information directly from the brain providing promise towards a faster communication assistance, thereby, improving the quality of life for these patients. Magnetoencephalography (MEG) is a non-invasive neuroimaging modality that has an excellent spatio-temporal resolution, suitable to study neural mechanism of speech. This dissertation, for the first time, investigates the possibility of neural speech decoding using MEG in the following aspects: imagined and overt speech decoding for healthy and ALS individuals, subject generalization in decoding, articulation and acoustic synthesis, and MEG sensor selection for optimal decoding. The possibility of decoding speech from MEG was evident from the findings showcased in this dissertation providing a solid foundation towards future wearable MEG based speech-BCI applications.