Jerry Tang
@jerryptang
phd student @HuthLab interested in language and brain-computer interfaces
How does the human brain represent semantic information from different languages? Our new preprint suggests that bilingual language comprehension relies on shared semantic representations that are systematically modulated by each language! 1/n
Bilingual language processing relies on shared semantic representations that are modulated by each language biorxiv.org/cgi/content/sh… #bioRxiv
Do brain representations of language depend on whether the inputs are pixels or sounds? Our @CommsBio paper studies this question from the perspective of language timescales. We find that representations are highly similar between modalities! rdcu.be/dACh5 1/8
I’ll be presenting this work at the #NeurIPS2023 5pm poster session on Wednesday — come by to chat about the relationship between language and vision in the brain!
Multimodal transformers make it possible to transfer fMRI encoding models between language and vision! (though mostly from L->V and not V->L 🤔) New paper from @jerryptang @_du_meng @vvobot @vasudev_lal arxiv.org/abs/2305.12248
This paper and dataset is now officially published in Scientific Data!! And not only that but we have nearly doubled the amount of data and stimulus available since the preprint version. Link to paper here: nature.com/articles/s4159… 1/n
New Dataset Alert! I'm very happy to official announce a naturalistic language fMRI dataset now available! This dataset includes 8 participants listening to 5 hours each of the moth radio hour. biorxiv.org/content/10.110…
Our new study is out today in Nature! We demonstrate a brain-computer interface that turns speech-related neural activity into text, enabling a person with paralysis to communicate at 62 words per minute - 3.4 times faster than prior work. 1/3 nature.com/articles/s4158…
Our paper on a high-performance neuroprosthesis for speech decoding and avatar control is out in Nature! Thankful to work with such a great interdisciplinary team on this. nature.com/articles/s4158…
🌟NEW PREPRINT🌟 🤖-based🧠models are all the rage! But, - How do we interpret 🧠if 🤖are SO un-interpretable? - How do we _test_ if🤖are good models of 🧠? (No, your prediction score is NOT the answer) Our new paper (co-lead @vvobot) shows you how! tinyurl.com/vojain2023 1/9