TL;DR
Current fMRI decoders struggle with a trade-off between efficiency and geometric accuracy. The NeurIPS framework introduces a Selective ROI Spherical Tokenizer and a Structure-Guided Mixture of Experts to leverage anatomical features for improved brain decoding.
✦ Why It Matters
Engineers can leverage NeurIPS for faster and more accurate brain decoding in fMRI applications.
Key Takeaways
Full Summary
fMRI (functional Magnetic Resonance Imaging) decoders often face a challenge where efficient models do not accurately represent brain surface geometry. NeurIPS is a novel framework that addresses this issue by transforming anatomical variation from a hindrance into a valuable predictive signal.
It combines two key innovations: a Selective ROI Spherical Tokenizer (SRST) for effective geometric encoding and a Structure-Guided Mixture of Experts (SG-MoE) that models individual anatomical features. Testing on the Natural Scenes Dataset, NeurIPS set a new benchmark for surface decoders, achieving performance comparable to strong one-dimensional baselines.
Remarkably, it converges in just 10 epochs compared to the typical 600, allowing for rapid adaptation to new subjects with only 20% of the data. Causal analysis indicates that these improvements stem from the model's use of cortical features rather than memorizing subject IDs.
By utilizing anatomical priors, NeurIPS offers a scalable and robust approach to brain decoding.
Related