CAMEL-CLIP: Channel-aware Multimodal Electroencephalography-text Alignment for Generalizable Brain Foundation Models
AI 摘要
arXiv:2603.13272v2 Announce Type: replace Abstract: Electroencephalography (EEG) foundation models have shown promise for learning generalizable representations, yet they remain sensitive to channel heterogeneity, such as changes in channel composition or ordering. We propose channel-aware multimodal EEG-text alignment contrastive language image pretraining (CAMEL-CLIP), a contrastive EEG-text multimodal foundation model designed to be robust to heterogeneous channel configurations and widely applicable to diverse downstream tasks. CAMEL-CLIP combines three components: (1) channel attribute-based positional encoding, which identifies channels using their anatomical attributes and reference type; (2) dynamic channel projection, which preserves channel-specific information across varying numbers of EEG channels and combines textual reports with channel information to support channel-wise EEG-text matching; and (3) dual-level contrastive learning, which aligns EEG signals with text at both the individual-channel and whole-sample levels. Experimental results show that CAMEL-CLIP achieves the highest mean balanced accuracy among the evaluated baselines across multiple datasets under linear probing. CAMEL-CLIP also shows high classification performance when transferred between different channel configurations without classifier retraining.