OraCore · Topic ·research
Why multimodal MoE models get distracted
A study of multimodal MoE models finds visual inputs can derail routing to reasoning experts, and a routing-guided fix improves results.
1 articles in this thread ·Last updated 19h ago·First seen Jul 5, 2026
Timeline
A study of multimodal MoE models finds visual inputs can derail routing to reasoning experts, and a routing-guided fix improves results.