
doi: 10.5281/zenodo.20406928 , 10.5281/zenodo.20406927 , 10.5281/zenodo.20417321 , 10.5281/zenodo.20417713 , 10.5281/zenodo.20418022 , 10.5281/zenodo.20411377 , 10.5281/zenodo.20411378 , 10.5281/zenodo.20406733 , 10.5281/zenodo.20418023 , 10.5281/zenodo.20417712 , 10.5281/zenodo.20406732 , 10.5281/zenodo.20417320
doi: 10.5281/zenodo.20406928 , 10.5281/zenodo.20406927 , 10.5281/zenodo.20417321 , 10.5281/zenodo.20417713 , 10.5281/zenodo.20418022 , 10.5281/zenodo.20411377 , 10.5281/zenodo.20411378 , 10.5281/zenodo.20406733 , 10.5281/zenodo.20418023 , 10.5281/zenodo.20417712 , 10.5281/zenodo.20406732 , 10.5281/zenodo.20417320
Mixture-of-Experts (MoE) has become a prevalent backbone for large vision-language models (VLMs), yet how modality-specific signals should guide expert routing remains under-explored. Existing routing strategies are either hand-crafted or modality-agnostic, relying on idealized priors that ignore the layer-dependent modality fusion patterns in MoE-VLMs and provide little guidance for expert specialization. We propose Soft Modality-guided Expert Specialization (SMoES), which consists of dynamic soft modality scores that capture layer-dependent fusion patterns, an expert binning mechanism aligne Research goal: Does soft modality-guided routing in MoE-VLMs improve robustness to distribution shift on the VQA v2.0 and A-OKVQA datasets compared to dense models of similar parameter count? Autonomous synthesis report generated by SOVEREIGN Research Kernel. Tribunal consensus score: 7.8/10.
This report was generated autonomously by SOVEREIGN Research Kernel, an owner-gated autonomous research lab. The content synthesizes findings from peer-reviewed papers. Tribunal score: 7.8/10.
hard-routed, baselines, modality-guided, robustness, sec, models, SMoES-based, distribution, score, modality-agnostic, law, terms, throughput, inference, scaling, MMMU, dense, standard, shift, MoE-VLMs, improve, varying, expert, count, tokens, soft, routing, impact, MoE, SMoES, VLMs
hard-routed, baselines, modality-guided, robustness, sec, models, SMoES-based, distribution, score, modality-agnostic, law, terms, throughput, inference, scaling, MMMU, dense, standard, shift, MoE-VLMs, improve, varying, expert, count, tokens, soft, routing, impact, MoE, SMoES, VLMs
| selected citations These citations are derived from selected sources. This is an alternative to the "Influence" indicator, which also reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | 0 | |
| popularity This indicator reflects the "current" impact/attention (the "hype") of an article in the research community at large, based on the underlying citation network. | Average | |
| influence This indicator reflects the overall/total impact of an article in the research community at large, based on the underlying citation network (diachronically). | Average | |
| impulse This indicator reflects the initial momentum of an article directly after its publication, based on the underlying citation network. | Average |
