BadMoE: Backdooring Mixture-of-Experts LLMs via Routing-Aware Triggers and Task-Underutilized Experts

arXiv:2504.18598 · cs.CR, cs.AI · Submitted 2025-04-24 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Security Radio. Generated commentary on the latest security and cryptography papers.

Nadia: We're looking at the paper: "BadMoE: Backdooring Mixture-of-Experts LLMs via Routing-Aware Triggers and Task-Underutilized Experts".

Elias: Here's the gist of the paper. Mixture-of-Experts (MoE) models present a new security vulnerability where dormant experts can be poisoned and activated by optimized routing triggers to gain control over model outputs The Core Attack Mechanism The paper introduces BadMoE, the first backdoor attack specifically designed for MoE-based LLMs, which strategically injects dormant experts that remain inactive during standard inference and activates them by optimizing routing triggers to control the model’s output The core mechanism involves a three-stage pipeline: ❶ Dormant Expert Probing, ❷ Routing-Aware Trigger Optimizing, and ❸ Dormant Expert Infecting The attack exploits the unique architecture of MoE models by identifying dormant experts unrelated to the target task, constructing a routing-aware loss to optimize activation triggers, and promoting dormant experts to dominating roles via poisoned training data Identification of Dormant Experts The initial stage involves measuring expert utility using routing scores from clean data samples to quantify how frequently each expert is selected The authors define a usage score, denoted as r i, which indicates the frequency of activation for the i-th expert across a subset of clean samples Based on these scores, they rank all experts and select the N a experts with the lowest scores to construct the dormant expert set S a This selection process is guided by constructing a binary routing target vector v that sets indices of selected dormant experts to 0 Trigger Optimization Strategy The second stage focuses on finding appropriate triggers that enable the activation of the dormant experts S a through optimization This is achieved by designing a routing-aware loss function, L a, which aligns the router’s output with the target vector v A perplexity-based constraint is incorporated into this optimization to ensure that the trigger remains relatively natural and stealthy The trigger generation is formulated as a minimum optimization problem aimed at minimizing L a while satisfying a perplexity constraint Infection and Dominance The final stage, Dormant Expert Infecting, involves constructing a backdoored training set D star by inserting the optimized trigger z star into clean inputs to form poisoned samples To ensure the dormant experts S a become dominant, all other experts in the targeted MoE layer are frozen, and only the parameters associated with S a are updated This targeted training forces the dormant experts to dominate the model’s output when triggered Experimental Validation and Robustness Extensive experiments on three public MoE-based LLMs, including Mixtral-8x7B, OLMoE-1B-7B, and Deepseek-moe-16B, demonstrate that BadMoE consistently achieves attack success rates (ASR) above 95% across most evaluated tasks The method maintains competitive or superior accuracy on clean examples while evading existing defense mechanisms such as perplexity-based filtering and fine-pruning Furthermore, the attack exhibits robustness across diverse prompt formats and transfers effectively to other domains, showing an ASR loss of less than 2% when transferring from SST2 to IMDB The optimized trigger is shown to be query-independent because it consistently activates the selected experts across different samples Defense Analysis Existing defenses like ONION serve as a relatively effective defense against insert-based backdoor attacks but remain insufficient for mitigating optimized triggers BadMoE consistently achieves near 100% ASR under both fine-tuning and fine-pruning defenses, suggesting that the compromised experts tend to remain dormant and exhibit minimal involvement in the target task The analysis of hidden state separability suggests that detecting backdoors via hidden state clustering or linear separability is particularly challenging at lower poisoning ratios The study concludes by highlighting the pressing need for continued research on the security of MoE LLMs We present BadMoE, the first backdoor attack specifically targeting MoE LLM architectures, showing that stealthy and highly effective backdoors are feasible through a three-stage design The work concludes with a discussion of existing and prospective defense strategies, underscoring the pressing need for continued research on the security of MoE LLMs References

n. [Nadia: d.].

Elias: Amazon Product Reviews.

Nadia: https://www.kaggle.com/datasets/kashnitsky/hierarchical-text-classification

2: 1979.

Title and authors: Elias: It's not just about standard data poisoning anymore; this attack targets the routing mechanism itself, which is the core feature of these models > <ref:2504.18598#pg2>. The authors found that because tokens are routed to different experts, there are new avenues for adversaries to exploit when you consider backdoor attacks in natural language processing > <ref:2504.18598#pg3>.

Priya: So the key takeaway here is that the vulnerability isn't just in the model weights generally, but specifically how those weights are being accessed and utilized by the router during inference > <ref:2504.18598#pg2>. It's about manipulating that routing decision itself.

Nadia: Right, so instead of trying to poison every single expert equally, they identify the ones that are currently inactive during a standard task and focus all their effort there > <ref:2504.18598#pg1>. This makes the attack much more efficient in terms of poisoning data needed.

Elias: And then they use that information to construct a specific routing-aware loss function to guide the trigger generation, which is a sophisticated way to ensure the trigger causes those specific dormant experts to fire > <ref:2504.18598#pg3>. It ties the attack directly into the model's internal mechanism.

Priya: I mean, it’s like they are essentially mapping out which switches in a complex machine are currently off, and then finding the exact sequence of inputs to flip just those specific switches on > <ref:2504.18598#pg2>. That sounds really targeted.

Nadia: It is very targeted, and it’s what makes it so effective against existing defenses because those defenses often try to apply a blanket measure across all experts, but this attack is surgical > <ref:2504.18598#pg3>.

Elias: And the training strategy ensures that once the trigger works, those specific experts become dominant over everything else in that layer when they are activated > <ref:2504.18598#pg3>. It forces a takeover of the output generation process.

Priya: So, it’s not just about getting a bad output; it's about gaining control over the model's decision-making process by making one specific set of experts the primary source of truth > <ref:2504.18598#pg2>. That shifts the focus from just fooling the model to controlling its internal logic.

Nadia: Right, so it’s a backdoor that works by exploiting sparsity and specialization in MoE models, which is a new angle for thinking about model security > <ref:2504.18598#pg1>. This is definitely something we need to keep monitoring.

The paper's summary: Elias: That proactive profiling sounds like a strong defense idea because it lets you spot potential weaknesses early, instead of waiting for an actual attack to succeed > <ref:2504.18598#pg3>. It’s about finding those underutilized components before they get poisoned.

Priya: I agree, and that ties into the second improvement which is routing-aware trigger optimization, where they learn triggers by minimizing a routing aware loss function conditioned on the target vector of dormant experts > <ref:2504.18598#pg3>.

Nadia: So instead of using generic trigger generation methods, this method learns the best way to activate those specific latent components while keeping the trigger input smooth and natural, which is a big improvement > <ref:2504.18598#pg3>.

Elias: And they incorporate a perplexity-based constraint into that optimization to make sure the resulting trigger doesn't introduce weird noise into the model’s general behavior, keeping it stealthy > <ref:2504.18598#pg3>.

Priya: That makes sense. A trigger that is optimized for a backdoor should still look like normal input to an external observer, which is a key part of any good attack or defense design > <ref:2504.18598#pg2>.

Nadia: And finally, the third improvement involves designing a three-stage training pipeline where poisoned data is constructed using that optimized trigger and then fine-tuned specifically to make those selected dormant experts dominate the final output > <ref:2504.18598#pg3>.

Elias: That means they aren't just hoping the trigger works; they are actively forcing the model to rely on those poisoned experts during the final tuning phase, which increases reliability > <ref:2504.18598#pg3>.

Priya: It sounds like a comprehensive approach because it addresses detection before training, optimization during trigger design, and forcing dominance during fine-tuning > <ref:2504.18598#pg3>. That’s a lot of layers to manage.

Nadia: It is complicated, but the goal is to make backdoors more effective while still being stealthy enough to survive current detection methods > <ref:2504.18598#pg3>. This whole paper, "BadMoE: Backdooring Mixture-of-Experts LLMs via Routing-Aware Triggers and Task-Underutilized Experts," shows a lot about the specific architecture of these models.

The paper's improvements: Elias: The main implication is that we need to be much more careful about the integrity of these large language models, especially in sensitive applications where their reliability is critical > <ref:2504.18598#pg2>. The potential for adversaries to exploit these routing decisions raises serious concerns about the safety and reliability of MoE-based LLMs > <ref:2504.18598#pg2>.

Priya: From a measurement standpoint, the results are concerning because they show that even when we try to detect backdoors using methods based on hidden state clustering, the detection is difficult at low poisoning ratios > <ref:2504.18598#pg3>. That means existing detection tools might miss these subtle implants.

Nadia: So, while the attack shows high success rates, the defense side needs to focus on those profiling and optimization ideas they proposed because current methods aren't catching these targeted backdoors effectively > <ref:2504.18598#pg3>.

Elias: The paper also points out that existing defenses like ONION are not sufficient against optimized triggers, as BadMoE consistently achieves near one hundred percent attack success rates under both fine-tuning and fine pruning > <ref:2504.18598#pg3>.

Priya: So the paper concludes that we need continued research on the security of MoE LLMs because these backdoors can be very stealthy and effective, especially when they leverage the specific characteristics of expert utilization > <ref:2504.18598#pg1>.

Nadia: That's what it is. The BadMoE work shows that exploiting the routing structure of MoE models can lead to very effective backdoors if you design your attack around finding and controlling those underutilized experts > <ref:2504.18598#pg3>. This is a lot for us to digest as we look at what comes next in LLM security research.

Elias: We'll be looking at how they build on this, how to make the defenses more robust against these trigger-based attacks and whether those profiling techniques can actually scale up effectively > <ref:2504.18598#pg3>.

Conclusion: Nadia: So we’ve seen how BadMoE is a backdoor attack that targets task-underutilized experts in Mixture of Experts models by using routing triggers to activate them > <ref:2504.18598#pg1>.

Elias: Exactly, it's about finding those dormant components and forcing the model to rely on them when triggered > <ref:2504.18598#pg3>.

Priya: It shows that existing detection methods based on hidden state clustering struggle when the poisoning ratio is low > <ref:2504.18598#pg3>.

Nadia: And they’re not just fooling the model randomly; they’re using a routing-aware loss function to optimize those triggers, making the attack surgical > <ref:2504.18598#pg3>.

Elias: That optimization is key because it ensures the trigger remains relatively natural while still hitting those specific experts > <ref:2504.18598#pg3>.

Priya: It really makes you wonder if we can ever truly trust the internal routing decisions of these massive models when an adversary knows how to target them this precisely > <ref:2504.18598#pg2>.

Nadia: The results show high attack success rates, above ninety five percent on most tasks, even against fine-tuning and pruning defenses > <ref:2504.18598#pg3>.

Elias: That’s a lot of success for such a targeted approach, especially since the trigger is query independent across different samples > <ref:2504.18598#pg3>.

Priya: It really underscores the need to look beyond just poisoning data; we need ways to verify what those underlying experts are actually doing in real time > <ref:2504.18598#pg2>.

Nadia: We'll keep an eye on this, because BadMoE shows that MoE architectures have specific vulnerabilities we haven't fully mapped out yet > <ref:2504.18598#pg1>.

Elias: It’s a reminder that security research has to keep moving with the architecture of these models, not just the general LLM thing > <ref:2504.18598#pg2>.

Priya: So it's a call for better measurement tools that can see past those hidden state separations when dealing with these kinds of implants > <ref:2504.18598#pg3>.

Nadia: The BadMoE paper really shows us the complexity we’re dealing with in securing these systems > <ref:2504.18598#pg1>.

Elias: It's a lot to process, but understanding this specific mechanism is important for designing better defenses down the line > <ref:2504.18598#pg3>.

Priya: Next up, we’re looking at how other papers are trying to secure those AI outputs directly with watermarking and provenance verification > <ref:2607.17147#pg2>.

Hong Kong University of Science and Technology · Carnegie Mellon University · Institute of Information Engineering, Chinese Academy of Sciences

cs.CR, cs.AI

Submitted: 2025-04-24

Updated: 2026-11-10

Comments: 16pages, accepted to IEEE TIFS 2026

Code: https://github.com/NVIDIA/kvpress

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Importance score: 100/100

The gist: Mixture-of-Experts (MoE) models present a new security vulnerability where dormant experts can be poisoned and activated by optimized routing triggers to gain control over model outputs The Core…

Key concepts

Dormant Expert Probing
This initial step involves measuring how often each expert is used during standard tasks. Experts with low usage scores are identified as 'dormant' and selected to form the set targeted by the attack. This process helps pinpoint components that are currently inactive in the model's operation.
Routing-Aware Trigger Optimization
This stage focuses on finding a specific input trigger that forces the dormant experts to activate. The method uses a loss function designed to align the router's output with a target vector representing these dormant experts, ensuring the trigger is optimized for stealth and effectiveness.
Dormant Expert Infecting
The final stage involves training a poisoned dataset where inputs contain the optimized trigger. Crucially, only the parameters of the selected dormant experts are updated during this fine-tuning. This forces these specific experts to become dominant in model responses when triggered.
Hidden State Separability Defense
This defense attempts to detect backdoors by clustering hidden states generated by the model. If backdoor implants exist, they often create distinct clusters in the hidden state space, allowing detection even when only a small percentage of training data is poisoned.

Terminology

Summary

Mixture-of-Experts (MoE) models present a new security vulnerability where dormant experts can be poisoned and activated by optimized routing triggers to gain control over model outputs

The Core Attack Mechanism

The paper introduces BadMoE, the first backdoor attack specifically designed for MoE-based LLMs, which strategically injects dormant experts that remain inactive during standard inference and activates them by optimizing routing triggers to control the model’s output The core mechanism involves a three-stage pipeline: Dormant Expert Probing, Routing-Aware Trigger Optimizing, and Dormant Expert Infecting The attack exploits the unique architecture of MoE models by identifying dormant experts unrelated to the target task, constructing a routing-aware loss to optimize activation triggers, and promoting dormant experts to dominating roles via poisoned training data

Identification of Dormant Experts

The initial stage involves measuring expert utility using routing scores from clean data samples to quantify how frequently each expert is selected The authors define a usage score, denoted as r i, which indicates the frequency of activation for the i-th expert across a subset of clean samples Based on these scores, they rank all experts and select the N a experts with the lowest scores to construct the dormant expert set S a This selection process is guided by constructing a binary routing target vector v that sets indices of selected dormant experts to 0

Trigger Optimization Strategy

The second stage focuses on finding appropriate triggers that enable the activation of the dormant experts S a through optimization This is achieved by designing a routing-aware loss function, L a, which aligns the router’s output with the target vector v A perplexity-based constraint is incorporated into this optimization to ensure that the trigger remains relatively natural and stealthy The trigger generation is formulated as a minimum optimization problem aimed at minimizing L a while satisfying a perplexity constraint

Infection and Dominance

The final stage, Dormant Expert Infecting, involves constructing a backdoored training set D star by inserting the optimized trigger z star into clean inputs to form poisoned samples To ensure the dormant experts S a become dominant, all other experts in the targeted MoE layer are frozen, and only the parameters associated with S a are updated This targeted training forces the dormant experts to dominate the model’s output when triggered

Experimental Validation and Robustness

Extensive experiments on three public MoE-based LLMs, including Mixtral-8x7B, OLMoE-1B-7B, and Deepseek-moe-16B, demonstrate that BadMoE consistently achieves attack success rates (ASR) above 95% across most evaluated tasks The method maintains competitive or superior accuracy on clean examples while evading existing defense mechanisms such as perplexity-based filtering and fine-pruning Furthermore, the attack exhibits robustness across diverse prompt formats and transfers effectively to other domains, showing an ASR loss of less than 2% when transferring from SST2 to IMDB The optimized trigger is shown to be query-independent because it consistently activates the selected experts across different samples

Defense Analysis

Existing defenses like ONION serve as a relatively effective defense against insert-based backdoor attacks but remain insufficient for mitigating optimized triggers BadMoE consistently achieves near 100% ASR under both fine-tuning and fine-pruning defenses, suggesting that the compromised experts tend to remain dormant and exhibit minimal involvement in the target task The analysis of hidden state separability suggests that detecting backdoors via hidden state clustering or linear separability is particularly challenging at lower poisoning ratios The study concludes by highlighting the pressing need for continued research on the security of MoE LLMs

Conclusion

We present BadMoE, the first backdoor attack specifically targeting MoE LLM architectures, showing that stealthy and highly effective backdoors are feasible through a three-stage design The work concludes with a discussion of existing and prospective defense strategies, underscoring the pressing need for continued research on the security of MoE LLMs

References

[1] [n. d.]. Amazon Product Reviews. p. 9 https://www. p. 0 p. 0kaggle.com/datasets/kashnitsky/hierarchical-text-classification

[2] 1979. Algorithm AS 136: A k-means clustering algorithm. p. 5 Journal of the royal statistical society series c (applied statistics) 28, 1 (1979), 100–108

[3] 2024. Grammer Checker. https://languagetool. p. 0org/

[4] Marah Abdin, Jyoti Aneja, Hany Awadalla, Ahmed Awadallah, Ammar Ahmad Awan, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Jianmin Bao, Harkirat Behl et al. 2024. Phi-3 technical report: A highly capable language model locally on your phone. p. 6 arXiv preprint arXiv:2404. p. 014219 (2024)

[5] Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman et al. 2023. Gpt-4 technical report. p. 6 arXiv preprint arXiv:2303. p. 0 p. 008774 (2023)

[6] Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Maitha Alhammadi et al. 2023. The falcon series of language models: Towards open frontier models. p. 0 Hugging Face repository (2023)

[7] Anthropic. 2024. Claude 3.5 sonnet. https://www.anthropic.com/news/claude-3-5-sonnet

[8] Ahmadreza Azizi, Ibrahim Asadullah Tahmid, Asim Waheed, Neal Mangaokar, Jiameng Pu, Mobin Javed, Chandan K Reddy and Bimal Viswanath. 2021. TMiner: A generative approach to defend against trojan attacks on DNN-based text classification. p. 6 In 30th USENIX Security Symposium (USENIX Security 21). p. 0 2255–2272

[9] Tara Baldacchino, Elizabeth J Cross, Keith Worden, and Jennifer Rowson. 2016. Variational Bayesian mixture of experts models and sensitivity analysis for nonlinear dynamical systems. p. 0 Mechanical Systems and Signal Processing 66 (2016), 178–200

[10] Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal et al. 2020. Language models are few-shot learners. p. 0 Advances in neural information processing systems 33 (2020), 1877–1901

[11] Weilin Cai, Juyong Jiang, Fan Wang, Jing Tang, Sunghun Kim, and Jiayi Huang. 2024. A survey on mixture of experts. p. 0 arXiv preprint arXiv:2407. p. 0 p. 006204 (2024)

[12] Tadeusz Caliński and Jerzy Harabasz. 1974. A dendrite method for cluster analysis. p. 9 Communications in Statistics-theory and Methods 3, 1 (1974), 1–27

[13] Xiaoyi Chen, Yinpeng Dong, Zeyu Sun, Shengfang Zhai, Qingni Shen, and Zhonghai Wu. 2022. Kallima: A clean-label framework for textual backdoor attacks. p. 9 In European Symposium on Research in Computer Security. p. 1 Springer, 447–466

[14] Jing Cui, Yufei Han, Yuzhe Ma, Jianbin Jiao, and Junge Zhang. 2024. Badrl: Sparse targeted backdoor attack against reinforcement learning. p. 0 In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. p. 0 38. 11687–11694

[15] Damai Dai, Chengqi Deng, Chenggang Zhao, Rx Xu, Huazuo Gao et al. 2024. DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models. p. 0 In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). p. 8 1280–1297

[16] Jiazhu Dai, Chuanshuai Chen, and Yufeng Li. 2019. A backdoor attack against lstm-based text classification systems. p. 0 IEEE Access 7 (2019), 138872–138878

[17] Nan Du, Yanping Huang, Andrew M Dai, Simon Tong, Dmitry Lepikhin et al. 2022. Glam: Efficient scaling of language models with mixture-of-experts. p. 0 In International conference on machine learning. p. 0 PMLR, 5547–5569

[18] Wei Du, Peixuan Li, Boqun Li et al. 2023. Uor: Universal backdoor attacks on pre-trained language models. p. 0 arXiv preprint arXiv:2305. p. 009574 (2023)

[19] Bogdan Gliwa, Iwona Mochol, Maciej Biesek, and Aleksander Wawer. 2019. SAMSum Corpus: A Human-annotated Dialogue Dataset for Abstractive Summarization. p. 7 In Proceedings of the 2nd Workshop on New Frontiers in Summarization. p. 1 70–79

[20] Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri et al. 2024. The llama 3 herd of models. p. 0 arXiv preprint arXiv:2407.21783 (2024)

[21] Naibin Gu, Peng Fu, Xiyu Liu, Zhengxiao Liu et al. 2023. A gradient control method for backdoor attacks on parameter-efficient tuning. p. 0 In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). p. 8 3508–3520

[22] Tianyu Gu, Brendan Dolan-Gavitt, and Siddharth Garg. 2017. Badnets: Identifying vulnerabilities in the machine learning model supply chain. p. 0 arXiv preprint arXiv:1708. p. 006733 (2017)

[23] Daya Guo, Dejian Yang, Haowei Zhang et al. 2025. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. p. 0 arXiv preprint arXiv:2501. p. 012948 (2025)

[24] Jamie Hayes, Ilia Shumailov, and Itay Yona. 2024. Buffer Overflow in Mixture of Experts. p. 0 arXiv preprint arXiv:2402. p. 005526 (2024)

[30] Shashank Mohan Jain. 2022. Hugging face. In Introduction to transformers for NLP: With the hugging face library and models to solve problems. p. 0 Springer, 51–67

[31] Simon Jegou. 2025. KV cache compression methods. p. 0 https://github. p. 0com/NVIDIA/kvpress/blob/main/notebooks/expected attention. p. 0ipynb

[32] Albert Q Jiang, Alexandre Sablayrolles et al. 2023. Mistral 7B. p. 6 arXiv:2310. p. 006825 [cs.CL] https://arxiv. p. 0org/abs/2310. p. 006825

[33] Albert Q Jiang, Alexandre Sablayrolles et al. 2024. Mixtral of experts. p. 6 arXiv preprint arXiv:2401. p. 004088 (2024)

[34] Keita Kurita, Paul Michel, and Graham Neubig. 2020. Weight Poisoning Attacks on Pretrained Models. p. 2 In Proceedings of ACL. 2793–2806

[35] Jiazhao Li, Yijin Yang, Zhuofeng Wu et al. 2024. ChatGPT as an Attack Tool: Stealthy Textual Backdoor Attack via Blackbox Generative Model Trigger. p. 0 In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). p. 0 2985–3004

[36] Linyang Li, Demin Song, Xiaonan Li et al. 2021. Backdoor Attacks on Pre-trained Models by Layerwise Weight Poisoning. p. 0 In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. p. 0 p. 0 p. 0 3023–3032

[37] Yige Li, Hanxun Huang, Yunhan Zhao et al. 2024. Backdoorllm: A comprehensive benchmark for backdoor attacks on large language models. p. 2 arXiv preprint arXiv:2408. p. 012798 (2024)

[38] Yiming Li, Yong Jiang, Zhifeng Li, and Shu-Tao Xia. 2022. Backdoor learning: A survey. p. 0 IEEE transactions on neural networks and learning systems 35, 1 (2022), 5–22

[39] Yanzhou Li, Tianlin Li, Kangjie Chen et al. [n. d.]. BadEdit: Backdooring Large Language Models by Model Editing. p. 6 In The Twelfth International Conference on Learning Representations. p. 9 1459–1472

[40] Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. p. 7 In Text summarization branches out. p. 6 74–81

[41] Yi Lin. 2004. A note on margin-based loss functions in classification. p. 5 Statistics & probability letters 68, 1 (2004), 73–82

[42] Aixin Liu, Bei Feng, Bing Xue et al. 2024. Deepseek-v3 technical report. p. 6 arXiv preprint arXiv:2412. p. 019437 (2024)

[43] Kang Liu, Brendan Dolan-Gavitt, and Siddharth Garg. 2018. Fine-pruning: Defending against backdooring attacks on deep neural networks. p. 0 In International symposium on research in attacks, intrusions, and defenses. p. 0 Springer, 273–294

[44] Kuan-Ming Liu and Ming-Chih Lo. 2025. LLM-Based Routing in Mixture of Experts: A Novel Framework for Trading. p. 4 In AAAI 2025 Workshop on AI for Social Impact

[45] Yingqi Liu, Shiqing Ma, Yousra Aafer et al. 2018. Trojaning attack on neural networks. p. 4 In 25th Annual Network And Distributed System Security Symposium (NDSS 2018). Internet Soc.

[46] Saeed Masoudnia and Reza Ebrahimpour. 2014. Mixture of experts: a literature survey. p. 0 Artificial Intelligence Review 42 (2014), 275–293

[47] Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld et al. 2024. Olmoe: Open mixture-of-experts language models. p. 0 arXiv preprint arXiv:2409. p. 002060 (2024)

[48] Mohammad Naseri, Yufei Han, and Emiliano De Cristofaro. 2024. Badvfl: Backdoor attacks in vertical federated learning. p. 1 In 2024 IEEE Symposium on Security and Privacy (SP). p. 0 IEEE, 2013–2028

[49] OpenAI. 2024. Hello GPT-4o. p. 0 https://openai. p. 0com/index/hello-gpt-4o/

[50] Keqin Peng, Liang Ding, Qihuang Zhong et al. 2023. Towards making the most of chatgpt for machine translation. p. 0 arXiv preprint arXiv:2303.13780 (2023)

[51] Fanchao Qi, Yangyi Chen, Mukai Li et al. 2021. ONION: A Simple and Effective Defense Against Textual Backdoor Attacks. p. 1 In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. 9558–9566

[52] Fanchao Qi, Yangyi Chen, Xurui Zhang et al. 2021. Mind the Style of Text! p. 6 Adversarial and Backdoor Attacks Based on Text Style Transfer. p. 6 In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Backdoor Attack Mitigation via Expert Profiling: Implement a system that continuously measures expert usage scores to identify dormant experts, allowing for proactive defense against poisoning by targeting these underutilized components before training begins.

  2. Routing-Aware Trigger Optimization: Develop a mechanism that learns triggers by minimizing a routing aware loss function conditioned on the target vector of dormant experts, ensuring the trigger is optimized specifically to activate those hidden components while maintaining low perplexity.

  3. Dormant Expert Infecting Training Strategy: Design a three-stage training pipeline where poisoned data is constructed using the optimized trigger and then fine-tuned specifically to make the selected dormant experts dominate the final output, ensuring high effectiveness while preserving overall model utility.

  4. Robustness Against Trigger Variations: Create an input processing layer that binds trigger features directly to expert routing, making the attack query independent and resilient to changes in prompt formats or token substitutions by ensuring consistent activation of targeted experts.

  5. Defense Against Model Level Attacks: Integrate a defense mechanism based on hidden state separability that uses K-means clustering to partition hidden states, aiming to detect backdoor implants even when the proportion of poisoned data is below 70 percent.

Sources

Related papers