XekRung Technical Report
summary
The gist
XekRung is a frontier large language model for cybersecurity designed to provide comprehensive security capabilities by developing diverse data synthesis pipelines and a complete training pipeline…
In short
XekRung is a frontier LLM specifically built for cybersecurity using a full training pipeline (CPT to RL). It achieves state-of-the-art results on security benchmarks by using specialized data synthesis and multi-task reinforcement learning. This means the model gains deep domain expertise in security while keeping strong general knowledge, allowing it to perform complex tasks like vulnerability analysis and attack simulation.
Key concepts
- Full Training Pipeline (CPT→SFT→RL)
- This is a complete, three-stage training process: Continued Pre-Training (CPT) builds foundational knowledge on cybersecurity concepts; Supervised Fine-Tuning (SFT) teaches the model specific security tasks; and Reinforcement Learning (RL) refines behavior through trial and error. This ensures the model learns both general language skills and deep, specialized security expertise.
- Group Relative Policy Optimization (GRPO)
- GRPO is a specific type of multi-task reinforcement learning used during the training phase. It allows the model to optimize its performance across many different security tasks simultaneously by comparing its actions against a group of related policies. This helps the model learn robust strategies for various security scenarios efficiently.
- Agentic RL and ActionRL
- These concepts enable the model to act like an autonomous agent in complex workflows. Agentic RL optimizes end-to-end operational tasks, while ActionRL specifically focuses supervision on critical decision points, known as the 'Branch Divergence Point,' ensuring the model makes precise, effective moves during security analysis.
Terminology used across episodes
This episode discusses
- XekRung Technical Report · Paper Radio
- Qwen Technical Report
- Does your data spark joy? Performance gains from domain upsampling at the end of training
- Gradient Similarity Surgery in Multi-Task Deep Learning
- AlpaGasus: Training A Better Alpaca with Fewer Data
- Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge
- Training Verifiers to Solve Math Word Problems
- Spatially Resolved Observations of Betelgeuse at 7mm and 1.3cm Just Prior to the Great Dimming
- DeepSeek-V3 Technical Report
- DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- CLewR: Curriculum Learning with Restarts for Machine Translation Preference Learning
- Flow-Induced Vibration of Flexible Hydrofoil Within Cavitating Turbulent Flow
- The Llama 3 Herd of Models · Paper Radio
- A C++20 Interface for MPI 4.0
- OpenAI o1 System Card
- EntropyLong: Effective Long-Context Training via Predictive Uncertainty
- Llama-3.1-FoundationAI-SecurityLLM-Base-8B Technical Report
- Estimating rank-one matrices with mismatched prior and noise: universality and large deviations
- How to Correctly do Semantic Backpropagation on Language-based Agentic Systems
- MSSR: Memory-Aware Adaptive Replay for Continual LLM Fine-Tuning
- Qwen3 Technical Report
The paper
XekRung Technical Report · Read on arXiv
Alibaba Security AGI Lab
We present XekRung, a frontier large language model for cybersecurity, designed to provide comprehensive security capabilities. To achieve this, we develop diverse data synthesis pipelines tailored to the cybersecurity domain, enabling the scalable construction of high-quality training data and providing a strong foundation for cybersecurity knowledge and understanding. Building on this foundation, we establish a complete training pipeline spanning continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL) to further extend the model's capabilities. We further introduce a multi-dimensional evaluation system to guide the iterative improvement of both domain-specific and general-purpose abilities. Extensive experiments demonstrate that XekRung achieves state-of-the-art performance on cybersecurity-specific benchmarks among models of the same scale, while maintaining strong performance on general benchmarks.
Transcript
Introduction to the show: ident: Security Radio. Generated commentary on the latest security and cryptography papers.
Nadia: We're looking at the paper: "XekRung Technical Report".
Elias: Here's the gist of the paper. XekRung is a frontier large language model for cybersecurity designed to provide comprehensive security capabilities by developing diverse data synthesis pipelines and a complete training pipeline spanning continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL) <ref:2605.00072#pg2>.
Nadia: Model Performance and Benchmarking XekRung achieves state-of-the-art performance on cybersecurity benchmarks among models of the same scale, while maintaining strong performance on general benchmarks <ref:2605.00072#pg2>.
Elias: The overall average score for XekRung-8B across 15 cybersecurity benchmarks is 81.04% <ref:2605.00072#pg2>.
Nadia: This represents a +9.03 percentage point improvement over its base model Qwen3-8B (72.01%) and surpasses all same-scale baselines by a substantial margin <ref:2605.00072#pg2>.
Title and authors: Nadia: Let's talk about the title and who wrote this, the XekRung Technical Report. It sets up what we are looking at—a large language model built for cybersecurity that aims to give it comprehensive security capabilities.
Elias: The authors are Jiutian Zeng, Junjie Li, Chengwei Dai, Jie Liang, Zhaoyu Hu, Yiliang Zhang, Ziang Weng, and Longtao Huang as core contributors. They seem to have a strong mix of expertise here.
Priya: I noticed the team includes people focused on different parts of the problem—from measurement research to exploitation and defense. That suggests they're trying to cover the whole cycle.
Nadia: Right, because what they're doing is tackling something inherently cross-domain and cross-layer, which means you need mastery over software engineering, operating systems, network protocols, and cryptographic primitives all at once.
Elias: The paper also points out that the search space in cybersecurity is vast because adversarial behaviors can show up across an enormous landscape of possible configurations and execution paths that just makes exhaustive enumeration infeasible.
Priya: That sounds like a huge hurdle for any system trying to learn this, so I'm curious if their data strategies really help navigate that complexity.
The paper's summary: Nadia: Now let's look at what the report actually summarizes about XekRung. Basically, they show that XekRung achieves state-of-the-art performance on cybersecurity benchmarks compared to other models of the same scale, while still keeping strong performance on general tasks.
Elias: The key number here is that the average score across fifteen cybersecurity benchmarks for XekRung-8B is eighty-one point zero four percent, which they say is a nine point zero three percentage point improvement over its base model, Qwen3-8B, which scored seventy-two point zero one percent.
Priya: eighty-one point zero four percent on those specific security metrics sounds pretty solid for a specialized model, but I need to know what that means in terms of real utility versus just high scores on a test set.
Nadia: It means it outperforms all the same-scale baselines by a substantial margin, and critically, XekRung-8B still holds seventy-two point five four percent overall on general purpose benchmarks, which is close to the base Qwen3-8B's seventy-three point thirty one percent.
Elias: That comparison shows that they managed to get deep domain expertise without completely losing general competence, which is a tough balance to strike in these specialized training efforts.
The paper's improvements: Nadia: The report highlights the specific ways they improved the model's capabilities. They built a system spanning continued pre-training, supervised fine-tuning, and reinforcement learning to extend the model’s abilities across tasks.
Elias: They introduce a multi-dimensional evaluation system that guides iterative improvement for both domain-specific and general purpose abilities throughout the whole training process.
Priya: I'm interested in how they structured that RL part because traditional RL often targets isolated subtasks, but this one seems to aim for something more unified.
Nadia: They move away from targeting just isolated subtasks by introducing a framework that unifies reinforcement learning with verifiable rewards, which we call Verifiable Rewards or RLVR for those specific tasks.
Elias: Plus, they use Agentic RL for end-to-end workflow optimization and they integrate reasoning reinforcement learning with preference alignment within a shared optimization loop.
Priya: That sounds like it’s trying to optimize the entire chain of security analysis, not just one step in it. How does that translate to actual capability?
Conclusion: Nadia: To wrap things up on this XekRung Technical Report, the main implication is that a well-trained 8B model can match or even exceed models with several times more parameters when it comes to domain-specific security tasks.
Elias: That highlights how effective domain compression can be, showing that deep expertise in a smaller model can outperform much larger models on specialized problems.
Priya: I just want to stress that the authors mention they are planning to further expand the model’s agentic capabilities and look into self-evolution for cybersecurity applications next.
Nadia: Right, so while this report shows strong performance, the team is focused on making it more capable of actually *doing* things autonomously in a security context.
Elias: They also plan to pursue broader cybersecurity research and applications based on this work, continuing the development of AI for Security.
More episodes
- 2608.27496-ROPE: Routed Origin Policy Enforcement against Indirect Prompt Injection
- Daily Summary for 2026-11-19
- 2607.07085-Is Randomness Necessary for Adaptive Data Analysis?
- The day in conversation for 2026-11-19
- Daily Summary for 2026-11-19
- 2609.10601-Threshold Choice, Not Sample Size, Bounds Trustless Verification of Nondeterministic Compound AI Workflows
- 2610.38786-Adversarial Process Disturbances at a Deployable Alarm Budget: Detector Evaluation on a Simulator and a Real Plant
- 2511.08660-Binary and Multiclass Cyberattack Classification on GeNIS Dataset
- 2604.27302-Static Attribution of Android Residential Proxy Malware Using Graph Kernels
- Daily Summary for 2026-11-18