aiXcoder Open-Sources 4B Context Compression Model, Claims 78% Lower Inference Cost vs DeepSeek-V4-Pro
aiXcoder has open-sourced aiXcompact-4B, a context compression model for coding agents, with vendor self-tests showing significant reductions in token overhead and GPU inference costs for long-running tasks.
On November 11, 2026, aiXcoder, an AI programming startup incubated from Peking University's Institute of Software Engineering, officially open-sourced aiXcompact-4B, a dedicated context compression model. With only 4 billion parameters, the model is designed for long-horizon complex development tasks involving coding agents and supports private deployment on a single A100-40GB GPU.
As AI coding tools like Claude Code and Codex handle increasingly complex tasks, agents must continuously read code, call tools, and run tests, causing token consumption to surge. Research based on the OpenHands framework found that a complete agentic coding task consumes an average of 4.17 million tokens, 3,500 times more than single-turn code reasoning. aiXcompact-4B aims to alleviate this cost pressure by structurally processing the agent's historical trajectory: it retains key original information, condenses tool return results such as file reads and test runs, removes redundant or obsolete intermediate records, and generates structured task summaries.
According to self-reported data from aiXcoder, when integrated into OpenCode for context compression during Terminal-Bench evaluations, aiXcompact-4B achieved overall task completion accuracy comparable to DeepSeek-V4-Pro. In private deployment scenarios, the single-task GPU inference cost was reported to be 78% lower than DeepSeek-V4-Pro. For API calls, the estimated token cost per request is approximately 0.019 RMB, representing reductions of 97.30%, 97.08%, and 97.98% compared to reference costs for DeepSeek-V4-Pro, GLM-5.3, and Qwen3.8-Max, respectively. Additionally, the model compresses historical context to an average of 25.89% of its original length, freeing up more context space for subsequent agent calls.
Technically, aiXcompact-4B combines teacher large model distillation, LoRA fine-tuning of a 4B student model, and structured compression decisions. Training data is derived entirely from real-world agent execution trajectories in development scenarios. While the vendor claims performance metrics close to or partially exceeding the larger DeepSeek-V4-Pro in rule-based scores and retention rates, these results are based on internal evaluation sets and specific configurations (such as ngram k=32) and have not been independently verified by third parties. For enterprises seeking to reduce high-frequency context compression costs, this offers a lightweight and economical potential choice, though actual benefits depend on specific workloads.