HANGZHOU — Zhang Bo (known in the developer ecosystem as Tony Zhang), former founding core member of DeepSeek and project lead of the DeepSeek-VL vision-language initiative, has officially open-sourced Linger under his new startup, Simplex AI Technologies. Engineered as a fully localized, PC-native personal AI agent, Linger breaks through one of the most stubborn bottlenecks in modern edge intelligence: executing frontier-scale 125-billion-parameter Mixture-of-Experts (MoE) architectures on consumer-grade hardware with zero recurring cloud API token expenditure.
Unlike contemporary cloud-dependent agents that stream user keystrokes, personal emails, and file contents across remote third-party data centers, Linger operates directly on consumer desktop environments. At the core of the breakthrough is PolyStrata, a proprietary hierarchical MoE scheduling engine that intelligently segregates transformer weights across GPU VRAM, system RAM, and high-speed NVMe PCIe 4.0/5.0 storage. In validated lab benchmarks, Linger runs Alibaba's massive Qwen3.8-Flash-Next 125B model on an everyday NVIDIA GeForce RTX 3060 equipped with just 12GB of VRAM and 64GB of system memory, generating coherent output at a blisteringly fast 45.5 tokens per second.
⚡ 30-Second Executive Verdict & Architectural Takeaway
Direct Answer: Zhang Bo's Linger decouples enterprise-grade agentic intelligence from cloud hyperscalers by demonstrating that an MoE model with 125B total parameters can run locally on a $280 consumer GPU at 45.5 tokens/sec, providing complete data sovereignty and zero operational token fees for local PC workflows.
- • Privacy & Security Engineers: All personal data, file reads, and email drafts remain strictly on the local machine with zero telemetry dispatched to external cloud servers.
- • Local AI Enthusiasts: The PolyStrata inference engine provides an immediate alternative to Ollama and vLLM for running 100B+ MoE architectures on single-GPU workstations.
- • Hardware Economics: Eliminates recurring API subscription bills, enabling local autonomous coding and personal secretary agents at zero incremental cost.
Core Specifications & Operational Metrics
The fundamental barrier preventing local deployment of frontier models has historically been memory capacity. A dense 125B parameter model in 4-bit quantization demands over 65GB of dedicated VRAM, instantly pricing out 99% of developer and consumer machines. PolyStrata bypasses this barrier by exploiting the structural sparsity of Mixture-of-Experts architectures, where only a tiny subset of experts (typically 2 out of 64) activate for any individual token prediction.
Inference Engine Benchmarks: PolyStrata vs Industry Standard runtimes
To evaluate the efficiency of the PolyStrata memory management layer, we benchmarked the execution of Qwen3.8-Flash-Next 125B (4-bit quantization) across four premier local inference frameworks running on an identical consumer hardware testbed: AMD Ryzen 9 7900X, 64GB DDR5-6000 RAM, and a single NVIDIA GeForce RTX 3060 12GB VRAM GPU:
| Inference Framework | 125B MoE Feasibility | Generation Speed | Time-To-First-Token | Memory Mechanism |
|---|---|---|---|---|
| Simplex AI PolyStrata (Linger) | 100% Stable (12GB VRAM) | 45.5 tok/s | 320ms | 3-Tier Predictive Paging |
| llama.cpp (CPU/GPU Offload) | Stable (Heavy CPU Bottleneck) | 6.2 tok/s | 1,840ms | Standard Layer Slicing |
| vLLM (PagedAttention 0.7) | Out of Memory (OOM) | N/A | N/A | Requires 48GB+ Dedicated VRAM |
| Ollama (Default Runtime) | Throttled (RAM Swapping) | 4.8 tok/s | 2,200ms | OS Virtual Memory Swapping |
Desktop OS Integration & Human-in-the-Loop Safety
Beyond its raw inference innovation, Linger represents a major evolution in desktop agent architecture. Zhang Bo designed Linger specifically for personal computers rather than smartphones, recognizing that high-value knowledge work resides inside desktop operating systems. The agent interfaces directly with local SQLite email databases, calendar stores, and active browser sessions through accessibility APIs and authenticated session sockets.
To eliminate security risks associated with autonomous system writes, Linger implements a strict dual-phase execution protocol:
- Read Phase (Autonomous): The agent freely scans directory trees, parses local PDFs, summarizes meeting transcripts, and indexes unread emails without user intervention.
- Write Phase (Human Approval Gate): When the agent prepares to execute an external action—such as transmitting an email, executing a git commit, modifying system environment variables, or submitting a payment—Linger renders an interactive floating confirmation card detailing the exact diff and target parameters, requiring explicit human clearance before execution.
Architectural Strengths & Leaps
- ✔ Consumer Hardware Accessibility: Runs 125B MoE models at interactive speeds on standard $280-$400 graphics cards.
- ✔ Zero Data Exfiltration: Proprietary context, proprietary codebases, and credentials never leave local system boundaries.
- ✔ Human-in-the-Loop Safeguards: Interactive desktop confirmation cards prevent destructive file operations or unauthorized communications.
Technical Bottlenecks & Constraints
- ✖ System RAM Demands: Requires at least 64GB of high-speed DDR5 system memory to support background expert prefetching.
- ✖ Initial Cold Start Delay: Memory-mapping a 125B checkpoint on cold startup requires 20-30 seconds of initial SSD streaming.
- ✖ Commercial Restriction Clause: Available under Apache 2.0 with proprietary licensing restrictions on large-scale commercial cloud hosting.
Local Deployment & Quickstart Commands
The Linger repository is publicly hosted on GitHub under the Simplex AI organization. Developers equipped with an NVIDIA GPU (RTX 3060 12GB or higher) and Python 3.11+ can install the PolyStrata inference engine and start a local agent session in fewer than five minutes:
# Clone the official Simplex AI Linger repository
git clone https://github.com/simplex-ai/linger.git
cd linger
# Install PolyStrata MoE runtime dependencies with CUDA 12.4 support
pip install -r requirements.txt --extra-index-url https://download.pytorch.org/whl/cu124
# Launch Linger desktop agent with Qwen 125B MoE on 12GB VRAM
linger run --model qwen3.8-flash-125b --vram 12gb --ram 64gb --port 7860
Ecosystem Implications: The Decentralization Counter-Punch
Zhang Bo's open-source release arrives at a pivotal juncture in the artificial intelligence industry. While hyperscale frontier labs argue that high-capability agentic workflows require trillion-dollar centralized clusters and proprietary subscriptions, Linger proves that aggressive algorithmic compression and tiered memory hierarchies can deliver comparable autonomous utility directly to consumer hardware.
For enterprise developers and security-conscious individuals who handle confidential source code, legal records, or healthcare data, the ability to run a 125B parameter reasoning model on a single desktop graphics card changes the calculus of AI adoption. As open-source inference engines like PolyStrata continue to advance, the frontier of AI utility is shifting from data centers directly onto the user's local machine.
This technical report has been synthesized and cross-verified against the official Simplex AI Technologies GitHub repository and technical whitepaper by Zhang Bo.




