Liquid AI LFM2.5-VL-3B Hits 228 Tokens/Sec on Apple M5 Max
Liquid AI has released LFM2.5-VL-3B, an open-weight vision-language model pairing a 2.6B text backbone with a SigLIP2 encoder for high-speed edge inference.
Liquid AI released LFM2.5-VL-3B today, an open-weight 3.1-billion-parameter vision-language model optimized for high-speed edge deployment. The release pairs the company’s recent LFM2.5-2.6B language backbone with a SigLIP2 400M NaFlex vision encoder, replacing the previous LFM2-VL-3B iteration. The system is designed as a “non-reasoning” model that skips chain-of-thought processing to return direct answers with minimal latency.
Architecture and Inference Speed
The model was pre-trained on approximately 34 trillion tokens, utilizing four times more vision data than its predecessor. Liquid AI expanded the tokenizer vocabulary to 128,000 tokens to improve support for non-Latin scripts. The resulting weights fit under a 3.3 GB memory footprint, leaving ample headroom on standard consumer hardware when you configure local AI inference pipelines.
Raw speed is the primary optimization target. On an Apple M5 Max, LFM2.5-VL-3B achieves 228 tokens per second. Running on an AMD Ryzen AI Max+ 395 yields 116 tokens per second. The system supports a 32K token context window, allowing for sustained document analysis or multi-image processing in local memory.
Benchmark Capabilities
The addition of scaled synthetic grounding data drove significant accuracy improvements across spatial and interface tasks. The model achieved an 80.7 average on ScreenSpot-v2, surpassing Qwen 3.5 4B at 78.5 and Gemma-4-E4B at 51.2. RefCOCO grounding precision rose 30 points to 87.9.
LFM2.5-VL-3B also introduces function calling to Liquid AI’s vision line. The model scored 59.5 on ToolSandbox, up from 26.4 in previous builds, alongside a 32.5 on BFCL v4. Multi-image reasoning tasks saw similar gains, moving from 50.2 to 61.5 on BLINK and from 34.9 to 58.3 on MUIRBench.
Ecosystem Support
The open weights are available on Hugging Face in native, GGUF, MLX, and ONNX formats. This breadth of format support means developers can run the model directly via llama.cpp, mlx-vlm, and Ollama for edge workloads, or route to vLLM and SGLang for server environments. Fine-tuning is supported through LoRA using the TRL and Unsloth frameworks.
The hardware efficiency aligns with recent industry shifts toward running LLMs locally for privacy-constrained enterprise environments. Liquid AI recently partnered with MacPaw to integrate these models for macOS users, while parallel integrations target robotics and automotive use cases via Mercedes-Benz.
If you build vision-dependent edge applications, the combination of robust MLX and GGUF support with a sub-4 GB memory footprint makes LFM2.5-VL-3B a practical replacement for larger cloud-dependent vision models.
Get Insanely Good at AI
The book for developers who want to understand how AI actually works. LLMs, prompt engineering, RAG, AI agents, and production systems.
Keep Reading
How to Cut CPU Costs with Cloudflare Workers Cache
You will learn how to configure Cloudflare Workers Cache to serve responses directly from entrypoints, handle invalidations, and partition cache keys.
Frozen MTP Drafters Yield 3x Gemini Nano Speedup on Pixel 10
Google has introduced frozen Multi-Token Prediction for Gemini Nano, utilizing lightweight drafter models to triple on-device inference speeds.
Multilingual PP-OCRv6 Beats GPT-5.5 on Industrial Text
PaddlePaddle's PP-OCRv6 system delivers 50-language text recognition in a 34.5M parameter footprint that outperforms massive vision models.
MacPaw Merges Liquid AI Models With Local macOS Memory Stack
MacPaw has partnered with Liquid AI to build a unified on-device inference and memory stack for macOS applications distributed through the Setapp marketplace.
FP8 Cache Quantization Doubles Kimi K2.6 Context on Cloudflare
Cloudflare implemented FP8 KV cache quantization and weight compression to scale Kimi and GLM frontier models on its Workers AI platform.