Liquid AI Releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: Bidirectional Encoders That Stay Fast at 8K Context on CPU

8k contextbidirectional encoderscpu inferenceefficient aiencoder modelslfm2.5-encoder-230mlfm2.5-encoder-350mliquid ai

Liquid AI Releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: Bidirectional Encoders Optimized for 8K Context on CPU


July 29, 2026 — By Asif Razzaq


In a notable advancement for efficient natural language processing, Liquid AI has unveiled two new bidirectional encoder models: the LFM2.5-Encoder-230M and the LFM2.5-Encoder-350M. Designed to maintain high performance even under extended context windows, these encoders deliver fast inference on CPU hardware while handling sequences up to 8,000 tokens.


The new models build on Liquid AI’s commitment to making advanced AI more accessible by reducing reliance on specialized accelerators. As of 2026, the industry trend toward edge computing and cost-efficient deployment has accelerated, making CPU-friendly architectures increasingly valuable for production systems.


Key Features


  • Bidirectional attention for richer contextual understanding.
  • 8K context support without significant speed degradation on CPU.
  • Two sizes: 230 million parameters (lightweight) and 350 million parameters (balanced performance).
  • Optimized for tasks requiring deep semantic encoding, such as retrieval-augmented generation, document classification, and embedding generation.

Performance and Use Cases


Liquid AI positions these encoders as ideal for applications where latency and hardware cost are critical. By maintaining inference speed at 8K context length on standard CPUs, the models enable real-time or near-real-time processing in serverless, mobile, or edge environments.


Potential use cases include:

  • Enterprise search and document understanding.
  • Real-time sentiment analysis and content moderation.
  • Lightweight embedding pipelines for retrieval-augmented generation (RAG).
  • On-device AI assistants and smart agents.

Availability and Open Source


Both models are available under permissive open-source licenses, aligning with the growing community push for transparent and reproducible AI development. Developers can access the models via standard NLP frameworks and integrate them into existing pipelines without proprietary dependencies.


Implications for 2026 AI Landscape


The release comes at a time when the AI industry is shifting focus from raw parameter counts to efficiency and practical deployability. Desktop and edge AI, once limited to smaller models, is now benefiting from architectures that handle longer contexts without sacrificing speed. Liquid AI’s latest encoders highlight this trend, offering a viable path for bidirectional encoding workloads on general-purpose hardware.


For more details, visit the official Liquid AI release page or their GitHub repository.

via MarkTechPost

Related