Skip to main content

Contrastive-LM Releases CLM-8B Open-Source Agent Model

Contrastive-LM has released CLM-8B, an 8B open-source model scoring agent actions up to 9x faster than Jev under the Apache-2.0 license.

AI-written
Inewgen
24 Sep 2026Source: MarkTechPost3 min read (0 views)
Share
Contrastive-LM Releases CLM-8B Open-Source Agent Model

Stock photo for illustration only, not from the actual event

Font size
  • Contrastive-LM launches CLM-8B, an 8B parameter open-source model
  • Scores agent actions up to 9x faster than Jev with Apache-2.0 license
  • Features dual encoders and cached state vectors on a single NVIDIA GPU

Contrastive-LM has released CLM-8B, an open-source single-model system designed to evaluate agent actions up to 9 times faster than Jev. Available under an Apache-2.0 license, the head weighs 75 MB and operates on a single NVIDIA GPU under Linux, utilizing vLLM to serve the Qwen3-8B encoder.

Jev previously entered limited early access on September 15, 2026, returning typed values with probabilities instead of raw text. CLM targets this same interface, providing a GitHub repository that serves CLM-8B behind a TypeSafe-compatible API and exposes three question types for users to replay requests through its Python client.

Faster than Jev
69.2%Accuracy after mid-training

For its training methodology, CLM trains a state encoder and an action encoder using a bidirectional InfoNCE loss. Each encoder consists of a frozen Qwen3-8B backbone combined with a 20M-parameter trainable projection head. Training pulls each state toward its actual action while pushing it away from others, using dot products between state and action embeddings for scoring during inference.

This architectural design disaggregates states and actions. In an agent loop, the state changes at every step while the action set remains mostly static. Consequently, clm-serve reserves a slab of GPU memory similar to vLLM's KV cache to reuse cached vectors. On a single RTX 4090 with three actions, revisited states drop from 1.7 ms to 0.6 ms, with model cards reporting speeds up to 13x faster than Jev with roughly 1,000 candidates.

Disaggregating states from actions represents a crucial efficiency breakthrough for AI agents by eliminating redundant computations for static action spaces. Caching vectors using a mechanism analogous to LLM KV caches demonstrates a powerful bridge between core infrastructure optimizations and complex agentic workflows.

Regarding accuracy evaluation, pre-training alone achieves 52.1% top-1 accuracy across approximately 100K held-out questions, while mid-training raises it to 69.2%. The 9x figure originates from the T-Rex game, where actions repeat across states, with CLM matching Jev on T-Rex and Super Mario while trailing on tool calling and WikiRacing while maintaining superior speed across all tasks.

Never miss the latest news?

Subscribe to get news summaries by email - not often enough to be annoying.

โฆษณา

gpu hardware electronics motherboard tech workspace

Stock photo for illustration only, not from the actual event

The research team also evaluated new verifier results across 38 held-out DeepSWE tasks and 30 held-out Terminal-Bench 2.1 tasks, measuring latency on an H100 GPU. CLM achieved new SOTA verifier results while running 4.1x to 5.7x faster. Because Jev scores below pass@1 on both benchmarks, selecting with Jev underperforms taking a single sample, whereas CLM provides robust acceleration.

Source: MarkTechPost

Comments

Leave a Comment
0/2000

Found something wrong in this article? Report an issue with this article