Live intelligence

Latest AI updates

27 updates
Products

Sarvam Launches Token Factory: India-Hosted Inference for 8 Open Models

Sarvam has opened Token Factory, a managed inference platform serving its own models and open-weight models from NVIDIA B200 clusters in India through one OpenAI-compatible API. The launch lineup lists 8 models including Sarvam 105B, GLM 5.3, DeepSeek V4.1 Flash 1017, Kimi K3.1 Pro and Gemma 4 31B, with on-premise deployment offered to enterprises. The stack combines a cache-aware control plane, separate prefill/decode GPU pools and a shared Mooncake-based cache; Sarvam reports 95.7% of prompt tokens served from cache for DeepSeek V4.1 Flash and a 2.2x throughput gain for Sarvam 105B from MXFP8 weights plus speculative decoding. Pricing starts at ₹10/₹25 per 1M tokens for Sarvam 105B (introductory through end of 2026), though all benchmarks are self-reported and Together still beats Sarvam on some DeepSeek streaming metrics.

Sarvam AILLM inference infrastructureIndia AI ecosystem
Products

Use prompt caching with open-weight models on Amazon Bedrock

Amazon Bedrock now supports explicit prompt caching for open-weight models, alongside implicit caching, to reduce costs and latency by reusing repeated prompt prefixes. The post demonstrates both modes via the Chat Completions API, including code examples and how to read cache usage fields. It also applies implicit caching to an OpenCode coding agent session and provides best practices.

Amazon BedrockPrompt CachingOpen-weight Models
Models Editor selected

Perplexity Releases Decider v1.3: Open-Weight Decision Models Add Locate

Perplexity released pplx-decider-v1.3 and pplx-decider-flash-v1.3, open-weight decision models that return option probabilities instead of generated text for yes/no, multiple-choice, score and locate questions over text or images. The main addition, Locate, extracts exact text spans with start and end character offsets for tasks such as NER, PII detection and extractive QA. The weights are Apache 2.0 on Hugging Face, and both models are available through the Perplexity Decisions API and OpenRouter. Perplexity reports benchmark gains over TypeSafe's Jev 1.14, though the figures are self-reported.

Why it matters: Useful for developers evaluating open-weight classifier and extraction models for routing, classification and structured extraction, with transparent licensing and deployment options.

Perplexityopen-weight modelsdecision models
Models

NaiveAI's Naive-N0.5-Flash: a speed-focused open-weights coding model, reviewed

Latent reviewed NaiveAI's Naive-N0.5-Flash, an open-weights coding model derived from Xiaomi's MiMo-V2.5 and paired with the company's NaiveRT inference engine. NaiveAI claims peak throughput around 2,100 tokens/s and sustained decode near 1,000 tokens/s, with target pricing of $0.10 per million input tokens and $0.40 per million output tokens. In Latent's small tests, the model answered faster at the median than DeepSeek V4.1 Flash 1017 and GLM 5.3 Flash at high thinking settings but used far more tokens on hard questions, while its reported coding benchmarks landed between the two comparison models.

NaiveAIopen-weight modelsAI coding
Opinion

Alex Stamos warns AI is rapidly lowering the cost of cyberattacks

Cognition security chief Alex Stamos argues that open-weight AI models and agentic tools can increasingly automate vulnerability discovery, exploit creation, and attacks. He says this shift is expanding advanced offensive capabilities beyond elite hackers while defenders still face high operational costs. Stamos calls for cheaper, layered AI systems to help security teams monitor logs, investigate alerts, and respond to attacks.

Alex StamosAI-assisted cyberattacksopen-weight models
Products

Thinking Machines' Inkling 2 Small claims top spot among western open-weight models

Thinking Machines, the startup led by former OpenAI CTO Mira Murati, is releasing Inkling 2 Small, a mixture-of-experts model with 594 billion parameters. The company claims it is the strongest western open-weight model, with improved agentic performance. However, this performance comes with significantly higher token usage.

open-weight modelsAI startupsmodel performance
Products Editor selected

Thinking Machines Unveils Inkling 2 Small: 17B-Active MoE Trained in 68 Hours

Thinking Machines released Inkling 2 Small, a 594B-total/17B-active multimodal MoE, trained from scratch in 68 hours on 8.4T tokens (NVFP4). It scores 31 on the Artificial Analysis Intelligence Index, beating many same-size Chinese models and ranking high among open-weight models. The model is available on Tinker with Apache 2.0 weights promised next week after safety testing.

Why it matters: This is a major open-weight model release with unprecedented training efficiency and competitive performance, offering concrete technical details and independent benchmarks.

Thinking MachinesInkling 2 Smallefficient pretraining
Industry Editor selected

AINews: Open-weight model releases, autonomous Linux patching, and AI talent moves

The roundup covers OpenAI's autonomous security pipeline, which it says validated and generated patches for 948 Linux kernel local privilege-escalation vulnerabilities at a $1.2M API cost. It also reports Moonshot releasing Kimi K3.1 Pro open weights, Cognition launching SWE-2 Flash, and Tencent detailing Hy4. Talent moves include Cat Wu leaving Anthropic for OpenAI and Sharon Zhou leaving AMD for Anthropic, while GPT-6.2 Sol and Astra remain unconfirmed rumors.

Why it matters: Readers get a dense, source-linked scan of the week's most consequential model releases, safety findings, infrastructure shifts, and industry moves.

OpenAIMoonshot AIopen-weight models
Models Editor selected

Ricursive AI Releases Ripple-65B Preview: A 65B Dense Open-Weight Model Scoring 80.5 on Terminal-Bench 2.1

Ricursive Intelligence has released Ripple-65B Preview, a 65B dense open-weight model pretrained from scratch for agentic coding. It achieves 80.5 on Terminal-Bench 2.1, the top self-reported score among US open-weight models, and is available under Apache 2.0 with three checkpoints. The model uses a dense Transformer architecture, trained on 12T tokens with up to 1M context, and claims a full R&D cost of $32M. It trails larger MoE rivals on some benchmarks like SciCode and DeepSWE.

Why it matters: This is a concrete new model release with notable performance claims and open-weight availability, offering practical value for developers and researchers in agentic coding.

AI model releaseopen-weight modelsagentic coding
Models

Nace AI Open-Sources Drex Max v1: A 27B Decision Model for Local Inference

Nace AI released Drex Max v1, a dense 27B decision model, as open weights under the Nace.AI Open RAIL-M license. It returns option probabilities in a single forward pass for choice, yes/no and ordinal questions, targeting routing, classification and policy checks. The release includes bf16 weights, a Q8_0 GGUF, an affine Q4 checkpoint and forks of llama.cpp and Ollama, with the 4-bit build fitting 24 GB+ Apple Silicon Macs. Nace self-reports 67.52 on Decision Index 0.4, ahead of Drex v2.0 at 61.25.

Nace AIDrex Maxopen-weight models
Models

Mistral Releases Weights for Trillion-Parameter Mistral Large 4

Mistral has released the weights for Mistral Large 4 (ML4), a trillion-parameter open-source AI model. Businesses and governments can download and deploy the system on their own infrastructure. The release is positioned toward cybersecurity use cases.

Mistralopen-weight modelsAI in cybersecurity
Models

Mistral Releases Open Weights for Mistral Large 4 (Le Chonk)

Mistral AI has published the weights of Mistral Large 4, nicknamed Le Chonk, as an open-weight release. The model is described as a 1T parameter multimodal model that Mistral calls the best open-weight model for coding, trained in Europe. The announcement focuses on coding use and defensive or security-oriented applications.

Mistral AIopen-weight modelsmultimodal LLMs
Models Editor selected

NVIDIA Releases Nemotron 3.5 Transcribe Open Speech LLM

NVIDIA has released Nemotron 3.5 Transcribe, an open-weights speech LLM that handles 40 languages and recordings up to one hour from a single model. The hybrid Mamba-Transformer MoE has roughly 34B total and 4.3B active parameters, with built-in speaker attribution, word timestamps and prompt-selected output styles. NVIDIA reports 4.71% mean WER on nine English Open ASR sets, the best open-weights score, though commercial APIs still lead. Weights ship in BF16, FP8, NVFP4 and GGUF under a commercial-use license, with NVFP4 fitting an RTX 5090.

Why it matters: Developers get a concrete open, commercially licensed speech model that combines transcription, diarization, timestamps and translation, with deployment details and benchmark context.

NVIDIANemotronspeech recognition
Models Editor selected

Hugging Face Releases Carbon-X, a 14.8B Open DNA Language Model

Hugging Face Bio has released Carbon-X, an Apache 2.0 decoder-only model with 14.8B parameters that processes raw DNA and English in a single token stream and answers in natural language. Built on Qwen3-14B with a hybrid tokenizer adding 5,515 DNA tokens over 6-mers, it was trained in four stages and runs on one 80GB GPU or quantized GGUF builds. Hugging Face reports a 66.7% average across five DNA benchmarks, leading on BioReason Coding at 74.9% but weaker on GenomeQA splice-site questions at 2

Why it matters: It gives readers a concrete, openly licensed DNA model with weight-level access, deployment guidance and self-reported benchmarks for judging practical use.

Carbon-XHugging Facegenomics
Models Editor selected

Moonshot releases Kimi K3.1 Pro with open weights promised by Nov 4

Moonshot launched Kimi K3.1 Pro on its API, priced at $2.00 per million input tokens and $10 per million output tokens, with a higher-priced "Highspeed" variant that runs 2-3x faster. The model is not yet open weights, but Moonshot promises full weights by Nov 4, 2026. Moonshot's own benchmarks place it near Claude Opus 5.5 and GPT-6 Astra, and Artificial Analysis scored it 55, behind only Opus 5.5 at 58. Simon Willison tested it through the Moonshot API, including a pelican SVG comparison acros

Why it matters: It signals a soon-to-be open-weight model reaching near-frontier benchmark standing at competitive API pricing, which matters to teams choosing models.

MoonshotKimi K3.1 Proopen-weight models
Models Editor selected

IBM Releases Granite Speech 5.0 2B, an Apache 2.0 Multilingual Speech Model

IBM released Granite Speech 5.0 2B, a 2B-parameter open speech-language model for transcription and translation in 6 languages under Apache 2.0. It combines a 16-block Conformer speech encoder with a window q-former and a fine-tuned granite-4.0-1b-base backbone, and adds language-ID prompting, keyword biasing up to 2,000 terms, and requested punctuation and capitalization. IBM reports 5.68% average English WER on the Open ASR Leaderboard, ranking second among open-weight models behind Qwen3-ASR-

Why it matters: Developers get a concrete, benchmarked open-weight ASR and translation release with deployment options and licensing details they can evaluate directly.

IBM Granitespeech recognitionopen-weight models
Industry

NVIDIA Details European Retail Deployments of Open Models and Physical AI

NVIDIA outlined how European retailers and brands are deploying its open models, inference software and digital twin tooling across commerce and logistics. Shopify post-trained NVIDIA Nemotron 3.5 Lightning for a Sidekick subagent, reporting better accuracy on an internal benchmark alongside 90% lower serving costs and 7x faster responses. Otto Group extended an NVIDIA Omniverse-based warehouse simulation effort to its largest fulfillment center in Germany, and L'Oréal is using NVIDIA ALCHEMI an

NVIDIAEurope retail AIopen-weight models
Models

NVIDIA Expands Open Model Portfolio Across Language, Robotics, Biology and Quantum

NVIDIA announced a broad expansion of its open model family, including Nemotron 3.5 Super VL and Bolt language models, Nemotron Retriever embedding and reranking models, and the new Kumo foundation models for structured business data. The lineup also covers Cosmos 3.5 world models, Alpamayo 2 Edge for autonomous vehicles, BioNeMo RFD4-Proteina for protein design and Ising for quantum computing. The company cites European partners including Mistral, Black Forest Labs and H-Company, plus enterpris

NVIDIAOpen-weight modelsEnterprise AI