Explore tools, prompts, skills, news and resources related to 16k.
Prompt works related to 16k
Latest articles, prompts, use cases and editorial content about 16k
Researchers introduce MentalGrid, a benchmark for testing whether multimodal large language models can simulate evolving spatial states without intermediate visual feedback. The evaluation finds existing models struggle,...
AWS describes how to detect and recover from silent data corruption (SDC) on SageMaker HyperPod by adding three checks to a PyTorch DDP training loop: non-finite gradient checks, ring replay audits, and weight fingerprin...
Google introduced the Gemini Decisions API, powered by the new Gemini Decision 1 model, which scores up to 1,000 typed questions against a shared input and returns calibrated probabilities instead of generating text. It...
Zyphra released ZYFA, an open-source FP8 and BF16 prefill attention kernel library for AMD Instinct MI355X GPUs. It achieves 1.16-1.76x speedups over AMD's AITER on real model activations, with lower FP8 error. The...
Thinking Machines released Inkling 2 Small, a 594B-total/17B-active multimodal MoE, trained from scratch in 68 hours on 8.4T tokens (NVFP4). It scores 31 on the Artificial Analysis Intelligence Index, beating many same-s...
Anthropic's Frontier Red Team released FlashProve, an open-source zkSNARK system for provable inference. It proves that a model's reply came from committed weights without revealing them, achieving ~110 tokens/...
The paper introduces DualBudget, a sparse text diffusion method that separately budgets attention graph edges and expert activations. It combines local, dilated, and global attention with conditional expert computation....
Factory has released Droid 1.0, a model-independent coding agent harness that enables programmatic tool calling by default. Its Script tool runs JavaScript in a sandbox, coordinating multiple tool calls while returning o...
Baseten's Base Labs released joey-1, a 2B parameter decision model that returns labels and calibrated probabilities instead of text. It achieves 20 ms P50 latency at $0.01 per million input tokens, making it suitabl...
Researchers from Tsinghua University and CUHK have open-sourced AKV, an Apache-2.0 serving system that lets LLM agents drop and reposition KV cache entries instead of summarizing text history. AKV extends SGLang's r...
Researchers at Stanford and UC Berkeley have released TokenGate, a drop-in module that adds learned token pruning to pretrained LLMs so long prompts are processed faster. A small MLP gate scores tokens at a chosen layer,...
Discover tools, products and platforms related to 16k