Explore tools, prompts, skills, news and resources related to inference 第12页.
Prompt works related to inference 第12页
Latest articles, prompts, use cases and editorial content about inference 第12页
A new arXiv paper argues that existing benchmarks for predicting how many tokens an LLM will decode from prefill-phase hidden states conflate predictor quality with task difficulty, causing reported accuracy to collapse...
Breakthrough Listen and the SETI Institute are integrating AI agents into observations at the Allen Telescope Array, enabling telescope control, calibration and live signal analysis through natural-language requests. NVI...
Researchers present Guideline-derived Decision Graph (GDGraph), a framework that decouples guideline compilation from case evaluation for radiological risk stratification and management planning. During compilation, a la...
This arXiv study examines looping in dense decoder-only transformers, where weights are reused to make models deeper without increasing parameter count. It finds that looping the full transformer gives the strongest qual...
The paper measures the energy cost of speculative decoding under production serving conditions on H100 and H200 GPUs using SGLang with CUDA graphs, at batch sizes up to 64 across five corpora. It finds that on dense mode...
Researchers used 2.71 million reactions to test whether retrieving reaction precedents can compensate for gaps in task-specific training coverage. With model parameters fixed, expanding only the retrieval corpus raised m...
A new arXiv paper introduces EpiAgent, a framework that gives LLM-based agents an explicit, learnable epistemic layer holding beliefs about other agents' private information. The agent's policy is split into tw...
EventSeeColor combines event-reconstructed grayscale images with aligned event data to guide a diffusion-based colorizer. The method uses semantic context, region-balanced chroma supervision and local RGB refinement to i...
This paper analyzes clustered optimal-transport activation steering for toxicity mitigation in Gemma-2-2B and Granite-3.1-2B. It proves that cluster displacements averaged by cluster size equal the standard difference-of...
The InferD paper introduces a low-interaction honeypot framework for studying threats targeting AI inference infrastructure, including model-serving stacks, inference APIs, vector databases and agent gateways. It emulate...
Edge0 released Audio8-TTS-Realistic, a 601M-parameter text-to-speech model supporting 23 languages and zero-shot voice cloning from a reference clip and transcript, with weights and code under Apache 2.0. Its training us...
Prime Intellect released Prime Mega MoE, a training-capable fused MoE kernel built on DeepSeek's DeepGEMM Mega MoE, adding an overlapping backward pass. It is available as a dispatch backend in prime-rl and supports...
Anthropic hiring manager Felix Rieseberg announces the end of traditional coding interviews, advising junior engineers to focus on business impact and rapid prototyping. Google DeepMind launches Genie 4, a real-time worl...
AWS announced that NVIDIA Nemotron 3.5 Super VL, a 120B-parameter MoE multimodal model, is now available on AWS and detailed its deployment on Amazon EKS, EKS Auto Mode, and SageMaker HyperPod EKS. The model activates 12...
Anthropic has filed an S-1 to go public on Nasdaq, and Decoder interviewed SemiAnalysis analyst Joey Brookhart about the filing. The discussion covers a reported $1.5 trillion to $2 trillion valuation range, $70 billion-...
Timestral is a family of four probabilistic time series foundation models with 5M, 28M, 123M, and 209M parameters. The design uses Decoupled Horizon Forecasting to separate prediction tokens from causally encoded context...
Google DeepMind announced Gemini 4 Carbon, a new frontier model positioned for cybersecurity and long-horizon tasks, initially available to trusted cyber defenders through the Fairwind Program with wider developer access...
Discover tools, products and platforms related to inference 第12页