Explore tools, prompts, skills, news and resources related to OpenAI-compatible API.
Latest articles, prompts, use cases and editorial content about OpenAI-compatible API
NVIDIA has released Nemotron 3.5 Transcribe, an open-weights speech LLM that handles 40 languages and recordings up to one hour from a single model. The hybrid Mamba-Transformer MoE has roughly 34B total and 4.3B active...
UC Berkeley's Sky Computing Lab released LEANN, an open-source vector index that stores a pruned graph instead of full embeddings and recomputes embeddings only for nodes on the search path. Benchmarks show a 60 mil...
Researchers from Tsinghua University and CUHK have open-sourced AKV, an Apache-2.0 serving system that lets LLM agents drop and reposition KV cache entries instead of summarizing text history. AKV extends SGLang's r...
Moonshot AI has released Kimi K3.1 Pro, a post-trained successor to Kimi K3 with 2.8T total and 104B active parameters in a mixture-of-experts architecture and a 1M-token context window. It is available now through an Op...
You.com has launched Inference Router, a managed, OpenAI-compatible API that routes requests across 12 open-weight models including Kimi K3, Qwen3.8 Max, GLM 5.3 and DeepSeek V4 variants. The service bundles a 99.9% upti...
AWS announced that Canadian organizations can access OpenAI GPT-5.6, GPT-6 and GPT-6.1 models on Amazon Bedrock from the Canada (Central) and Canada West (Calgary) Regions using cross-Region inference profiles. Requests...
StepFun has published open FP8 and BF16 checkpoints for Step 5 Preview, a sparse Mixture-of-Experts model with 600B total parameters, 27B active per token and up to 1M tokens of context, targeting long-horizon agentic wo...
AWS details a tutorial for deploying one large language model across two GPU nodes on Amazon EKS using the multi-node Ray LLM Deep Learning Container. The setup separates prefill and decode phases onto different nodes be...
The AWS Machine Learning Blog details serving quantized GGUF models with the AWS Deep Learning Container for llama.cpp on Amazon SageMaker AI, exposing OpenAI-compatible chat completions through InvokeEndpoint. It then e...
AWS describes how to invoke OpenAI GPT-6 Sol, Luna, and Astra through Amazon Bedrock global cross-Region inference profiles from Singapore, Jakarta, Malaysia, Thailand, and Taipei. The post shows configuration through th...
Discover tools, products and platforms related to OpenAI-compatible API
