Live intelligence

Latest AI updates

2 updates
Products

Perplexity Launches Orchestrator API for Failover and Model Routing

Perplexity launched the Orchestrator API, a single endpoint serving frontier and open-weight models from multiple providers with automatic same-model failover across deployments. It accepts OpenAI Chat Completions, OpenAI Responses and Anthropic Messages request formats, so most teams only change the API key and base URL. A preview perplexity/auto routing feature uses plain-language route descriptions and falls back to a default model when no route matches or the decision model fails. Requests are billed at the answering model's published rate, and Perplexity says there is no additional platform fee on top of credits.

PerplexityAI inference infrastructureModel routing
Industry

Deepseek Open-Sources DeepInfer Inference Engine Behind V4.1-Flash

Deepseek has open-sourced DeepInfer, the inference framework powering its fast V4.1-Flash model. The vLLM-based system is described as reducing compute costs and energy use when running AI models. The release is framed as adding pricing pressure on Western providers such as OpenAI and Anthropic.

DeepseekAI inference infrastructureOpen-source AI