Live intelligence

Latest AI updates

19 updates
Products Editor selected

Amazon Bedrock Adds India-Based Inference for Kimi K3

Amazon Bedrock now supports in-country inference for Moonshot AI's Kimi K3 model in India, with processing confined to Mumbai and Hyderabad Regions. This enables customers with strict data residency requirements to use the model for workloads like OCR and multilingual document understanding. The post includes a code walkthrough for extracting data from Hindi documents and answering follow-up questions in Hinglish, plus tips on prompt caching and cost optimization.

Why it matters: Provides a concrete, recent AWS service update with practical code examples and a real customer case, valuable for developers needing compliant AI inference in India.

Amazon BedrockKimi K3data residency
Tutorial Editor selected

AWS builds multi-agent engineering assistant with Nova Multimodal Embeddings and Bedrock AgentCore

AWS presents a multi-agent system for aerospace part substitution evaluation, combining Amazon Nova Multimodal Embeddings, Amazon Bedrock AgentCore, and the Strands Agents SDK. The system routes queries across three specialist agents, uses deterministic code for spec-fit scoring, and keeps engineers as final decision-makers. It supports multimodal retrieval and visual similarity scoring, with a human-in-the-loop design for audit trails.

Why it matters: This is a concrete, recent technical guide with architecture details and code, valuable for engineers building multimodal RAG and multi-agent systems.

Amazon BedrockMultimodal AIAgentic AI
Industry Editor selected

Circle K cuts DevOps incident triage to under 15 minutes with Amazon Bedrock

Circle K built an automated incident triage system using Amazon Bedrock, reducing mean triage time from 45–60 minutes to under 15 minutes. The system uses agentic AI to investigate alerts, gather context from logs, AWS resources, and code, and deliver structured summaries to Slack. The architecture evolved from Amazon Bedrock Flows to AgentCore Runtime for longer sessions and better scalability.

Why it matters: Provides a concrete, recent case study with measurable results and architectural insights for AI-driven DevOps automation.

Amazon Bedrockincident managementAI operations
Tutorial Editor selected

AWS publishes end-to-end Amazon Bedrock cost management playbook

AWS outlines a five-stage operating model for managing Amazon Bedrock generative AI costs: attribute spend to IAM principals, log requests with metadata, enforce budgets, optimize platform defaults, and run a review cadence. The playbook covers per-user attribution behind shared gateways, invocation logging with CloudWatch and S3/Athena, and three enforcement tiers ranging from alerts to synchronous gateway blocking. It also details model routing and prompt caching as central cost levers, with diagnostic queries for token usage by caller and workload.

Why it matters: It gives FinOps and platform teams a concrete, implementation-oriented framework for attributing, observing, and controlling Bedrock spend as agentic workloads increase token consumption.

Amazon BedrockFinOpsAI cost governance
Industry Editor selected

Worldwide Express cuts freight billing exceptions by 75% with a Bedrock multi-agent system

Worldwide Express (part of ShipStation Global) built a multi-agent system on Amazon EC2 with Amazon Bedrock inference that works directly in its SpeedShip transportation management system to resolve LTL freight invoice exceptions. Three specialized agents, each handling invoice matching, pricing variance, and accessorial validation, retrieve carrier-specific tariff and dispute rules from per-carrier knowledge bases before recommending a resolution and writing a plain-language note for human approval in the analyst UI. Six months after launch, active exceptions fell from $15M to $4M, about 10,000 exceptions per week are closed automatically at under 1% error across 40+ carriers, and the company reports $10M in freed cash flow plus over $1M in annual savings. Human-in-the-loop bulk approval became the default once accuracy passed 99%.

Why it matters: It offers a metrics-backed blueprint for deploying multi-agent LLM systems against high-volume back-office exception workflows, including knowledge-base grounding, human review, and observability patterns readers can reuse.

Amazon Bedrockagentic AIlogistics automation
Tutorial

AWS Publishes Guide to Run ChatGPT Desktop App and Codex on Bedrock in GovCloud

AWS published a walkthrough for configuring the ChatGPT desktop app and Codex to use OpenAI models through Amazon Bedrock in AWS GovCloud (US-West). The setup routes inference through the Bedrock Mantle endpoint in us-gov-west-1 and relies on IAM, named AWS profiles, managed requirements.toml and config.toml policies, and network allow/deny rules. It covers authentication through a Bedrock API key or the AWS SDK credential chain, plus verification, troubleshooting, and rollback. AWS notes that following the guide does not by itself authorize a workload.

Amazon BedrockAWS GovCloudOpenAI Codex
Tutorial Editor selected

Building a Governed Agentic AI Platform on Amazon Bedrock AgentCore

This post presents an enterprise architecture for an Agentic AI Platform built on Amazon Bedrock AgentCore, addressing the operational challenges of scaling agents across teams. It details a federated operating model with a Platform control plane and repeatable Workstream cells, covering governed model and tool access, delegated delivery, fleet operations, and lifecycle management. The blueprint includes multi-account topology, service control policies, CI/CD pipelines with evaluation gates, and defense-in-depth security controls.

Why it matters: Provides a concrete, actionable reference architecture for enterprises seeking to operationalize agentic AI at scale, addressing real governance and delivery bottlenecks.

Amazon BedrockAgentic AIEnterprise Architecture
Tutorial Editor selected

Fixing evaluation bias for model selection on Amazon Bedrock

AWS and Property Finder describe how 96.8% of evaluation labels had been inherited from the incumbent model, biasing comparisons against alternatives. They built expert-annotated ground truth and used iterative prompt optimization to select Llama 4 Maverick 17B Instruct on Amazon Bedrock. The post reports development-set Micro F1 rising from 0.55 to 0.81 and an estimated 86% cost reduction, with a caveat that evaluation-set scores are optimistic because prompts were tuned on included images.

Why it matters: It gives practitioners a concrete methodology for auditing biased evaluation labels and running fairer model selection, with reported accuracy and cost tradeoffs.

Amazon Bedrockmodel evaluationprompt optimization
Tutorial

AWS demonstrates hybrid SLM/cloud agent routing with Strands Agents

AWS's Machine Learning Blog walks through the Adaptive Agentic Intelligence Framework (AAIF), built on Strands Agents, which uses a small local orchestrator model (llama3.2:1b via Ollama) to classify requests and route routine tasks to on-device models while escalating complex queries to cloud models on Amazon Bedrock. The post provides working code for local telemetry and vision tools, a Bedrock expert-insights tool, and deployment variants spanning edge, fully cloud, and air-gapped configurati

AWSStrands AgentsAmazon Bedrock
Products

Octave builds multi-tenant AI foundation on Amazon Bedrock

Octave's Reliance quality management platform built a shared three-layer AI foundation on Amazon Bedrock to serve regulated-industry customers while keeping tenant data isolated. The architecture uses Cohere Embed v4 for multimodal, multilingual embeddings written to per-tenant Amazon OpenSearch Service indexes, Bedrock AgentCore for isolated per-session execution and scoped credentials, and Bedrock Guardrails applied at input and output. An event-driven pipeline embedding roughly 2 billion docu

Amazon BedrockOctave RelianceCohere Embed v4
Products

OpenAI GPT-5.6, GPT-6 and GPT-6.1 on Amazon Bedrock Now Accessible from Canada via Cross-Region Inference

AWS announced that Canadian organizations can access OpenAI GPT-5.6, GPT-6 and GPT-6.1 models on Amazon Bedrock from the Canada (Central) and Canada West (Calgary) Regions using cross-Region inference profiles. Requests are invoked from the source Region and routed to destination Regions in North America (US geographic profiles) or supported commercial Regions (global profiles). The post details IAM and SCP permissions, invocation through the OpenAI Responses, Chat Completions and Bedrock Conver

Amazon BedrockOpenAI GPT modelsCross-Region inference
Products

AWS Agent Registry Enables Runtime Tool Discovery for AI Agents

AWS published a technical walkthrough of AWS Agent Registry, a managed service for cataloging and discovering MCP servers, agents, and agent skills at runtime. An orchestrator on Amazon Bedrock AgentCore runtime searches approved registry records via hybrid keyword and semantic search, constructs protocol-specific clients, and executes with request-scoped tools. The sample demonstrates MCP-only, MCP plus A2A, and pure semantic-match scenarios, with authentication kept separate from discovery.

AWS Agent RegistryModel Context Protocolagent orchestration
Products Editor selected

Amazon Bedrock adds structured outputs for Anthropic Claude models

Amazon Bedrock now supports structured outputs for all Anthropic Claude models on the bedrock-runtime and bedrock-mantle endpoints. The feature uses constrained decoding to enforce a JSON schema during token generation, which the post says makes output formatting deterministic and removes the need for custom parsing or retry logic. It covers JSON Schema output format and strict tool use, works with batch inference, cross-Region inference and streaming, and caches compiled grammars for 24 hours.

Why it matters: This gives teams building on Bedrock a concrete way to get schema-compliant JSON from Claude without custom validation code, which matters for data extraction and agent tool calls.

Amazon BedrockAnthropic ClaudeAWS
Products

TwelveLabs Pegasus 1.5 video model lands on Amazon Bedrock

TwelveLabs' Pegasus 1.5 is now available in Amazon Bedrock, adding time-based metadata generation that returns every matching video segment as structured JSON with start and end times. The release adds video segmentation, multimodal prompting with reference images, on-the-fly processing from S3 or base64 without pre-indexing, and support for videos up to two hours in a single request. It is invoked via the bedrock-runtime InvokeModel and InvokeModelWithResponseStream APIs in us-west-2.

Amazon BedrockTwelveLabs Pegasusvideo language models
Products

AWS introduces "Trust in Depth" framework for governing autonomous AI agents

AWS outlined a governance approach called Trust in Depth for letting AI agents act with more autonomy while keeping them within verifiable limits. The framework has four layers—Scope, Know, Bound and Observe—combining automated reasoning proofs of precise rules with deterministic policy enforcement outside the agent's reasoning, agent identity tracking, and production observability. It is backed by AWS services including Policy and identity controls in Amazon Bedrock AgentCore, Automated Reasoni

AWSAmazon BedrockAI agent governance
Tutorial

AWS sample automates Amazon Bedrock private pricing grant activation

AWS published a tutorial for managing Amazon Bedrock access through AWS Marketplace Private Pricing Offers and managed entitlements. It shows two approaches: a lightweight script for one-time activation of trusted received licenses, and a CDK-based event-driven automation that listens for Marketplace agreement events, verifies a seller allowlist, creates distributed grants, and activates them via License Manager. The event-driven path uses EventBridge, Lambda, DynamoDB, and CloudWatch Logs to re

Amazon BedrockAWS License ManagerAWS Marketplace private pricing
Products

Natural language security queries at Orca Security using Amazon Bedrock

Orca Security partnered with AWS to build Discovery AI, a natural-language query agent on Amazon Bedrock that converts security questions into Sonar/Discovery filters. The production system uses a nine-stage pipeline combining RAG example retrieval, Cohere Rerank 3.5, model selection, agentic filter generation, and validation, with different Bedrock models assigned per stage. Orca reports that Discovery AI reduced input tokens by 93 percent, cost by 90 percent, and latency by 75 percent versus i

Amazon BedrockOrca SecurityRetrieval-Augmented Generation
Tutorial

Accessing OpenAI GPT-6 models on Amazon Bedrock with global cross-Region inference in APAC

AWS describes how to invoke OpenAI GPT-6 Sol, Luna, and Astra through Amazon Bedrock global cross-Region inference profiles from Singapore, Jakarta, Malaysia, Thailand, and Taipei. The post shows configuration through the Converse API, OpenAI-compatible APIs, and the ChatGPT desktop app or Codex CLI, including required IAM and SCP permissions. It also covers quota management, data retention, and monitoring with CloudWatch and CloudTrail while keeping billing, quotas, and logs in the source Regio

Amazon BedrockOpenAI GPT-6AWS cross-Region inference