Live intelligence

Latest AI updates

1 updates
Products

Amazon SageMaker AI adds usage-based metering for bidirectional streaming

AWS announced usage-based metering for Amazon SageMaker AI bidirectional streaming, letting model providers report actual consumption to AWS Marketplace during live inference sessions. A companion metadata WebSocket carries JSON metering records correlated to the inference session by request ID. Deepgram is the launch partner, bringing usage-based Speech-to-Text and Text-to-Speech billing to AWS Marketplace. SageMaker AI endpoint infrastructure charges remain separate and still apply.

Amazon SageMaker AIAWS Marketplacereal-time speech AI