Tutorial
Amazon SageMaker HyperPod adds three-tier inference Data Capture with flywheel walkthrough
AWS describes SageMaker HyperPod Data Capture, which records live inference inputs and outputs to Amazon S3 at three independent tiers: SageMaker endpoint, load balancer, and model pod. The post walks through Tier 3 capture on a vLLM-served Qwen2.5-3B support-ticket router, uses Athena to surface a new-product blind spot in production traffic, labels captured records with a SQL policy, fine-tunes on a second GPU, and redeploys with capture still enabled. It also covers sampling, buffering, payload limits, KMS encryption, and the IAM roles required for capture to work.
Amazon SageMakerinference data capturemodel improvement