Live intelligence

Latest AI updates

1 updates
Products

Salesforce advances global model serving with SageMaker AI cross-Region inference routing

AWS details how Salesforce uses the SageMaker AI inference router to serve models across 30+ Regions and multiple AWS accounts. The router sends requests to local endpoints by default and fails over based on recent request outcomes, while residency-tagged traffic stays pinned in-Region. In a failover test, traffic shifted to a remote Region after local errors, with about 78% served remotely, under 100 ms added latency at p50, and a gradual return after recovery.

Amazon SageMaker AISalesforcecross-Region inference routing