Salesforce advances global model serving with SageMaker AI cross-Region inference routing
AWS details how Salesforce uses the SageMaker AI inference router to serve models across 30+ Regions and multiple AWS accounts. The router sends requests to local endpoints by default and fails over based on recent request outcomes, while residency-tagged traffic stays pinned in-Region. In a failover test, traffic shifted to a remote Region after local errors, with about 78% served remotely, under 100 ms added latency at p50, and a gradual return after recovery.