Amazon Web Services, Inc.

Amazon SageMaker Inference Router Runtime

Amazon SageMaker Inference Router Runtime is the runtime API for Amazon SageMaker AI inference routers. An inference router sends each request that you make…

AI & machine learning#openapi

Fork copies the collection into your workspace, without the publisher's secrets, so you can add your own key and send requests. Star saves it to your starred APIs (Account › Marketplace) and helps others find it.

Overview

Amazon SageMaker Inference Router Runtime is the runtime API for Amazon SageMaker AI inference routers. An inference router sends each request that you make to one of the destinations of a routing target. A destination is a SageMaker AI endpoint or inference component, in your account or in another account, in the router's Amazon Web Services Region or in another Region in the same Amazon Web Services partition. The router chooses a healthy destination with capacity, and prefers destinations in its own Region. Use InvokeInferenceRouter to get an inference in real time. Use InvokeInferenceRouterAsync to submit a request whose input and response are stored in Amazon S3. The inference router runtime endpoint supports HTTP/1.1 only. HTTP/2 isn't supported. If you use the Amazon Web Services SDKs or the Amazon Web Services CLI, you don't need to change anything.

Endpoints 2

  • POSTInvoke inference router/inference-routers/:InferenceRouterName/invocationsSends a real-time inference request to an inference router. In the request, you name the routing target, and the router sends the request to one of the…
  • POSTInvoke inference router async/inference-routers/:InferenceRouterName/async-invocationsSubmits an asynchronous inference request to an inference router. Before you call this operation, upload the input data to Amazon S3 in the router's Amazon…

API details

Base URL
https://inferencerouter-runtime.sagemaker.{region}.amazonaws.com
Authentication
AWS Signature Version 4 (requests signed with your AWS access key)
Operations
2 operations on 2 pathsPOST 2
Description format
AWS Smithy model, API version 2026-01-01

How to test the Amazon SageMaker Inference Router Runtime in Swastik Codes

  1. Open the APISelect “Fork & run in Swastik Codes” on this page. Sign in or create a free account if asked.
  2. Fork it into your workspaceChoose a workspace. You get your own copy of the Amazon SageMaker Inference Router Runtime collection, without the publisher's secrets.
  3. Add your credentialsThis API uses AWS Signature Version 4 (requests signed with your AWS access key). Add yours in the collection's variables or an environment; the requests already reference it.
  4. Send a requestPick an endpoint, for example “Invoke inference router” (POST /inference-routers/:InferenceRouterName/invocations), and press Send. Check the response, add tests and run the whole collection with the runner.

Frequently asked questions

What is the Amazon SageMaker Inference Router Runtime?

Amazon SageMaker Inference Router Runtime is the runtime API for Amazon SageMaker AI inference routers. An inference router sends each request that you make… It is listed under AI & machine learning and has 2 endpoints.

Who publishes the Amazon SageMaker Inference Router Runtime?

It is listed from Amazon Web Services, Inc.'s public API description (an OpenAPI document), not published by Amazon Web Services, Inc. on Swastik Codes. Anyone who controls amazonaws.com can claim the profile by adding a DNS TXT record.

What is the base URL of the Amazon SageMaker Inference Router Runtime?

Requests go to https://inferencerouter-runtime.sagemaker.{region}.amazonaws.com. Endpoint paths are added to this base URL.

How do I authenticate with the Amazon SageMaker Inference Router Runtime?

With AWS Signature Version 4 (requests signed with your AWS access key).

How many endpoints does the Amazon SageMaker Inference Router Runtime have?

2 operations on 2 paths (2 POST).

Is forking the Amazon SageMaker Inference Router Runtime free?

Yes. Forking copies the collection into your workspace for free. It has been starred 0 times and forked 0 times.

Suggest an API

Tell us which public API is missing. We check it, then add it here with its endpoints when it has an OpenAPI (Swagger) description.