Amazon Web Services, Inc.

Amazon EMR Containers

Amazon EMR on EKS provides a deployment option for Amazon EMR that allows you to run open-source big data frameworks on Amazon Elastic Kubernetes Service…

Developer tools#openapi#cloud

Fork copies the collection into your workspace, without the publisher's secrets, so you can add your own key and send requests. Star saves it to your starred APIs (Account › Marketplace) and helps others find it.

Overview

Amazon EMR on EKS provides a deployment option for Amazon EMR that allows
you to run open-source big data frameworks on Amazon Elastic Kubernetes Service (Amazon EKS).
With this deployment option, you can focus on running analytics workloads while Amazon EMR on EKS builds, configures, and manages containers for open-source applications.
For more information about Amazon EMR on EKS concepts and tasks, see What is
Amazon EMR on EKS
.

Amazon EMR containers is the API name for Amazon EMR on EKS. The emr-containers prefix is used in the following
scenarios:

It is the prefix in the CLI commands for Amazon EMR on EKS. For example,
aws emr-containers start-job-run .

It is the prefix before IAM policy actions for Amazon EMR on EKS. For
example, "Action": [ "emr-containers:StartJobRun"] . For more
information, see Policy actions for Amazon EMR on EKS
.

It is the prefix used in Amazon EMR on EKS service endpoints. For example,
emr-containers.us-east-2.amazonaws.com . For more information, see

Amazon EMR on EKSService Endpoints .

Endpoints 25

  • GETDescribe job run/virtualclusters/:virtualClusterId/jobruns/:idDisplays detailed information about a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon…
  • DELETECancel job run/virtualclusters/:virtualClusterId/jobruns/:idCancels a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.
  • GETList job templates/jobtemplates?createdAfter=string&createdBefore=string&maxResults=0&nextToken=stringLists job templates based on a set of parameters. Job template stores values of StartJobRun API request in a template and can be used to start a job run. Job…
  • POSTCreate job template/jobtemplatesCreates a job template. Job template stores values of StartJobRun API request in a template and can be used to start a job run. Job template allows two use…
  • GETList managed endpoints/virtualclusters/:virtualClusterId/endpoints?createdBefore=string&createdAfter=string&types=&states=&maxResults=0&nextToken=stringLists managed endpoints based on a set of parameters. A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR…
  • POSTCreate managed endpoint/virtualclusters/:virtualClusterId/endpointsCreates a managed endpoint. A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR Studio can communicate…
  • GETList security configurations/securityconfigurations?createdAfter=string&createdBefore=string&maxResults=0&nextToken=stringLists security configurations based on a set of parameters. Security configurations in Amazon EMR on EKS are templates for different security setups. You can…
  • POSTCreate security configuration/securityconfigurationsCreates a security configuration. Security configurations in Amazon EMR on EKS are templates for different security setups. You can use security…
  • GETList virtual clusters/virtualclusters?containerProviderId=string&containerProviderType=string&createdAfter=string&createdBefore=string&states=&maxResults=0&nextToken=string&eksAccessEntryIntegrated=trueLists information about the specified virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, update, describe, list and…
  • POSTCreate virtual cluster/virtualclustersCreates a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, update, describe, list and delete virtual clusters. They…
  • GETDescribe job template/jobtemplates/:idDisplays detailed information about a specified job template. Job template stores values of StartJobRun API request in a template and can be used to start a…
  • DELETEDelete job template/jobtemplates/:idDeletes a job template. Job template stores values of StartJobRun API request in a template and can be used to start a job run. Job template allows two use…
  • GETDescribe managed endpoint/virtualclusters/:virtualClusterId/endpoints/:idDisplays detailed information about a managed endpoint. A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon…
  • DELETEDelete managed endpoint/virtualclusters/:virtualClusterId/endpoints/:idDeletes a managed endpoint. A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR Studio can communicate…
  • GETDescribe security configuration/securityconfigurations/:idDisplays detailed information about a specified security configuration. Security configurations in Amazon EMR on EKS are templates for different security…
  • DELETEDelete security configuration/securityconfigurations/:idDeletes a security configuration.
  • GETDescribe virtual cluster/virtualclusters/:idDisplays detailed information about a specified virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, update, describe,…
  • DELETEDelete virtual cluster/virtualclusters/:idDeletes a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, update, describe, list and delete virtual clusters. They…
  • PATCHUpdate virtual cluster/virtualclusters/:idUpdates a virtual cluster. Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, update, describe, list and delete virtual clusters. They…
  • POSTGet managed endpoint session credentials/virtualclusters/:virtualClusterIdentifier/endpoints/:endpointIdentifier/credentialsGenerate a session token to connect to a managed endpoint.
  • GETList job runs/virtualclusters/:virtualClusterId/jobruns?createdBefore=string&createdAfter=string&name=string&states=&maxResults=0&nextToken=stringLists job runs based on a set of parameters. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon…
  • POSTStart job run/virtualclusters/:virtualClusterId/jobrunsStarts a job run. A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.
  • GETList tags for resource/tags/:resourceArnLists the tags assigned to the resources.
  • POSTTag resource/tags/:resourceArnAssigns tags to resources. A tag is a label that you assign to an Amazon Web Services resource. Each tag consists of a key and an optional value, both of…
  • DELETEUntag resource/tags/:resourceArn?tagKeys=Removes tags from resources.

API details

Base URL
https://emr-containers.{region}.amazonaws.com
Authentication
AWS Signature Version 4 (requests signed with your AWS access key)
Operations
25 operations on 12 pathsGET 11POST 7DELETE 6PATCH 1
Description format
AWS Smithy model, API version 2020-10-01

How to test the Amazon EMR Containers in Swastik Codes

  1. Open the APISelect “Fork & run in Swastik Codes” on this page. Sign in or create a free account if asked.
  2. Fork it into your workspaceChoose a workspace. You get your own copy of the Amazon EMR Containers collection, without the publisher's secrets.
  3. Add your credentialsThis API uses AWS Signature Version 4 (requests signed with your AWS access key). Add yours in the collection's variables or an environment; the requests already reference it.
  4. Send a requestPick an endpoint, for example “Describe job run” (GET /virtualclusters/:virtualClusterId/jobruns/:id), and press Send. Check the response, add tests and run the whole collection with the runner.

Frequently asked questions

What is the Amazon EMR Containers?

Amazon EMR on EKS provides a deployment option for Amazon EMR that allows you to run open-source big data frameworks on Amazon Elastic Kubernetes Service… It is listed under Developer tools and has 25 endpoints.

Who publishes the Amazon EMR Containers?

It is listed from Amazon Web Services, Inc.'s public API description (an OpenAPI document), not published by Amazon Web Services, Inc. on Swastik Codes. Anyone who controls amazonaws.com can claim the profile by adding a DNS TXT record.

What is the base URL of the Amazon EMR Containers?

Requests go to https://emr-containers.{region}.amazonaws.com. Endpoint paths are added to this base URL.

How do I authenticate with the Amazon EMR Containers?

With AWS Signature Version 4 (requests signed with your AWS access key).

How many endpoints does the Amazon EMR Containers have?

25 operations on 12 paths (11 GET, 7 POST, 6 DELETE, 1 PATCH).

Is forking the Amazon EMR Containers free?

Yes. Forking copies the collection into your workspace for free. It has been starred 0 times and forked 0 times.

Suggest an API

Tell us which public API is missing. We check it, then add it here with its endpoints when it has an OpenAPI (Swagger) description.