Play free

Data World 2 · Pipeline Plumbing · Stage 5

Conduct the Run

Conduct, do not just start: wait for the job, retry what is transient, and tell someone about what is not.

  • AWS Step Functions
  • Standard and Express workflows
  • Run a Job (.sync)
  • Retry and Catch
Domain
Data engineering
World
Data World 2: Pipeline Plumbing (Associate)
Game type
Lake tuner: Tune a lake's tables until the queries fit their limit and budget.
Time
About 25 minutes on a first attempt (estimated)
Exam guides
  • DEA-C01Skill 1.3.1: Use orchestration services to build workflows for data ETL pipelines (for example, Lambda, EventBridge, Amazon Managed Workflows for Apache Airflow [Amazon MWAA], AWS Step Functions, AWS Glue workflows); Skill 1.3.2: Build data pipelines for performance, availability, scalability, resiliency, and fault tolerance; Skill 1.3.3: Implement and maintain serverless workflows; Skill 1.3.4: Use notification services to send alerts (for example, Amazon SNS, Amazon SQS); Skill 3.1.1: Orchestrate data pipelines (for example, Amazon MWAA, AWS Step Functions); Skill 3.1.2: Troubleshoot Amazon managed workflows