Play free

Data World 3 · Streams in Motion · Stage 5

Land It in S3

Buffers decide the files: Parquet the analysts can read, hours Athena can find, countries compliance can open.

  • Firehose buffering
  • Record format conversion
  • S3 prefixes
  • Dynamic partitioning
Domain
Data engineering
World
Data World 3: Streams in Motion (Associate)
Game type
Stream clock: Key and size a stream, then play every second of its peak.
Time
About 25 minutes on a first attempt (estimated)
Exam guides
  • SAA-C03Task 3.5: Determine high-performing data ingestion and transformation solutions
  • DEA-C01Skill 1.2.6: Transform data between formats (for example, from .csv to Apache Parquet); Skill 2.4.5: Describe best practices for indexing, partitioning strategies, compression, and other data optimization techniques; Skill 1.2.7: Troubleshoot and debug common transformation failures and performance issues; Skill 1.1.1: Read data from streaming sources (for example, Amazon Kinesis, Amazon Managed Streaming for Apache Kafka [Amazon MSK], Amazon DynamoDB Streams, AWS DMS, AWS Glue, Amazon Redshift)
  • MLA-C02Skill 1.1.5: Ingest from and write by using appropriate data formats (for example, Apache Parquet, JSON, CSV, ORC) based on data access patterns