AI World 5 · Serve and Secure · Stage 2

Scale It

Lunchtime peaks, a tool idle overnight, a scan queue, a fleet that flaps, trees on a GPU and a Neuron-compiled model: the policy, metric and family for each.

Auto scaling metrics
Scale to zero
Instance families

Domain: AI and machine learning
World: AI World 5: Serve and Secure (Associate)
Game type: Solution board: Drop services into each row's slots, then run records through them.
Time: About 25 minutes on a first attempt (estimated)
Exam guides: MLA-C02Skill 3.2.6: Select specific metrics for auto scaling implementations; Skill 3.2.10: Implement AI-specific resource scaling for GPU workloads; Skill 4.2.1: Select inference instance families to optimize performance and cost; Skill 4.2.4: Optimize capacity for cost, performance, and reliability
AIP-C01Skill 4.1.3: Develop high-performance FM systems to maximize resource utilization and throughput for GenAI workloads (for example, by using batching strategies, capacity planning, utilization monitoring, auto-scaling configurations, provisioned throughput optimization); Skill 4.2.5: Create efficient resource allocation systems specifically for FM workloads (for example, by using capacity planning for token processing requirements, utilization monitoring for prompt and completion patterns, auto-scaling configurations that are optimized for GenAI traffic patterns)