How do you deploy a FastAPI AI application on AWS ECS?
Steps: (1) Push Docker image to ECR (Elastic Container Registry), (2) Create ECS Task Definition with container config, CPU/memory, env vars from Secrets Manager, (3) Create ECS Service with desired count and health checks, (4) Place behind Application Load Balancer for traffic distribution, (5) Set up CloudWatch for logs and alarms, (6) Use auto-scaling policies based on CPU/request count. Total time: ~2 hours for first deployment.
How do you implement auto-scaling for an AI inference API on AWS?
ECS auto-scaling: (1) Set up CloudWatch alarms on CPUUtilization and RequestCountPerTarget, (2) Define scaling policies: scale out when CPU > 70% for 2 minutes, scale in when CPU < 30% for 5 minutes, (3) Set minimum (2) and maximum (20) task counts, (4) Use Application Auto Scaling with step scaling or target tracking. For spiky AI workloads, add SQS queue between API and workers — scale workers based on queue depth, not just CPU.
Know your weak spots before the interview
10-question AI readiness assessment → personalized study plan.
Take Free Assessment →Unlock 3,000+ Interview Questions
Get full access to all interview questions with detailed answers, explanations, and real company context
Unlock Full Access →