Introducing mw1.micro: A Game-Changing Addition
Amazon Managed Workflows for Apache Airflow (Amazon MWAA) has unveiled mw1.micro, a groundbreaking addition to their environment classes. This lightweight solution maintains essential features while offering significant cost savings for organizations running Airflow environments in the cloud.
Technical Specifications and Architecture
The mw1.micro environment provides a balanced resource allocation with:
- 1 vCPU and 3GB RAM for scheduler/worker hybrid container
- 1 vCPU and 3GB RAM for web server
- 20GB ephemeral task storage using AWS Fargate platform version 1.4.0
- Support for up to 3 concurrent tasks
- Capacity for 25 DAGs
Key Features and Capabilities
Despite its compact size, mw1.micro maintains crucial functionalities:
- Configurable public or private web server access
- Custom plugin and requirement support
- Startup script capabilities
- Full Airflow UI functionality
- Advanced networking features including custom URLs and VPC support
- Separate CloudWatch log groups for monitoring
Important Considerations and Limitations
Users should be aware of certain constraints:
- Combined scheduler and worker in a single Fargate task
- Single web server limitation
- Maximum of 3 concurrent Airflow tasks
- T4g.medium Amazon Aurora PostgreSQL-Compatible Edition instance for meta database
Monitoring and Performance
For optimal operation, it’s essential to monitor key metrics including metadata database memory usage and CPU utilization of the worker/scheduler hybrid container. This ensures proper resource utilization and helps identify potential capacity issues early on.
For more detailed information about Amazon MWAA Micro Environments, visit the official AWS blog post