Tag: MWAA
-
Capture Data Lineage from dbt, Apache Airflow, and Apache Spark with Amazon SageMaker
Amazon SageMaker now offers enhanced data lineage capabilities compatible with OpenLineage, allowing users to track data flow from tools like dbt, Apache Airflow, and Apache Spark. This integration creates transparency, builds trust, and centralizes governance of data assets in a single place.
-
How Flutter UKI Optimized Data Pipelines with Amazon MWAA
Discover how Flutter UKI transformed their data pipelines by migrating from EC2-based Airflow to Amazon MWAA, managing 5,500 DAGs and 60,000 daily runs with improved stability and reduced operational overhead.
-
Streamlining Cross-Account Orchestration with Amazon MWAA
Learn how to orchestrate data workflows across multiple AWS accounts and regions using Amazon Managed Workflows for Apache Airflow (MWAA). This article covers implementing secure cross-account access, creating custom Airflow operators, and following best practices for distributed data processing and machine learning pipelines.
-
Amazon MWAA Introduces Micro Environments: Cost-Effective Apache Airflow Solution
Discover Amazon MWAA’s new mw1.micro environment class, a cost-effective solution for Apache Airflow that offers essential features with optimized resources. Perfect for development, testing, and small production workloads while maintaining core functionalities.