Tag: Airflow
-
Capture Data Lineage from dbt, Apache Airflow, and Apache Spark with Amazon SageMaker
Amazon SageMaker now offers enhanced data lineage capabilities compatible with OpenLineage, allowing users to track data flow from tools like dbt, Apache Airflow, and Apache Spark. This integration creates transparency, builds trust, and centralizes governance of data assets in a single place.
-
How Flutter UKI Optimized Data Pipelines with Amazon MWAA
Discover how Flutter UKI transformed their data pipelines by migrating from EC2-based Airflow to Amazon MWAA, managing 5,500 DAGs and 60,000 daily runs with improved stability and reduced operational overhead.
-
Amazon MWAA Introduces Micro Environments: Cost-Effective Apache Airflow Solution
Discover Amazon MWAA’s new mw1.micro environment class, a cost-effective solution for Apache Airflow that offers essential features with optimized resources. Perfect for development, testing, and small production workloads while maintaining core functionalities.