Category: Data Engineering
-
Building Event-Driven Amazon Redshift Lakehouse Architecture for Cloud Excellence at MuleSoft
Explore how MuleSoft implemented a sophisticated lakehouse architecture using AWS services to achieve cloud excellence. Learn about their three-phase approach combining preparation, enrichment, and action to create a comprehensive cloud operations framework.
-
Integrating AWS Glue with Amazon OpenSearch Service for Streamlined Data Ingestion
Discover how to effectively integrate AWS Glue with Amazon OpenSearch Service for streamlined data ingestion. Learn about three powerful integration methods, best practices, and infrastructure setup for building robust data pipelines.
-
Optimizing Quant Research with Apache Iceberg: Performance and Productivity Gains
Explore how Apache Iceberg enhances quantitative research platforms through improved query performance, cost reduction, and increased productivity. Learn about its advantages over traditional Parquet files and its impact on data management efficiency.
-
Scaling Data Preprocessing: Leveraging Ray and GKE for Large-Scale ML Datasets
Discover how to overcome data preprocessing challenges in machine learning by implementing a distributed computing solution using Ray and Google Kubernetes Engine (GKE). Learn to efficiently handle large-scale datasets and accelerate your ML workflow.
-
Revolutionizing the 3D Printing Supply Chain: HP’s Innovative Approach with Delta Sharing
Discover how HP is revolutionizing the 3D printing supply chain using Delta Sharing. By leveraging real-time telemetry data, predictive maintenance, and enhanced data security, HP empowers customers to optimize operations, reduce downtime, and improve overall efficiency. Explore the power of data-driven solutions in transforming business outcomes.
-
HEMA’s Data Governance Transformation: Leveraging Amazon DataZone for Enterprise Success
Discover how HEMA revolutionized their data management by implementing Amazon DataZone, transforming from siloed data systems to an efficient data mesh architecture that enables seamless data sharing and governance across their enterprise.
-
Amazon Q Data Integration: Enhanced DataFrame Support and Context-Aware ETL Development
Discover how Amazon Q data integration has evolved with DataFrame support and context-aware development, revolutionizing ETL workflows. Learn about its enhanced capabilities, multiple data source support, and seamless integration with AWS services.
-
Jumia’s Data Platform Modernization: Building Metadata-Driven Frameworks on AWS
Discover how Jumia, Africa’s leading e-commerce platform, transformed its data infrastructure by migrating from Hadoop to AWS serverless solutions, achieving 50% cost reduction through innovative metadata-driven frameworks and standardized workflows.
-
Implementing End-to-End Data Lineage for Complex Analytics using AWS Services and dbt
Discover how to build comprehensive data lineage for one-time and complex queries using Amazon Athena, Redshift, and Neptune. Learn about unified data modeling with dbt and automated lineage generation through AWS serverless architecture.