Tag: Data Management
-
Meta’s Agentic Solution for Data Warehouse Access Management
Meta transforms data warehouse access with multi-agent AI system featuring specialized data-user and data-owner agents. The solution addresses growing complexity in data access patterns through context-aware permissions, granular query control, and rule-based risk management while maintaining security guardrails.
-
Modernizing Batch Processing with Amazon Redshift ORDS Architecture
Discover how Vanguard modernized their legacy mainframe system using Amazon Redshift as an Operational Read-only Data Store (ORDS). Learn about their transition to cloud-native, domain-driven architecture while preserving critical batch processing capabilities and enabling cross-domain analytics with improved performance and scalability.
-
UDA: Netflix’s Unified Data Architecture for Seamless Data Integration
Netflix introduces UDA (Unified Data Architecture), a knowledge graph-based solution that addresses data integration challenges across their expanding business. UDA enables consistent modeling of business concepts, semantic data integration, and automated schema generation across systems like GraphQL and Avro.
-
How Meta Manages Data Understanding at Scale: A Privacy-First Approach
Meta has developed an innovative approach to data understanding at scale through their Privacy Aware Infrastructure, using a five-step process that includes schematization, metadata prediction, annotation, asset inventory, and continuous maintenance. This system enables Meta to manage millions of data assets while protecting user privacy and driving product innovation.
-
Scaling Apache Iceberg Tables with AWS Lake Formation Hybrid Access Mode
Apache Iceberg tables combined with AWS Lake Formation’s hybrid access mode provide a powerful solution for enterprises managing large datasets. This approach allows organizations to use Lake Formation for read access while maintaining IAM policy-based permissions for write operations, offering fine-grained access control without disrupting existing workflows.
-
Building an Operational Data Store with AWS Purpose-Built Databases for Finance Applications
Discover how Amazon Finance Automation built a high-performance operational data store using AWS purpose-built databases. Learn how they combined DynamoDB, OpenSearch, and Neptune to handle hundreds of millions of daily financial transactions with millisecond latency while maintaining flexibility and data accuracy.
-
Cross-Account Data Collaboration with Amazon DataZone and AWS Analytics Tools
Amazon DataZone enables secure cross-account data collaboration for AWS services. This solution streamlines data sharing between producer and consumer accounts while maintaining governance. Learn how to set up, publish, and consume shared data assets across accounts using AWS Glue and Amazon Redshift.
-
How EUROGATE Revolutionizes Container Terminal Operations with Amazon DataZone Integration
Discover how EUROGATE transformed its container terminal operations by implementing Amazon DataZone, enabling efficient data sharing, enhanced analytics, and streamlined machine learning capabilities across their European operations.
-
Optimizing Quant Research with Apache Iceberg: Performance and Productivity Gains
Explore how Apache Iceberg enhances quantitative research platforms through improved query performance, cost reduction, and increased productivity. Learn about its advantages over traditional Parquet files and its impact on data management efficiency.