Tag: Data Catalog
-
How Meta Manages Data Understanding at Scale: A Privacy-First Approach
Meta has developed an innovative approach to data understanding at scale through their Privacy Aware Infrastructure, using a five-step process that includes schematization, metadata prediction, annotation, asset inventory, and continuous maintenance. This system enables Meta to manage millions of data assets while protecting user privacy and driving product innovation.
-
Scaling Apache Iceberg Tables with AWS Lake Formation Hybrid Access Mode
Apache Iceberg tables combined with AWS Lake Formation’s hybrid access mode provide a powerful solution for enterprises managing large datasets. This approach allows organizations to use Lake Formation for read access while maintaining IAM policy-based permissions for write operations, offering fine-grained access control without disrupting existing workflows.
-
Cross-Account Data Collaboration with Amazon DataZone and AWS Analytics Tools
Amazon DataZone enables secure cross-account data collaboration for AWS services. This solution streamlines data sharing between producer and consumer accounts while maintaining governance. Learn how to set up, publish, and consume shared data assets across accounts using AWS Glue and Amazon Redshift.
-
AWS Glue Data Catalog Enables VPC-Based Apache Iceberg Table Optimization
Discover how AWS Glue Data Catalog now supports automatic optimization of Apache Iceberg tables through VPC integration, enabling secure table maintenance while meeting strict access control requirements. Learn about key features and implementation details.
-
Enhance AWS Glue Data Catalog with Generative AI and Amazon Bedrock
Learn how to automate metadata generation for AWS Glue Data Catalog using foundation models on Amazon Bedrock. This solution explores both in-context learning and RAG approaches to create comprehensive data descriptions for improved data governance.