Tag: Iceberg
-
Scaling Apache Iceberg Tables with AWS Lake Formation Hybrid Access Mode
Apache Iceberg tables combined with AWS Lake Formation’s hybrid access mode provide a powerful solution for enterprises managing large datasets. This approach allows organizations to use Lake Formation for read access while maintaining IAM policy-based permissions for write operations, offering fine-grained access control without disrupting existing workflows.
-
Unify Data Analytics: Integrating Amazon S3 Tables with SageMaker Lakehouse
Amazon SageMaker Lakehouse now integrates with Amazon S3 Tables, offering unified access to data across S3, Redshift warehouses, and other sources. This integration enables seamless analytics using preferred tools while maintaining security through fine-grained permissions, helping organizations derive insights from distributed data without duplication or complex connectors.
-
Building Netflix’s Impression System: Powering Personalized Content Discovery at Scale
Explore Netflix’s innovative impression system that processes billions of user interactions daily to power personalized content discovery. Learn how this sophisticated architecture combines real-time processing with historical data analysis for enhanced user experiences.
-
Access Amazon S3 Iceberg Tables in Databricks Using AWS Glue and SageMaker Lakehouse
Discover how to seamlessly integrate Databricks with AWS Glue Iceberg REST Catalog and SageMaker Lakehouse. Learn about unified data architecture, security controls, and efficient data access across platforms while maintaining a single source of truth.
-
Optimizing Quant Research with Apache Iceberg: Performance and Productivity Gains
Explore how Apache Iceberg enhances quantitative research platforms through improved query performance, cost reduction, and increased productivity. Learn about its advantages over traditional Parquet files and its impact on data management efficiency.
-
Implementing Write-Audit-Publish Pattern with Apache Iceberg and AWS Glue Data Quality
Explore how to implement the Write-Audit-Publish pattern using Apache Iceberg and AWS Glue Data Quality for robust data validation. Learn about efficient data quality management strategies and their practical applications in modern data architectures.
-
AWS Glue Data Catalog Enables VPC-Based Apache Iceberg Table Optimization
Discover how AWS Glue Data Catalog now supports automatic optimization of Apache Iceberg tables through VPC integration, enabling secure table maintenance while meeting strict access control requirements. Learn about key features and implementation details.