Autonomous table optimization when query workloads stop being predictable: observing file layout and query patterns, scoring compaction work, adaptive sort order, and cost discipline.

Autonomous Table Optimization When Your Query Workload Stops Being Predictable

A field guide to the Apache Iceberg V4 proposals: adaptive metadata trees, single-file commits, typed statistics, column families, and what is safe to build on today.

Reading the Apache Iceberg V4 Proposals Before They Land

An honest TCO framework for open lakehouses versus proprietary warehouses: five cost categories, measured numbers, sensitivity analysis, and where each side still wins.

Building an Honest TCO Model for Open Lakehouses and Proprietary Warehouses

How the Iceberg REST catalog became the lakehouse control plane: multi-table atomic commits, credential vending, capability negotiation, and what still breaks.

How the Iceberg REST Catalog Turned Into the Lakehouse Control Plane

A dependency-first playbook for migrating legacy warehouses onto Apache Iceberg: snapshot vs migrate vs add_files, four-level parity validation, and federation-based cutover.

A Migration Playbook for Moving Legacy Warehouses onto Apache Iceberg

How AWS, Google Cloud, and Microsoft Azure actually support Apache Iceberg: storage, catalogs, maintenance, governance, and interoperability, layer by layer.

Apache Iceberg Support Across the Major Hyperscalers

Block vs. Object Storage: A Deep Dive Into the Foundation of Modern Data, and How the Lakehouse Made the Slow Option Fast

Preparing Your Data Lakehouse for the EU AI Act: Auditable Lineage and Data Provenance

Federation and the Lakehouse: Two Roads to Unified Data Access, and How to Know Which One to Take

File Encryption for the Lakehouse: The Terminology, the Machinery, and the Hard Problem of Interoperable Encrypted Tables

Designing Private, Air-Gapped Data Lakehouses: Scaling Iceberg in Highly Secure, On-Premises Clouds

Optimize single-node data engineering with DuckDB, DataFusion, Polars, and LakeSail. Compare architectures and learn when to transition to Dremio MPP.

Single-Node Data Engineering: DuckDB, DataFusion, Polars, and LakeSail

Apache Iceberg 1.11.0 delivers manifest list encryption, the new pluggable File Format API, credential lifecycle refreshes, and Spark/Flink improvements.

An In-Depth Overview of the Apache Iceberg 1.11.0 Release

Learn about the Apache Software Foundation's history, governance model, and why it matters for open source data lakehouse technologies like Iceberg, Parquet, and Arrow.

Apache Software Foundation: History, Purpose, and Process

A deep dive into Apache Parquet's columnar storage format, encoding strategies, and why it's the backbone of modern data lakehouse architectures.

What is Apache Parquet? Columns, Encoding, and Performance

Understand how Apache Iceberg brings ACID transactions, schema evolution, and time travel to object storage, enabling the modern open data lakehouse.

What is Apache Iceberg? The Table Format Revolution

Apache Polaris is the open-source Iceberg REST catalog that enables multi-engine interoperability across your entire lakehouse ecosystem.

What is Apache Polaris? Unifying the Iceberg Ecosystem

Apache Arrow provides a standardized in-memory columnar format that eliminates serialization overhead between query engines, eliminating the cost of data movement.

What is Apache Arrow? Erasing the Serialization Tax

Learn how to combine Apache Iceberg, Apache Parquet, Apache Arrow, and Apache Polaris into a complete, vendor-neutral open data lakehouse.

Assembling the Apache Lakehouse: The Modular Architecture

Explore how the Apache Lakehouse stack enables agentic AI systems to autonomously query, reason over, and act on large-scale structured data.

Agentic Analytics on the Apache Lakehouse

An updated introduction to Apache Iceberg

A 2026 Introduction to Apache Iceberg

A look back at key developments in Apache Iceberg, Polaris, Parquet, and Arrow in 2025.

2025 Year in Review Apache Iceberg, Polaris, Parquet, and Arrow

Walkthrough with the new trial of the Dremio Cloud Platform

Comprehensive Hands-on Walk Through of Dremio Cloud Next Gen (Hands-on with Free Trial)

A curated guide to mastering Apache Iceberg, data lakehouse architectures, and the emerging field of Agentic AI for data professionals.

2025-2026 Guide to Learning about Apache Iceberg, Data Lakehouse & Agentic AI

Dive into the world of commercial Iceberg catalogs and discover how they enhance data lakehouse architectures for modern data engineering.

An Exploration of the Commercial Iceberg Catalog Ecosystem

Exploring paths to a universal lakehouse catalog that supports multiple data formats and engines, building on Apache Iceberg's success.

Building a Universal Lakehouse Catalog - Beyond Iceberg Tables

Learn how to leverage Apache Iceberg with Apache Polaris and Apache Spark to build scalable and efficient data lakehouses.

Intro to Apache Iceberg with Apache Polaris and Apache Spark

What's Coming in Apache Iceberg v4: A Deep Dive into the Future of Open Table Formats

The State of Apache Iceberg v4 - October 2025 Edition

Understanding Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

The Ultimate Guide to Open Table Formats - Iceberg, Delta Lake, Hudi, Paimon, and DuckLake

What is the Data Lakehouse and the Data Lakehouse Ecosystem? This comprehensive guide covers everything you need to know about the Data Lakehouse architecture, open table formats like Apache Iceberg, Delta Lake, Apache Hudi, and Apache Paimon, and the modern data ecosystem that supports them.

The 2025 & 2026 Ultimate Guide to the Data Lakehouse and the Data Lakehouse Ecosystem

Unlocking the Power of Agentic AI with Apache Iceberg and Dremio

Learn how Apache Iceberg tables can degrade over time without optimization and what issues this causes for performance, cost, and governance.

The Cost of Neglect  – How Apache Iceberg Tables Degrade Without Optimization

Guide on How to Be Part of the Lakehouse Community

How to Discover or Organize Lakehouse & Apache Iceberg Meetups

Understanding the value of a lakehouse and how to get that value faster

The Data Lakehouse - The Benefits and Enhancing Implementation

What is Apache Iceberg, How it Works, and Why it Matters!

2025 Comprehensive Guide to Apache Iceberg

A Guide on when to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

When to use Apache Xtable or Delta Lake Uniform for Data Lakehouse Interoperability

A personal story of how I built Pangolin Catalog over a holiday break using an AI-powered IDE.

Building Pangolin - My Holiday Break, an AI IDE, and a Lakehouse Catalog for the Curious

A Comprehensive Guide to Building a Data Lakehouse with Apache Iceberg

2025 Guide to Architecting an Iceberg Lakehouse

What is cool about Apache Iceberg's Future

10 Future Apache Iceberg Developments to Look forward to in 2025

Auto ingesting data from JSON, CSV, and Parquet files into Apache Iceberg Tables

Deep Dive into Dremio's File-based Auto Ingestion into Apache Iceberg Tables

The Role of Dremio and Apache Iceberg in AI-Ready Data

Dremio, Apache Iceberg and their role in AI-Ready Data

Hands-on with Apache Iceberg & Dremio on Your Laptop within 10 Minutes

Data Modeling - Entities and Events

All About  Parquet Part 01 - An Introduction

All About  Parquet Part 02 - Parquet's Columnar Storage Model

All About  Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and Columns

All About  Parquet Part 04 - Schema Evolution in Parquet

All About  Parquet Part 05 - Compression Techniques in Parquet

All About  Parquet Part 06 - Encoding in Parquet | Optimizing for Storage

All About  Parquet Part 07 - Metadata in Parquet | Improving Data Efficiency

All About  Parquet Part 08 - Reading and Writing Parquet Files in Python

All About  Parquet Part 09 - Parquet in Data Lake Architectures

All About  Parquet Part 10 - Performance Tuning and Best Practices with Parquet

A Guide to dbt Macros - Purpose, Benefits, and Usage

What's Going on in the Data Lakehouse Space

Data Lakehouse Roundup 1 - News and Insights on the Lakehouse

Learning to work with PyArrow to run analytics

Getting Started with Data Analytics Using PyArrow in Python

Process Data from Raw to Clean Aggregated Data

What is Three-Tier Data (Bronze, Silver, Gold) and How Dremio Simplifies It

Controlling Access to your Apache Iceberg Tables

A Brief Guide to the Governance of Apache Iceberg Tables

Learning to work with Python to ingest and query data

Exploring Data Operations with PySpark, Pandas, DuckDB, Polars, and DataFusion in a Python Notebook

Apache Iceberg Education, Tutorials and more!

Ultimate Directory of Apache Iceberg Resources

Handling Synching Changing Data Across Systems

Change Data Capture (CDC) when there is no CDC

Combining Centralization and Decentralization for Data at Scale

Virtualization + Lakehouse + Mesh = Data At Scale

Hands-on with Apache Iceberg on Your Laptop - Deep Dive with Apache Spark, Nessie, Minio, Dremio, Polars and Seaborn

Why Data Analysts, Engineers, Architects and Scientists Should Care about Dremio and Apache Iceberg

5 Trends in the Data Lakehouse Space

Setting up a quick and easy data environment for data science and analytics

Using the alexmerced/datanotebook Docker Image

Continuing the Understand Apache Iceberg series, this article delves into the Manifest, a critical component of Apache Iceberg's architecture.

Understanding Apache Iceberg Delete Files

Understanding the Apache Iceberg Manifest

Continuing the Understand Apache Iceberg series, this article delves into the Manifest List, a critical component of Apache Iceberg's architecture.

Understanding the Apache Iceberg Manifest List (Snapshot)

The role and content of the metadata.json

Understanding Apache Iceberg's Metadata.json

Understanding Iceberg Catalog Interoperability

What Apache Iceberg REST Catalog is and isn't

What are ACID Guarantees? WHy do they matter?

ACID Guarantees and Apache Iceberg - Turning Any Storage into a Data Warehouse

Data Lakehouse 101 - The Who, What and Why of Data Lakehouses

Learn about the new open source Iceberg Catalog in Town

Understanding the Polaris Iceberg Catalog and Its Architecture

Apache Iceberg Reliability

Upcoming Data Talks from Alex Merced (And how to follow)

Databases Deconstructed - The Value of Data Lakehouses and Table Formats

Introductory Course to Data Engineering for Apache Iceberg Lakehouses

Video Course - Basics of Lakehouse Engineering - Apache Iceberg, Nessie, Dremio

Benefits of Apache Iceberg Partition Evolution and Hidden Partitioning

Partitioning with Apache Iceberg - A Deep Dive

3 Reasons Data Engineers Should Embrace Apache Iceberg

How to run SQL on your Excel files easily

Running SQL on your Excel Files From Your Laptop with Dremio

Java, Rest and the expanding open lakehouse ecosystem

Understanding the Future of Apache Iceberg Catalogs

A Deep Intro to Apache Iceberg and Resources for Learning More

Ingesting Data and Building BI Dashboards

End-to-End Basic Data Engineering Tutorial (Spark, Dremio, Superset)

Apache Iceberg, Apache Arrow, Nessie, Ibis, Substrait

5 Open Source Data Projects You Should Be Following

Understanding how catalogs work and which one to choose

5 Reasons Dremio is the Ideal Apache Iceberg Lakehouse Platform

Disrupting the Snowflake/Databricks status quo

The Apache Iceberg Lakehouse - The Great Data Equalizer

10 Reasons to Make Apache Iceberg and Dremio Part of Your Data Lakehouse Strategy

A deep dive into the concept and world of Apache Iceberg Catalogs

Introduction to ANSI SQL - Understanding the Syntax and Concepts

Understanding the Value of the Data Lakehouse

What is the Data Lakehouse and the Role of Apache Iceberg, Nessie and Dremio?

Deep Dive in Data Lake Table Partitioning

Partitioning Practices in Apache Hive and Apache Iceberg

Understanding the Data Vault Style of Data Warehouse Modeling

Introduction to Data Vault Modeling

Understanding how to choose a table format

Table Format FUD - Thinking Through the Table Format Conversion (Apache Iceberg, Apache Hudi, Delta Lake)

Embracing the Future of Data Management - Why Choose Lakehouse, Iceberg, and Dremio?

Resources for learning how to Engineer an Open Data Lakehouse

Open Lakehouse Engineering/Apache Iceberg Lakehouse Engineering - A Directory of Resources

Nessie is the only open-source catalog implementation specifically for Apache Iceberg.

Nessie -  An Alternative to Hive & JDBC for Self-Managed Apache Iceberg Catalogs

This is where the combined power of Dremio’s Lakehouse Management features and Project Nessie's catalog-level versioning comes into play.

Post Search