White Paper

AIStor Table Sharing: Integrating Databricks with MinIO AIStor

About This Resource
Simple maroon user profile icon with circular head and curved shoulders.
Who This is For:

Data engineers, platform architects, and Databricks administrators at organizations that need cloud analytics platforms to access on-premises data governed by sovereignty, compliance, or cost constraints.

Key Takeaways
Blue check mark inside a light blue circle.

The Delta Sharing protocol is built directly into the AIStor binary with full feature parity across bare-metal and container deployments, removing the need for any third-party sharing framework.

Blue check mark inside a light blue circle.

A single AIStor Table Share endpoint serves both Delta and Iceberg tables simultaneously, with table format being the only variable -- no programmatic changes required on the consumer side.

Blue check mark inside a light blue circle.

Databricks workloads on AWS, Azure (Premium tier), and GCP can query live on-premises AIStor data via secure Private Link or Direct Connect connections, with administrators able to update shares dynamically without interrupting active Databricks sessions.

Most enterprise data required for cloud analytics stays on-premises by deliberate architectural and regulatory choice, not inertia. Replicating petabyte-scale datasets to the cloud introduces storage costs, egress fees, synchronization pipelines, and version drift. AIStor Table Sharing solves this by embedding the Delta Sharing protocol directly into the AIStor binary, with no third-party sidecar services required. The implementation supports both Delta and Iceberg tables from a single endpoint, using AIStor's integrated Iceberg REST catalog to extend Delta Sharing beyond its original Delta-only reference scope. Authentication uses bearer tokens or OAuth2 via OIDC, and shares can be created, updated, or deleted without downtime. This white paper covers complete setup procedures for two deployment methods, along with connection steps for Databricks on AWS, Azure, and GCP, including TLS certificate requirements, networking prerequisites, and Unity Catalog installation.

Related Resources