Webinar

Architecting AIStor Table Sharing with Databricks for Scale and Performance

This webinar covers the full end-to-end setup for AIStor Table Sharing with Databricks, from production configuration through live query execution and Prometheus-based monitoring. The session opens with the six production settings that must be configured before any shares or tokens are created, explaining what each controls and how they interact: the sharing endpoint, pre-signed URL expiry, per-token rate limit, global rate limit, OAuth authentication, and OAuth token expiry. A console walkthrough covers share creation, adding Iceberg and Delta tables to the same share, token generation with scoped expiration, and profile.share file download. On the Databricks side, the demo imports the share into Unity Catalog via the Open Sharing protocol, confirms read-only enforcement at the protocol level, and runs a cross-format SQL join across a customer Iceberg table and an orders Delta table served from the same endpoint. The session closes with Prometheus metrics showing per-operation request counts, time-to-first-byte response curves, and rate limit saturation, demonstrating how each metric maps to a specific production decision.

About This Resource
Simple maroon user profile icon with circular head and curved shoulders.
Who This is For:

Data platform engineers, analytics architects, and Databricks administrators who need to give cloud-based Databricks workloads live query access to on-premises AIStor data, and who are responsible for configuring, securing, and monitoring that sharing infrastructure in production.

Key Takeaways
Blue check mark inside a light blue circle.

The open sharing endpoint must be explicitly configured before any tokens are created, as AIStor embeds it into every pre-signed URL and profile.share file at token creation time. An empty endpoint causes Databricks to fall back to an internally detected address that external consumers cannot reach.

Blue check mark inside a light blue circle.

A single AIStor Table Share endpoint serves both Iceberg and Delta tables simultaneously from the same share and token, with Databricks executing cross-format SQL joins across both table types without any format-specific configuration on the consumer side.

Blue check mark inside a light blue circle.

All six production settings (endpoint, pre-signed URL expiry, per-token rate limit, global rate limit, OAuth toggle, and OAuth token expiry) have corresponding Prometheus metrics available on the v3 endpoint, enabling real-time observability over request volume, response time, and rate limit saturation as consumer load grows.

Related Resources