The Security and Observability Lakehouse for Enterprise AI

AI agents multiply the activity enterprises must monitor and secure. Teams shouldn’t have to sample logs or ship them out of their environment. MinIO AIStor and Datadog Bring Your Own Cloud (BYOC) enable enterprises to keep every log where policy requires, on a lakehouse they own and control, and investigate it in Datadog.
close icon

Validated for Datadog BYOC

MinIO AIStor is validated as the on-premises data foundation for Datadog BYOC. AIStor is the first supported and validated partner tested against the way Datadog BYOC actually writes, merges and searches data, not generic S3 compatibility. AIStor + Datadog BYOC delivers a premier experience in security and observability that empowers organizations at scale.
Learn More About BYOC
White rightward arrow with rounded edges.
IN THE NEWS

MinIO and Datadog Announce Strategic Partnership to Power Security and Observability Lakehouse for Enterprise AI

MinIO AIStor and Datadog BYOC give enterprises a data foundation they own and control. AIStor and Datadog BYOC deliver search and analysis where the data lives and real-time context for teams and AI across unified observability and security.

Datadog offers customers one unified platform for comprehensive AI-powered Observability and Security. MinIO AIStor gives on-premises customers a certified, high-performance lakehouse foundation for Bring Your Own Cloud, so they can keep every log locally without compromising on visibility.

‍

— Michael Whetten

SVP of Product, Datadog

AI Is Driving the Data

Agentic AI generates a growing stream of prompts, context, memory and tool calls, and monitoring and securing it means keeping that record. The AI shift turns “keep every log” from a nice-to-have into a requirement.
10x
Growth in Global 2000 agent use by 2027, with token and API call loads rising 1,000x

AI Creates the Data

Agents generate far more activity to record than people do.

2x+
Year-over-year growth in median tokens per LLM request, and roughly 4x for the heaviest users

AI Needs Monitoring

That means keeping complete telemetry, including an audit trail of what agents did.

Up to 40%
Of enterprise applications will include task-specific AI agents by 2026, up from less than 5% in 2025

AI Reads the Data

Agentic AI assistants such as Bits AI agents investigate across your logs, so gaps in history become gaps in answers.

Source: Gartner
Every one of those actions is activity enterprises will need to monitor and secure.

Complete Logs, Kept Where Policy Requires

Teams usually choose between retaining complete logs and keeping data where policy requires. Datadog BYOC queries the data in place, on a data foundation where AIStor implements the complete S3 API.

YOUR ENVIRONMENT

Log Sources

Agents, cloud services, serverless, forwarders and more send logs to Datadog BYOC.

YOUR ENVIRONMENT

Datadog BYOC

The Observability Pipelines Worker and BYOC engine index and query your logs on Kubernetes.

YOUR ENVIRONMENT

MinIO AIStor

Holds the indexed log data, read and written over the S3 API.

DATADOG SAAS

Datadog UI

Log Explorer, dashboards, monitors and alerts send queries in and receive only results out.

AIStor Powers Datadog BYOC

Datadog BYOC ingests, stores and searches logs inside your environment, so the data layer is the foundation everything else is built on. AIStor gives it a high-performance, easily scalable home you own and control, on industry-standard hardware.

AIStor Beyond Logs, Proven at Exabyte Scale

A leading North American automaker runs AIStor on its own infrastructure to ingest vehicle sensor and video data for AI training. These are AIStor platform results from that deployment, not BYOC results.
3+ EB
Usable capacity
6 PB
Ingested every day from 100,000+ vehicles
600,000+
S3 requests per second per cluster
300+
Node clusters stood up in a single weekend
Read the Full Customer Story
arrow

How AIStor + Datadog BYOC Works

Datadog owns the engine and the experience. AIStor owns the data foundation underneath. Together they keep every log in your environment and searchable in Datadog.

STEP 1

Logs Flow Into Your Environment

Agents, cloud services and forwarders send logs to Datadog’s BYOC deployment, which runs in your own environment.

✓No log data leaves your environment during ingestion
✓Logs are ingested, indexed and stored inside your environment
STEP 2

AIStor Holds Every Log

Datadog BYOC writes to AIStor over the S3 API and searches the data in place, on high-performance storage you own.

✓Runs on industry-standard hardware
✓Built-in erasure coding protects the data
✓No per-operation or egress fees
STEP 3

Datadog Shows the Results

Teams investigate in the Datadog UI they already use. Only query results travel to Datadog.

✓Log Explorer, dashboards and monitors
✓Correlation with metrics and traces sent to Datadog
✓Bits AI investigations (Preview)
DATADOG BRINGS

The Engine and the Experience

✓The BYOC engine and Observability Pipelines Worker
✓Log Explorer, dashboards and monitors
✓Bits AI and the investigation experience (Preview)
MINIO BRINGS

The Data Foundation Underneath

✓A high-performance data foundation on industry-standard hardware
✓Built-in erasure coding, with no per-operation or egress fees
✓A lakehouse foundation: objects, Apache Iceberg tables and agentic memory

Built for Real-World BYOC Workloads

Regulated Enterprises
Purple Check icon
Logs stay in your environment to maintain privacy and compliance standards
Purple Check icon
Supports your residency and encryption requirements
Purple Check icon
Full history for the full retention period
AI & Agent Observability
Purple Check icon
A complete record of what agents do
Purple Check icon
Prompts, context and tool calls kept under your control
Purple Check icon
Investigate in Datadog, with Bits AI (Preview)
Security Log Retention
Purple Check icon
Retain full-fidelity security logs in OCSF
Purple Check icon
Query them for threat hunting and historical analysis
Purple Check icon
Security and observability data on one foundation
Analytics & AI on Telemetry
Purple Check icon
AIStor Tables (Apache Iceberg) beside your logs
Purple Check icon
One platform and one operating model
Purple Check icon
A single copy of agent telemetry supports analytics and AI

Read More