AI/ML

MinIO Blog Posts

Exness: Managing petabytes of trading data with MinIO
arrow
How does Exness handle massive data volumes and demanding AI/ML workloads? By moving to an on-prem infrastructure powered by MinIO. From scaling their data lake to managing traffic peaks of 200 Gbps, MinIO supports their AI workflows, disaster recovery, and more.
AI/ML
Case Studies & Solutions
Repatriating AI Workloads: An On-Prem Answer to Soaring Cloud Costs
arrow
As AI workloads drive cloud costs through the roof, many companies are rethinking their approach. Moving select AI tasks back on-prem offers a path to predictable costs, improved performance, and stronger data control.
AI/ML
Cloud Infrastructure
Map-Style Datasets using Amazon’s S3 Connector for PyTorch and MinIO
arrow
AI/ML
Architecture & Design Patterns
Storage & Infrastructure
AI Data Workflows with Kafka and MinIO
arrow
AIStor is a foundational component for creating and executing complex data workflows. At the core of this event-driven functionality is MinIO bucket notifications using Kafka.
AI/ML
Apache Ecosystem
Operations
The MinIO DataPod: A Reference Architecture for Exascale
arrow
AI/ML
Architecture & Design Patterns
Storage & Infrastructure
AIStor
Earn your RAG-ing rights with MinIO
arrow
In this blog, we will demonstrate how to use MinIO to build a Retrieval Augmented Generation(RAG) based chat application using commodity hardware.
AI/ML
Data Lakes & Analytics
Architecture & Design Patterns
The Architect’s Guide to the GenAI Tech Stack - Ten Tools
arrow
AI/ML
Architecture & Design Patterns
WARP speed your AI data storage Infrastructure
arrow
Do you know the secret to some of the best AI models out there? It's the amount of data they had access to on which they could be trained on. For AI/ML models Fast accessible Data is King. Let me emphasize, it's not just Data, but fast accessible Data.
AI/ML
Performance
Architecture & Design Patterns
Storage & Infrastructure
Dell ECS Data Movement to MinIO
arrow
Dell ECS's “Data Movement”, also called copy-to-cloud is a feature introduced in ECS 3.8.0.1 that allows you to copy objects from Dell ECS to MinIO which is rather popular with customers and prospects who are modernizing their storage stack to support their AI data infrastructure requirements.
Cloud Infrastructure
Architecture & Design Patterns
Storage & Infrastructure
Integrations & Partners
Operations
MinIO Audit Logs in ElasticSearch in Kubernetes
arrow
Whether you are on-prem or in the Cloud, you want to ensure in the cloud operating model processes are set up in a homogenous way. This tutorial will give you a full overview of how you can surface MinIO audit logs in ElasticSearch so they can be searchable.
AI/ML
Security
Operations
Deploy MinIO and Trino with Kubernetes
arrow
In this tutorial, we'll deploy a cohesive system that allows distributed SQL querying across large datasets stored in Minio, with Trino leveraging metadata from Hive Metastore and table schemas from Redis.
AI/ML
Data Lakes & Analytics
Integrations & Partners
Optimizing AI Data Processing with MinIO Weaviate and Langchain in Retrieval Augmented Generation (RAG) Pipelines
arrow
Delve into AI’s next frontier with MinIO S3 Object-Store and SDK, enhancing a Weaviate Retreival Augmented Generation (RAG) Pipeline for robust data management. Discover how to elevate efficiency in AI systems using LangChain, unlocking new dimensions in scalable AI solutions.
AI/ML
Data Lakes & Analytics
Integrations & Partners
Architecture & Design Patterns
Storage & Infrastructure
MinIO Cache: A Distributed DRAM Cache for Ultra-Performance
arrow
AI/ML
AIStor
SQL Server 2022 Machine Learning Services Unlock the Value of Your Data
arrow
Learn how to run Python stored procedures on SQL Server 2022.
Integrations & Partners
AI/ML
Data Lakes & Analytics
Operations
MinIO and Apache Tika: A Pattern for Text Extraction
arrow
AI/ML
Data Lakes & Analytics
Integrations & Partners
Hungry GPUs Need Fast Object Storage
arrow
AI/ML
The Future of AI is Open-Source
arrow
Explore the future of AI in an open-source landscape, challenging Big Tech's masked efforts. Learn how embracing extreme open innovation fosters collaboration, drives market growth, and sets the stage for an open-source AI data stack.
Apache Ecosystem
Architecture & Design Patterns
AI/ML
LanceDB: Your Trusted Steed in the Joust Against Data Complexity
arrow
Joust against data complexity with LanceDB, a lightning-fast vector database optimized for AI/ML on the open-source Lance format. Teaming up with MinIO, it scales seamlessly, offering high-performance, cloud-native storage. Dive into the tutorial for a swift deployment.
AI/ML
Data Lakes & Analytics
Apache Ecosystem
Architecture & Design Patterns
Distributed Training and Experiment Tracking with Ray Train, MLflow, and MinIO
arrow
AI/ML
Distributed Data Processing with Ray Data and MinIO
arrow
AI/ML
An Unintended Consequence of the AI/ML Revolution - Power Shifts in the Enterprise
arrow
AI/ML
Feature Extraction with Large Language Models, Hugging Face and MinIO
arrow
AI/ML
Object Detection Made Simple with MinIO and YOLO
arrow
AI/ML
Building a Data Lakehouse using Apache Iceberg and MinIO
arrow
AI/ML
Integrations & Partners
Data Lakes & Analytics