mini-io

An end-to-end real-time crypto data platform that ingests live market data from Binance WebSocket, streams it through a 3-node Kafka cluster, lands raw data in MinIO Bronze, transforms it into Silver/Gold layers with PySpark, stores analytics in PostgreSQL, triggers via Discord

Self-hosted S3-compatible deduplication proxy that chunks uploads, stores unique blocks, and works with existing S3 clients and backends.

A secure Express.js backend for MinIO with robust multi-user authentication, user-specific bucket management, and strict bucket-level access control. Features JWT authentication, PostgreSQL (via Prisma), and admin-level integration with MinIO, ensuring each user can only access their own buckets. Ideal for teams and organizations.