Skip to content
@online-dynamic-batching

online-dynamic-batching

Main repository PyPI License arXiv paper

Online Dynamic Batching

Online dynamic batching for faster LLM/VLM fine-tuning

Up to 4.4x faster

Start Here

New to ODB? Start with the main package, then open the example closest to your training stack.

Entry Use it for
Main package Install ODB, read the API, and choose an integration path
PyPI package Install the released package
Quickstart Try the minimal PyTorch loop and understand the ODB-ready batch contract
Example projects Run a framework-specific example workflow

Project Map

The organization is split into a core package and small framework-specific examples.

Repository Role
online-dynamic-batching Core package, integration guides, API docs, tests, and benchmark notes
odb-mm-mix-example Shared public MM-Mix-style data recipe and local TMDB utilities
odb-example-llamafactory LLaMA-Factory training and evaluation workflow
odb-example-hf-trainer Hugging Face Trainer workflow
odb-example-accelerate Accelerate custom-loop workflow
odb-example-lightning Lightning Trainer workflow

Paper

ODB is introduced in Online Dynamic Batching with Formal Guarantees for LLM Training by Dian Li, Zekun Wang, Yaoru Wang, and Jiahong Yan.

Links: arXiv · PDF · BibTeX

Design Principles

  • Observe real runtime lengths instead of relying on stale offline caches.
  • Keep batching at the DataLoader/collate boundary.
  • Make distributed dynamic batching explicit with aligned grouping metadata.
  • Keep examples framework-specific so users can copy the path closest to their stack.

Apache-2.0.

Popular repositories Loading

  1. .github .github Public

    GitHub organization profile for Online Dynamic Batching

  2. odb-mm-mix-example odb-mm-mix-example Public

    Public MM-Mix-style LLaMA-Factory reference example for Online Dynamic Batching

    Python

  3. odb-example-hf-trainer odb-example-hf-trainer Public

    Hugging Face Trainer MM-Mix integration example for Online Dynamic Batching

    Python

  4. odb-example-accelerate odb-example-accelerate Public

    Accelerate MM-Mix integration example for Online Dynamic Batching

    Python

  5. odb-example-lightning odb-example-lightning Public

    Lightning MM-Mix integration example for Online Dynamic Batching

    Python

  6. odb-example-llamafactory odb-example-llamafactory Public

    LLaMA-Factory MM-Mix reference example for Online Dynamic Batching

    Python

Repositories

Showing 6 of 6 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…