BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

8.9k
Stars
+729
Gained
8.9%
Growth
Python
Language

🎭 Best For

🏷️ Topics & Ecosystem

ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python

📊 Activity

Latest commit: 2026-10-27. Over the past 350 days, this repository gained 729 stars (+8.9% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.