BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

8.8k
Stars
+627
Gained
7.7%
Growth
Python
Language

🎭 Best For

🏷️ Topics & Ecosystem

ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python

📊 Activity

Latest commit: 2026-08-28. Over the past 295 days, this repository gained 627 stars (+7.7% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.