BentoML

BentoML turns model serving into Python APIs

I break down BentoML’s serving model and give you a copy-ready template for OpenAI-compatible model APIs.