mosecorg/mosec
A high-performance ML model serving framework, offers dynamic batching and CPU/GPU pipelines to fully exploit your compute machine
4 best points · 1 comments · 2 Hacker News posts · 903 GitHub stars · View on GitHub
Hacker News discussions
- Show HN: Mosec makes the machine learning model serving flexible and efficient (4 points, 1 comments, by urcyanide, 2021-10-05)
- Python Machine Learning Service Can Run Way More Faster (1 points, 0 comments, by urcyanide, 2022-10-06)