HackerGit Trending Discord Star

shayonj/loraplex

A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMe, routes requests, and pins workloads to nodes

2 best points · 0 comments · 3 Hacker News posts · 4 GitHub stars · View on GitHub

Hacker News discussions