ray-project/llmperf
LLMPerf is a library for validating and benchmarking LLMs
4 best points · 0 comments · 1 Hacker News post · 1,127 GitHub stars · View on GitHub
Hacker News discussions
- LLM Inference Endpoint Performance Benchmarking Tool (4 points, 0 comments, by richardliaw, 2023-11-01)