HackerGit Trending Discord Star

juraj-jumic/dspark-local-bench

Does DSpark speculative decoding help on your GPU, for one user? Reproducible batch-size-1 benchmarks for llama.cpp on consumer GPUs.

2 best points · 0 comments · 1 Hacker News post · 3 GitHub stars · View on GitHub

Hacker News discussions