FitMyLLM — Independent benchmarks for self-hosted AI (www.fitmyllm.com)
from anzo@programming.dev to selfhosted@lemmy.world on 03 Jun 08:57
https://programming.dev/post/51407461

cross-posted from: programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be… It has examples of many models and quantization levels. Huge resource!

#selfhosted