Tag: llm

All the articles with the tag "llm".

• Django and Streaming LLMs

  Published:Jul 6, 2024 |  at 02:28 PM

  Websockets, SSE, REST - what's the best way to stream LLMs in Django?

• How to run big on small? - Quantization in LLMs

  Published:May 20, 2024 |  at 01:24 PM

  How does quantization work in LLMs? How does it help? Why would you use it?