Janas: Run LLMs larger than RAM by streaming experts from SSD

Article URL: https://github.com/prabanta-dev/janas Comments URL: https://news.ycombinator.com/item?id=50063717 Points: 22 # Comments: 8