Janas: Run LLMs larger than RAM by streaming experts from SSD
Article URL: https://github.com/prabanta-dev/janas Comments URL: https://news.ycombinator.com/item?id=50063717 Points: 22 # Comments: 8
Hacker News15 min read
SSD
1 story
Showing 1 of 1 stories
You're all caught up.
AiByts Weekly Brief
Get the top AI news and tools straight to your inbox every week.
Weekly · AI news from Hacker News
Join 15,000+ AI enthusiasts