GitHub - IshekKhal/bitrun: Single-binary runner and model manager for 1-bit / 1.58-bit ternary LLMs (Microsoft BitNet b1.58) on CPU (macOS, Windows, Linux)

Show HN: BitRun – Run 1-bit LLMs on CPU at 98T/s without compiling

Single-binary runner and model manager for 1-bit / 1.58-bit ternary LLMs (Microsoft BitNet b1.58) on CPU (macOS, Windows, Linux) - IshekKhal/bitrun
2 points by ishekofficial 6 hours ago github.com 0 comments
Summary not yet generated for this article.

Comments (0 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open