Shipping 31 Rust crates in five days: a small-LLM dev stack, in the open

The author published 31 small Rust crates in five days to build a development stack for smaller open LLMs. This project addresses the challenges of using small models locally, which lack the advanced features of large API models like JSON modes and large context windows.