Language
·
July 2026
A 1B-parameter LLM at 20 tokens/second, in a language you've never heard of
I challenged machin — my machine-first language — to run TinyLlama-1.1B at 20 tok/s on a laptop CPU, pure MFL, no C kernels. It hit 21.8, token-identical to llama2.c, and 4x faster than the reference C single-threaded. Here's the 2.1 -> 21.8 arc and what it drove into the compiler.
#machin
#llm
#inference
#performance
#ai-engineering
Read more