Blog

Building for Autonomy

Thoughts on agent-first infrastructure, self-hosted systems, and owning the stack.

Filtering by: #llm × Clear

All Product Language Engineering Infrastructure Open Source AI & SWE AI Engineering Framework

#machin #ai-agents #open-source #agent-first #ai-engineering #devtools #peage #self-hosted #agents #cli #compiler #security #automaintainer #dogfooding #mfl #remotecmd #infrastructure #performance #roam #supercli #x402 #a2a #agent-economy #analytics #compilers #concurrency #devops #game-dev #grange #hart

Engineering · July 2026

A 7-billion-parameter LLM at the speed of a 1B — in pure MFL

I ran OLMoE-1B-7B — a 7-billion-parameter Mixture-of-Experts model — in pure MFL, token-identical to the fp32 reference, streamed from disk, at 14.5 tok/s on a laptop. The disruption wasn't in the engine; it was in the model.

#machin #llm #moe #inference #pure-mfl

Language · July 2026

A 1B-parameter LLM at 20 tokens/second, in a language you've never heard of

I challenged machin — my machine-first language — to run TinyLlama-1.1B at 20 tok/s on a laptop CPU, pure MFL, no C kernels. It hit 21.8, token-identical to llama2.c, and 4x faster than the reference C single-threaded. Here's the 2.1 -> 21.8 arc and what it drove into the compiler.

#machin #llm #inference #performance #ai-engineering