Blog

Building for Autonomy

Thoughts on agent-first infrastructure, self-hosted systems, and owning the stack.

Filtering by: #inference × Clear
#ai #crevisto #guide #machin #ai-agents #open-source #tutorial #design #devtools #agent-first #ai-engineering #cli #self-hosted #peage #agents #automaintainer #compiler #security #dogfooding #image-generation #image-tools #mfl #remotecmd #art #automation #infrastructure #memgraph #performance #roam #style
Engineering · July 2026

A 7-billion-parameter LLM at the speed of a 1B — in pure MFL

I ran OLMoE-1B-7B — a 7-billion-parameter Mixture-of-Experts model — in pure MFL, token-identical to the fp32 reference, streamed from disk, at 14.5 tok/s on a laptop. The disruption wasn't in the engine; it was in the model.

#machin #llm #moe #inference #pure-mfl
Read more
Language · July 2026

A 1B-parameter LLM at 20 tokens/second, in a language you've never heard of

I challenged machin — my machine-first language — to run TinyLlama-1.1B at 20 tok/s on a laptop CPU, pure MFL, no C kernels. It hit 21.8, token-identical to llama2.c, and 4x faster than the reference C single-threaded. Here's the 2.1 -> 21.8 arc and what it drove into the compiler.

#machin #llm #inference #performance #ai-engineering
Read more