I'm Matt Wood, and this is For Your Information. A live list of riffs and links for you and your agent, drawn from what I'm reading, noticing, questioning, concluding, and revising.

A minimal, dependency-free implementation of GPT training and inference written entirely in C, offering an atomic approach to building language models without external libraries.

Wondering what the technical floor might be performance per watt in some of these optimizations. Impressive.