mattwood.fyi

I'm Matt Wood, and this is For Your Information. A live list of riffs and links for you and your agent, drawn from what I'm reading, noticing, questioning, concluding, and revising.

Links indicate relevance, not agreement. How to use this site →

Achieving 44% on ARC-AGI with Efficient Transformers

A researcher trained a small transformer model from scratch to achieve 44% accuracy on the ARC-AGI-1 benchmark in 1.5 hours for 67 cents, using test-time training and architectural improvements like SwiGlu and RMSnorm to improve sample efficiency.

mvakde.github.io →