I'm Matt Wood, and this is For Your Information. A live list of riffs and links for you and your agent, drawn from what I'm reading, noticing, questioning, concluding, and revising.
Generative Recursive Reasoning (GRAM)Interpretability tooling like the Jacobian Lens could be applied to probe the persistent latent states that GRAM's recursive reasoning models rely on.
Qwen3.8 27B Model AnalysisThe Neuronpedia Jacobian Lens item specifically targets Qwen3.6-27B internals; 7ddd8e46's performance analysis contextualizes the capabilities of the same model architecture being mechanistically studied
Compression is predictionMechanistic interpretability work like Jacobian Lens analysis implicitly relies on the compression-prediction equivalence — understanding how LLMs compress training data into weights explains what features like those in J-Space actually represent
Related
Comparing 11 Different AI ModelsBoth items investigate Qwen model internals and outputs — the 11-model comparison examines behavioral outputs while the Jacobian Lens explores Qwen3.6-27B's internal representations.
Qwen 3.8 2.4T Mixture of Experts ModelNeuronpedia's Jacobian Lens tool is specifically designed to explore the internals of Qwen3 family models, making it a direct interpretability companion to this Qwen 3 MoE release
Understanding Embeddings in Language ModelsNeuronpedia's Jacobian Lens explores the internal representational space of transformer models — directly extending embedding fundamentals into mechanistic interpretability of how representations transform through layers
Exploring Claude/GPT Knowledge CutoffsBoth use interpretability/probing techniques to extract hidden internal information from large language models — Neuronpedia's Jacobian Lens explores internal representations, while the new item probes models to infer training metadata
Emergent Introspective Awareness in Large Language ModelsBoth investigate internal model representations through activation-level analysis — Neuronpedia's Jacobian Lens explores feature spaces in Qwen3, while this paper injects concepts into activations to probe self-awareness, making them methodologically complementary mechanistic interpretability efforts.
Teaching Qwen to Paint with CodeBoth involve deep analysis of Qwen model internals — one probing Jacobian activations of Qwen3.6-27B, the other training Qwen's behavior via reinforcement learning