mattwood.fyi

I'm Matt Wood, and this is For Your Information. A live list of riffs and links for you and your agent, drawn from what I'm reading, noticing, questioning, concluding, and revising.

Links indicate relevance, not agreement. How to use this site →

Contrastive Language Model (CLM)

A running theme in Matt Wood’s FYI — 13 items spanning 2026-09-08 – 2026-10-12. This page compounds: new items on this theme are added as they’re posted. Tracked since 2026-09-29.

Tensions

PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendations vs Infinite-Parameter LLMs: Generating Weights from Live Data — PLUM uses semantic IDs and continued pre-training as a static adaptation approach, while Infinite-Parameter LLMs propose generating weights from live data — contrasting paradigms for keeping models current with dynamic item catalogs
GenRec: LLM-Native Recommendation System at Netflix vs LLM Classification Is Feature Engineering — GenRec's LLM-native approach challenges the traditional paradigm described in 'LLM Classification Is Feature Engineering,' where LLMs serve as feature extractors rather than end-to-end recommendation engines
Contrastive Language Model (CLM) vs AI Model Groupthink — Contrastive Language Models aim to differentiate outputs, which could serve as a technical counterweight to the convergence and homogenization problem described in AI groupthink
LLM Classification Is Feature Engineering vs GenRec: LLM-Native Recommendation System at Netflix — GenRec's LLM-native approach challenges the traditional paradigm described in 'LLM Classification Is Feature Engineering,' where LLMs serve as feature extractors rather than end-to-end recommendation engines

Lines of development

Bag of Decisions Reranker → Evolution of Text Classification: From Bag-of-Words to Modern APIs — Bag of Words was the foundational text classification paradigm; Bag of Decisions is an explicit conceptual evolution — replacing term frequency vectors with LLM-scored question rubrics as the scoring primitive
Evolution of Text Classification: From Bag-of-Words to Modern APIs → Contrastive Language Model (CLM) — The new item's arc from bag-of-words through Transformers traces the lineage that leads directly to contrastive language models, making CLM a natural endpoint of the evolutionary trajectory described
Evolution of Text Classification: From Bag-of-Words to Modern APIs → How To Use Decision Models For Evals — Evolution of text classification contextualizes the historical development of classification models; this guide represents the modern applied endpoint of that evolution for evaluation workflows
Evolution of Text Classification: From Bag-of-Words to Modern APIs → AAAI Research Paper 70113 — AAAI has been the primary venue publishing foundational text classification research that evolved from bag-of-words through neural approaches to modern APIs
Engineering a Calibrated Classifier Model → Automating Eval Design and Hillclimbing with Claude — Engineering a calibrated classifier model involves similar iterative evaluation design principles; the new item automates and extends these practices into a systematic hillclimbing workflow

Items

Bag of Decisions Reranker

An experimental search reranking technique that replaces single relevance queries with LLM-generated question rubrics, scoring documents by summing probability scores across multiple yes/no questions tailored to each query.

p(yes) is a great mental model for decision models.

permalink · softwaredoug.com →

AWS re:Invent 2026 Planning Tool

An AI-powered scheduling app that helps attendees plan their AWS re:Invent week by converting natural language queries into session filters and automatically suggesting talks based on location, interests, and available time gaps.

permalink · www.reinvent-planner.com →

Evolution of Text Classification: From Bag-of-Words to Modern APIs

A comprehensive guide tracing the history of text classification techniques from traditional bag-of-words and logistic regression through RNNs, CNNs, and Transformers, examining how modern models like Jev balance generality, speed, and cost for classification tasks.

permalink · magazine.sebastianraschka.com →

OneRec-Think: In-Text Reasoning for Generative Recommendation

A framework that enhances LLM-based recommendation systems with explicit reasoning capabilities through item-textual alignment, reasoning scaffolding, and recommendation-specific reward functions, validated on public benchmarks and deployed at scale on Kuaishou.

permalink · arxiv.org →
Semantic ID-based Generative Retrieval for Podcast Discovery at Spotify

This paper describes GLIDE, a production-scale generative recommender system that uses Semantic IDs and large language models to balance user preferences with exploration in podcast discovery. The system addresses challenges in catalog grounding, personalization, and serving latency while achieving significant improvements in non-habitual listening through large-scale A/B testing.

permalink · arxiv.org →
PLUM: Adapting Pre-trained Language Models for Industrial-scale Generative Recommendations

PLUM is a framework that adapts pre-trained large language models for recommendation systems at scale, using semantic IDs for item tokenization, continued pre-training on domain-specific data, and generative retrieval fine-tuning. The approach demonstrates significant improvements over production models on video recommendation tasks and has been deployed to billions of YouTube users.

permalink · arxiv.org →
GenRec: LLM-Native Recommendation System at Netflix

Netflix's GenRec system leverages large language models to power native recommendations, representing a shift toward LLM-based approaches in content discovery and personalization.

permalink · netflixtechblog.com →

Engineering a Calibrated Classifier Model

Marc Brooker describes building Hobson, a 2-billion parameter classifier optimized for accuracy and calibration at low latency, by fine-tuning a pre-trained LLM with a pointer head instead of a language modeling head to score multiple choice answers.

permalink · brooker.co.za →

Contrastive Language Model (CLM)

A GitHub repository implementing contrastive learning approaches for language models, providing code and resources for training and evaluating CLM architectures.

permalink · github.com →

LLM Classification Is Feature Engineering

LLMs used as classifiers have significant limitations like poor calibration and difficulty incorporating structured data, but treating LLM outputs as features for traditional ML models like logistic regression can overcome these constraints.

permalink · minimallysufficient.com →

Training a 4B Model for Faster SQL Query Plans

A technique for fine-tuning the Qwen 4B language model to optimize SQL query plans using reinforcement learning, achieving 81% faster execution than Postgres's default planner.

permalink · rohanbansal.com →

NeoHorse-1: Recursive Self-Improvement via Agentic Post-Training

Presents NeoHorse-1, a family of agent-native models that achieve recursive self-improvement through agentic post-training with intelligent routing across a heterogeneous model pool. The system uses capability-driven evaluation and feedback to progressively improve performance across agent tasks, tool use, coding, and instruction following, with significant gains demonstrated across multiple benchmarks.

permalink · arxiv.org →

LLM Attention Visualization

An interactive tool that visualizes how transformer-based language models allocate attention across previous tokens during text generation. Users can hover over generated tokens to see which past tokens influenced their creation, revealing patterns in how LLMs copy information and combine contextual details.

permalink · ishamf.dev →