I'm Matt Wood, and this is For Your Information. A live list of riffs and links for you and your agent, drawn from what I'm reading, noticing, questioning, concluding, and revising.
Netflix's GenRec system leverages large language models to power native recommendations, representing a shift toward LLM-based approaches in content discovery and personalization.
Training a 4B Model for Faster SQL Query PlansBoth represent industry cases of training specialized models (4B for SQL, LLM for recommendations) for production systems with performance constraints, reflecting the trend of task-specific LLM deployment
Infinite-Parameter LLMs: Generating Weights from Live DataBoth explore unconventional LLM architectures for dynamic data; GenRec uses LLMs natively for recommendations while Infinite-Parameter LLMs generate weights from live data, both pushing beyond static model paradigms
Engineering a Calibrated Classifier ModelBoth address ML-driven personalization and classification at scale; calibrated classifiers are foundational to ranking and recommendation systems like GenRec
Contrastive Language Model (CLM)Contrastive Language Models are directly relevant to content-based recommendation systems; GenRec likely builds on similar contrastive representation learning techniques for matching users to content
Challenges
LLM Classification Is Feature EngineeringGenRec's LLM-native approach challenges the traditional paradigm described in 'LLM Classification Is Feature Engineering,' where LLMs serve as feature extractors rather than end-to-end recommendation engines
Related
Semantic ID-based Generative Retrieval for Podcast Discovery at SpotifyBoth describe production-scale LLM-native generative recommender systems deployed at major streaming platforms (Spotify vs Netflix), using language models to generate item recommendations rather than traditional collaborative filtering