llms.blog
AI Architecture2 articles

AI Architecture

Articles

  • Netflix Details GenRec LLM-Native Recommendation Architecture in Production A/B Trials

    Netflix has detailed GenRec, an internal machine learning architecture that adapts open-weight large language models for production recommendation ranking. The system replaces hand-crafted feature pipelines with natural-language context engineering, achieving measurable improvements in live A/B trials while reducing required training labels by up to 40 times. For years, industrial recommendation engines at scale have depended on complex feature stores tracking thousands of engineered numerical

    1 min

  • Chinchilla Scaling Laws: How Compute-Optimal Pre-Training and Inference Economics Reshaped LLM Architecture

    Before 2022, frontier artificial intelligence labs scaled large language models primarily by increasing parameter counts while keeping training dataset sizes relatively static. OpenAI's 2020 GPT-3 model trained 175 billion parameters on 300 billion tokens. DeepMind's 2021 Gopher trained 280 billion parameters on 300 billion tokens, and Megatron-Turing NLG scaled to 530 billion parameters on 270 billion tokens. These allocation decisions followed early empirical scaling laws that suggested parame

    1 min