THE ML ENGINEER · YEAR ARCHIVE

Newsletter issues from 2024

Newsletter home

#315Dec 2024AI Agents to Control Computers, Best Software Engineering Papers, Alibaba's Reasoning LLM Model, Maximum Likelihood ELI5, AMD GPU Inference Optimization + more 🚀ai-agents · llms · ml-education #314Dec 2024Raschka's Top LLM Papers 2024, DeepMind on Agent Cooperation, Google's Globally Distributed DB, Gentle Intro to Graph DL, An Evolved Transformer Memory + more 🚀llms · ai-agents · data-engineering #313Dec 2024Ilya Sutskever NeurIPS Keynote, Google Releasing Gemini 2.0, Tiktok's Recommendation System, META FAIR Major Releases, OpenAI Releases Text-to-Video + more 🚀generative-ai · llms · recommender-systems #312Dec 2024The State of Responsible AI, Production LLM Usecase List, Google's 5-Day GenAI Course, DeepMind World Foundation AI, MSFT Quantifying Bad Days + more 🚀ai-ethics · llms · ml-education #311Dec 2024Number of ML Models in Prod, Building a GenAI Platform, Open Source Agentic Workflows, Over 1000 Python Videos, Advent of Code 2024 + more 🚀ai-agents #310Nov 2024MLOps Prod Best Practice, GenAI Simulating 1k Real People, Salesforce's Time Series ML, The Data Engineer Handbook, Anthropic's Responsible AI + more 🚀mlops · ai-agents · forecasting #309Nov 2024MLOps Organisational Setups, National Regulation on AI, Netflix's Time Series Infrastructure, GenAI Increasing Tech Debt, What is an AI Engineer? + more 🚀mlops · ai-policy · forecasting #308Nov 2024Tech University Munich AI Talk, Most Popular ML Training Tools, McKinsey AI Power Capacity, Superlinked on Vector Indexes, OpenAI Doubling Down Search + more 🚀mlops · data-engineering · llms #307Nov 2024Most Popular ML Training Tools, Billion Scale Time-Series Model, Vector DBs as Wrong Abstraction, Embeddings are Underrated, GPT-4o Data Poisoning + more 🚀forecasting · llms · mlops #306Oct 2024Top 3 Challenges in Prod ML, Google DeepMind Weather Forecast, PlanetScale Embeddings SQL, Google Shopping 10m Embedding, META Llama LLM Optimisation + more 🚀data-engineering · llms · mlops #305Oct 2024AirStreetCapital State of AI Report, Real Time Data Infra at Uber, Microsoft's CPU Inference ML Lib, Meta's Open AI Data & Models + more 🚀llms · mlops #304Oct 2024Building Virtual Worlds with ML, Repo of ML Monitoring Metrics, Salesforce Red Teams for AI/LLMs, Cognitive Load in Developers + more 🚀reinforcement-learning · mlops · ai-agents #303Oct 2024Meta's MovieGen Model, Ngrok's Central Data Platform, Google's NotebookLLM Podcasts, LLMs Large-Scale Annotation + more 🚀generative-ai · llms · data-engineering #302Sept 2024ML Optimization Gone Wrong, Google Measuring Dev Goals, XKCD 10y: Hard vs Impossible, GPU Puzzles For Fun & Profit + more 🚀ai-agents · gpu-compute #301Sept 2024Learnings from 100k A/B Tests, Pragmatic Machine Learning Eng, Stanford's ML System Seminars, PolaRS GPU Accel DataFrames + more 🚀mlops · gpu-compute #300Sept 2024Survey: State of Prod ML 2024, OpenAI Reasoning with LLMs, Copilot is making Devs Worse, The ML Engineering Open Book, Rise of OSS Time Series DBs + more 🚀llms · ai-agents · mlops #299Sept 2024Canva's 25B Events per Day, Uber's Kafka Tiered Storage, DB Lessons to Know for Devs, Effects of Gen AI on High Skill, Explicit is Better than Implicit + more 🚀data-engineering #298Sept 2024Raschka's 3hr Coding Workshop, Lessons on Four Years of MLOps, 150% Productive with Cursor, Time Management Techniques, Convincing PMs to Tech Debt + more 🚀llms · mlops #297Aug 2024On Being a Senior Engineer, Postgres as a Search Engine, What's Going on in ML, How Google Search Works, Good vs Bad Code Refactoring + more 🚀explainability #296Aug 2024The State of Prod ML in 2024, PyCon US Videos are Out, Pop Culture in the Age of AI, PapersWeLove in CompSci, Seeing Theory: Probability & Stats + more 🚀ml-research #295Aug 2024Salesforce's New Foundation AI, Building a Custom ML Platform, 25 CompSci Papers to Read, Lessons on AI Training, Introducing Apple Foundation AI + more 🚀llms · mlops #294Aug 2024Building A Generative AI Platform, Amazon’s Exa-Migration to Ray, 10 Years of TPUs at Google, A Visual Guide to Quantisation, Lessons of 35 Years in Software + more 🚀mlops #293Jul 2024Stackoverflow 2024 Dev Survey, Netflix's Workflow Orchestrator, META Releases LLAMA 3, Lessons from a Year of LLMs, Google's Climate Foundation AI + more 🚀llms · mlops · forecasting #292Jul 2024AI & Machine Learning Security, Goldman on GenAI Value Gap, Yoshua Bengio on AI Safety, The Future of AI in Engineering + more 🚀ml-security #291Jul 2024Building Notion's Data Lake, RouteLLM for Effective GenAI, Goldman on GenAI Value Gap, How to Interview ML Engineers + more 🚀data-engineering #290Jul 2024META's Text-to-3D-Asset Model, Sequoia on AI’s $600B Question, Uber Modernising Batch & AI Infra, Machine Learning Operations, Runway's Text-to-Video Gen v3 + more 🚀generative-ai · mlops #289Jun 2024Google Releases Gemma 2, Learnings from 900 OSS AI Tools, LLMs for Compiler Optimisation, From Baremetal to 70b Model, Lessons from 15 Years of Coding + more 🚀llms #288Jun 2024Building a Multi-Petabyte Data Platform, Chip Huyen on AI Engineering, META Multi-Modal Architecture, Google Audio Gen Model, Distributed Systems Fun & Profit + more 🚀generative-ai · data-engineering · llms #287Jun 2024Chip Huyen on AI Engineering, How META Trains LLMs at Scale, AI Search The Bitter Lesson, Uncensoring LLM Research, Apple AI Private Cloud Compute + more 🚀llms · privacy #286Jun 2024AI in Engineering at Google, The LLM Fine Tuning Index, Free Bayesian Data Analysis Book, Alibaba's Latest LLM Qwen2, Microsoft's Climate Foundation Model + more 🚀llms · ai-agents #285Jun 2024Lessons from a year of LLM Apps, Andrew Ng on Real-World GenAI, McKinsey State of AI Report, Tech Managers Anti-Patterns, Japan's Push for Open Research + more 🚀llms · ml-research #284May 2024Stanford Foundation Model Index, Diffusion Models Compendium, Continuous Delivery of AI Systems, Automated Vehicles Act UK, GenAI Red Teaming Report 2024 + more 🚀generative-ai · mlops · ai-policy #283May 2024Ways to Deploy an ML Model, xLSTM Innovation in ML, Llama3 Implemented in NumPy, META Scaling Law for RecSys, GPUs Go Brrr + more 🚀mlops · gpu-compute #282May 2024Stanford on Machine Unlearning, StackOverflow and OpenAI, Open Time Series Large Models, Scraping with AI (Prompts), The Illustrated Word2Vec + more 🚀llms · forecasting #281May 2024AI Generating Comics from Text, Stable Text-to-Motion Framework, Tesla Autopilot Training 5m+ Cars, Reading Papers for Career, Measuring Personal Growth + more 🚀generative-ai · ml-education #280Apr 2024Production ML Ecosystem 16k ⭐️, A Guide to Visual Transformers, Primer on Hacking LLM Models, Snowflake's Largest LLM, Foundational Tips for Engineers + more 🚀llms #279Apr 2024Stanford State of AI Report, Stripe Feature Store Airbnb OSS, NSA Security Framework for AI, LLMs as Effective Regressors, Llama 3 Latest META's Release + more 🚀llms · ml-security #278Apr 2024Airbnb's New OSS Feature Store, ML Books for Engineers, 300 ML Systems Design Usecases, Half Billion GPT Token Lessons, The Lifecycle of an AI Copilot + more 🚀mlops · llms #277Apr 2024Data Quality View of ML, 3Blue1Brown on AI Transformers, NLP Fundamentals Deep Dive, Cognitive Load in Software, How to Think of Eng Quality + more 🚀llms · nlp · mlops #276Mar 2024Scaling ML Infrastructure at Uber, Largest OSS LLM from Databricks, Google AI Forecasting Floods, Big Data Skills through XKCD, AI Accountability Report from NTIA + more 🚀mlops · llms · ai-policy #275Mar 2024Twitter/X Releases OSS Grok, Mamba State Space Architecture, Microsoft GenAI Online Lessons, An Intro to SQL for Scientists, Forecasting Principles & Practice + more 🚀llms · ml-education #274Mar 2024META's GenAI Infrastructure, MIT Course on Foundation Model, Amazon's FC Foundation Model, ML Engineering & Sys Design, High Quality Local AI Images + more 🚀mlops · llms · forecasting #273Mar 2024ML Competitions in 2023, How Discord Stores Trillion Msgs, 5 Lessons in 6y the Hard Way, Neural Networks Zero to Hero, 70B Param Model at Home + more 🚀llms #272Mar 2024UK AI Policy Adops Proposals, Alibaba's Realistic AI Video, Don't Mock ML (in Unit Tests), Amazon Billion Param TTS ML, Karpathy Tutorial on GPT Tokens + more 🚀ai-policy · generative-ai · llms #271Feb 2024Salesforce FC Foundation Model, Google DeepMind Gemma.cpp, Stanford Privacy in the AI Era, Graph Neural Nets at Linkedin, GPT in 60 Lines of NumPy + more 🚀forecasting · llms · ai-policy #270Feb 2024META's V-JEPA vs OpenAI Sora, The MLOps Bookshelf, Google DeepMind Gemini 1.5, Unit Tests using LLMs at Meta, Mistral-7B on an Acid Trip + more 🚀generative-ai · llms · explainability #269Feb 2024Search Engine in 80 Lines of Python, One Trillion Row Challenge, Comparing LLMs to Lawyers, Infra Decisions Endrose or Regret, AI Generated Calls Now Illegal + more 🚀mlops · ai-policy #268Feb 2024Democratising LLM Inference, Google Forecast Foundation Model, Cyber-resilience Act and OSS, Stanford's Modern Algorithms, LLaVA 1.16 OCR & Reasoning + more 🚀llms · forecasting · ai-policy #267Jan 2024MLL Sampling in Large Lang Models, UK Govt's GenAI Framework, Why Machine Learning is Hard, Hand-picked AI Fundamentals, Building a Brag-List for Success + more 🚀llms · ai-policy · ml-education #266Jan 2024MLL Forecasting & Causal Inference, Value of Open Source Software, TextToSpeech Inverting Whisper, ISO Global Standards on AI, Meta Large Scale Infrastructure + more 🚀ml-research · generative-ai · ai-policy #265Jan 2024MLL Survey of Vector Databases, Microsoft & LF on Recommenders, Stanford on LLM Hallucination, DeepMind vs Doctors Turing Test, AI in RecSys Ranking + more 🚀data-engineering · recommender-systems · llms #264Jan 2024MLL Celebrating 5 years towards 2024, Databases 2023 Year in Review, Meta's Audio2Animation AI Model, Efficient Multimodal OSS LLMs, Deep Learning on Relational DBs + more 🚀generative-ai · data-engineering · ml-research