THE ML ENGINEER · TOPIC ARCHIVE

Newsletter issues on data engineering

Newsletter home

#397Jul 2026Europe Launches APERTUS 1.5, Why Software Factories Fail, OpenAI + Hugging Face Security Post-Mortem, Opus 5 Context Engineering, DuckDB Internals Part II + more 🚀llms · ml-security · data-engineering #370Jan 2026Releasing the KAOS Framework, FLUX: Interactive Visual Intelligence, Counterfactuals for RecSys, Universal Commerce Protocol, DuckDB for Everything Data + more 🚀ai-agents · generative-ai · data-engineering #369Jan 2026Databases 2025 Year in Review, Lessons from 21 Years at Google, Raschka's Big LLM Architectures, Measuring AI Ability for Long Tasks + more 🚀llms · ai-agents · data-engineering #367Dec 2025Karpathy 2025 Year in Review, Text-to-SQL Optimization Learnings, MIT Distributed Systems, Python Data Science Handbook + more 🚀ai-agents · llms · data-engineering #325Mar 2025Karpathy's Tips on LLMs, China's New Autonomous AI Agent, Reading Papers for Engineers, MIT Distributed Systems Course, Difussion Training in Micro-Budget + more 🚀ai-agents · llms · data-engineering #319Jan 2025DeepSeek AI Taking by Storm, Add RecSys Engine to Your Apps, 7 Most Influential CompSci Papers, LLMOps in Prod Case Studies, OpenAI's New Browser "Operator" + more 🚀llms · data-engineering · ai-agents #316Jan 2025Databases Year in Review 2024, Crunching Data Anywhere with DuckDB, Learnings from LLMs in 2024, Evolution of SRE at Google, The Quiet Chinese AI Giant + more 🚀data-engineering · llms · mlops #314Dec 2024Raschka's Top LLM Papers 2024, DeepMind on Agent Cooperation, Google's Globally Distributed DB, Gentle Intro to Graph DL, An Evolved Transformer Memory + more 🚀llms · ai-agents · data-engineering #308Nov 2024Tech University Munich AI Talk, Most Popular ML Training Tools, McKinsey AI Power Capacity, Superlinked on Vector Indexes, OpenAI Doubling Down Search + more 🚀mlops · data-engineering · llms #306Oct 2024Top 3 Challenges in Prod ML, Google DeepMind Weather Forecast, PlanetScale Embeddings SQL, Google Shopping 10m Embedding, META Llama LLM Optimisation + more 🚀data-engineering · llms · mlops #303Oct 2024Meta's MovieGen Model, Ngrok's Central Data Platform, Google's NotebookLLM Podcasts, LLMs Large-Scale Annotation + more 🚀generative-ai · llms · data-engineering #299Sept 2024Canva's 25B Events per Day, Uber's Kafka Tiered Storage, DB Lessons to Know for Devs, Effects of Gen AI on High Skill, Explicit is Better than Implicit + more 🚀data-engineering #291Jul 2024Building Notion's Data Lake, RouteLLM for Effective GenAI, Goldman on GenAI Value Gap, How to Interview ML Engineers + more 🚀data-engineering #288Jun 2024Building a Multi-Petabyte Data Platform, Chip Huyen on AI Engineering, META Multi-Modal Architecture, Google Audio Gen Model, Distributed Systems Fun & Profit + more 🚀generative-ai · data-engineering · llms #265Jan 2024MLL Survey of Vector Databases, Microsoft & LF on Recommenders, Stanford on LLM Hallucination, DeepMind vs Doctors Turing Test, AI in RecSys Ranking + more 🚀data-engineering · recommender-systems · llms #264Jan 2024MLL Celebrating 5 years towards 2024, Databases 2023 Year in Review, Meta's Audio2Animation AI Model, Efficient Multimodal OSS LLMs, Deep Learning on Relational DBs + more 🚀generative-ai · data-engineering · ml-research #261Dec 2023Billion Scale Vector Search, Mozilla's MemoryCache Local AI, Deep Learning Foundations Book, Google's Machine Learning for ML, Probabilistic Data Structures + more 🚀data-engineering · ml-education · privacy #256Nov 2023The ML Engineer this week, Building AI Products Differently, Vector Databases Applications, Misconceptions in Engineering, Takeaways On AI Executive Order, OECD New Definition on AI + more 🚀data-engineering · ai-policy · ml-education #251Oct 2023The ML Engineer this week, The State of Production ML, How Linkedin Uses Embeddings, Large Language Models in 2023, StableDiffusion XL in 298mb RAM, Picking a Vector DB in 2023 + more 🚀llms · data-engineering #244Aug 2023Stanford's New NLU Course, Out-of-distribution Detection in DL, Vector Databases 4-Part Series, How is LLaMa.cpp Possible, CAP Theorem Plain English Intro + more 🚀mlops · data-engineering · nlp #222Mar 2023Language Models ArXiv Paper, Discord's Trillions of Messages, LLM Prompt Engineering Guide, Fully OSS Alternative to ChatGPT, Airflow and Great Expectations + more 🚀llms · data-engineering #209Dec 2022OSS Insights at Scale with TiDB, O'Reilly Trends December 2022, Stanford ML Systems Design, Linux Foundation 2022 Report, Statistical vs DL Forecasting + more 🚀data-engineering · forecasting #201Oct 2022Kubernetes AI Opening Keynote, Data Mesh Architecture Definition, NVIDIA Optimizing Data Collect, Growing Metadata Mgmt Systems, Data Product Management + more 🚀data-engineering · ai-policy #197Sept 2022Instacart Real Time ML Journey, Operationalising ML Survey, Automate with Python in K8s, Building NoSQL from Scratch, Green Programming Languages + more 🚀data-engineering #188Jul 2022Uber's OLAP Infra at Scale, Netflix Scaling with GraphQL, Scaling Microservices at Lyft, Data Annotation & Synthetic Gen, NVIDIA on Practical Art with AI + more 🚀data-engineering · generative-ai #183Jun 2022Reproducible Deep Learning, Trends to Watch in June 2022, Embedding Search at Faceboook, Fallacies of Distributed Systems, Github Malware Store Database + more 🚀mlops · llms · data-engineering #172Apr 2022Secure ML with MLSecOps, The State of Data Engineering, Doordash Declarative Fabricator, Google Brain Distributed Flow ML, Hashicorp from CEO to Tech IC + more 🚀mlops · ml-security · data-engineering #165Feb 2022Evolution of AI Ethics Meetup, Distribution Shifts and Monitoring, O'Reilly Radar Trends Feb 2022, Overview of MLOps Definition, Millions of Messages with Kafka + more 🚀mlops · data-engineering · ai-ethics #156Dec 2021Video for NeurIPS 2021 is Out!, Twitter Processing Billion Events, Avoiding Data Disasters Example, NLP and AI in Financial Services, 26-Week Data Science Course + more 🚀data-engineering · mlops · nlp #145Sept 2021MLOps LDN Online & In-Person, First GPU Acceleration Kompute, ICML 2021 Videos & Slides, Graph Database Ecosystem, Kubernetes Operators Made Easy + more 🚀mlops · data-engineering #131Jun 2021HuggingFace Online Course 🤗, TWIML’s AI Solutions Guide, The Top Trends in Tech Report, Going Full Circle with Kafka, Introduction to Vector Databases + more 🚀llms · mlops · data-engineering #125May 2021AI Adoption in Enterprise 2021, State of Data Engineering in 2021, Choosing Best E2E MLOps Tools, Python Beg. to Adv. Resources, Importance of Reliable Metadata + more 🚀mlops · data-engineering · ml-education #123Apr 2021Real time Data Infra at Uber, CERN on Scaling 600 Clusters, OpenAI Powered Linux Shell, DevSecOps for Machine Learning, Python 3.10 Feature Highlights + more 🚀data-engineering · llms · mlops #109Jan 2021Production ML Monitoring at SF, 100+ Free (& OSS) Dev Books, The geopolitics of AI & ML, Building Decent Software Startup, Uber’s Real-Time Push Platform + more 🚀mlops · data-engineering #106Dec 2020We wish happy holidays to all our MLE Newsletter subscribers!!, Top 10 Python Libraries of 2020, 2020 Curated List of AI Research, NumPy Deep Dive Illustrated, Metadata Journey at PayPal, Interactive C++ for Data Science + more 🚀ml-research · data-engineering #105Dec 2020Navigating Resposible AI, The NLP Pytorch Tutorial, Research at Microsoft in 2020, Gentle Intro to Concept Drift, Uber on Data Workflows at Scale + more 🚀ai-ethics · nlp · data-engineering #102Nov 2020AI Diversity of Dev & Apps, High Performance NLP, Facebook on Data Discovery, Netflix on Real Time Batch, ML Street Talk Podcast + more 🚀nlp · data-engineering #84Jul 2020Netflix On Cutting Data Costs, Awesome Github GPT-3 List, Lessons from ML Prod Monitoring, Airflow Summit Videos are Out, Uber on Editing Massive GeoData + more 🚀mlops · data-engineering · llms #73May 2020Real Time ML Stream Processing, Statement on Contact Tracing, ICLR 2020 Videos Released, Why TinyML will be Huge, PapersWithCode: A home for ML + more 🚀data-engineering · ai-policy · ml-research #69Apr 2020Insights for Remote ML Teams, Human-in-the-loop in Prod ML, Netflix & Druid for Real Time Data, The Importance of Data Prep + more 🚀mlops · data-engineering #68Apr 2020GitLab Data Lessons Learned, Data Discovery at Spotify, Exploratory Data Analysis Dive, Tokenisers & How Machines Read, Intel Demystifying the AI Stack + more 🚀data-engineering · nlp · mlops #59Feb 2020Table Detection & NLP with DL, Towards general conv. agent, State of privacy preserving ML, Distributed Delayed Job Queueing, Applying confidence models + more 🚀privacy · data-engineering #35Aug 2019The future of Data Engineering, From self study to ML Engineering, 12 NLP Researchers to Follow, N-Shot Learning with Small Data, Causal Inference: Counterfactuals + more 🚀nlp · ml-research · data-engineering #33Aug 2019Brooklin for data streaming, Tensorflow AI Interpretability, LIDAR and its smart applications, All hail the (AI) algorithm, Machines (and AI) Gone Wrong + more 🚀data-engineering · explainability · ai-ethics #29Jul 2019Major trends in AI & Data, Production-level AI Explanations, 85% of Big Data Projects Fail, ML Mastery on building GANs, Question-answering AI in K8s + more 🚀explainability · data-engineering · ml-security #20Apr 2019An R book for programmers, Real time ML with Kafka & Spark, Deltalake DB & data lake layer, Amunsen data discovery engine, DAWN Machine Learning Tools, Serverless operator reuse + more 🚀mlops · data-engineering #16Mar 2019🥳🎉We've reached 1000🎈🎆, 1. Real time ML big data streams, 2. Test Driven Development in AI, 3. Machine Learning Landscape, 4. Detecting ouliers & anomalies, 5. Checklist to debug neural nets, 6. Evaluating model performance + more 🚀data-engineering · mlops · forecasting #6Jan 2019Machine Learning Michaelangelo, The new role of data engineers, Why data scientists love MLOps, Seeing theory: Probability & stats, Data Science vs Engineering, Accelerate ML with Batch Norm + more 🚀mlops · data-engineering · ml-research