OPEN SOURCE · COMMUNITY · AGENTS

Awesome Production Agentic Systems

"A curated list of awesome open source libraries to deploy, monitor, version, scale, and secure your production agentic systems and applications." 79 libraries across 7 categories, with a summary of new additions released every month.

01 — EXPLORE THE CATEGORIES

Explore the categories

Seven sections cover the stack an agentic application needs in production: the frameworks that orchestrate agents, the observability that makes their behaviour legible, the protocols they speak to each other and to tools, the memory that carries context between runs, the security tooling that red teams them, the prompt engineering platforms behind their instructions, and the interfaces people meet them through.

CategoryCount
Agentic Frameworks36
Agent Observability5
Agent Protocols10
Memory Management7
Agent Security10
Prompt Engineering8
Agent Interfaces3

ON-DOMAIN CATALOGUE

The production agentic systems list

Open a category to browse every library, its one-line description and its canonical project link.

Agentic Frameworks36 libraries
  • ADK

    ADK is Google's Agent Development Kit for Python, a framework for building production-ready AI agents.

  • Agent Lightning

    Agent Lightning is a framework for building production-ready AI agents with Lightning AI.

  • AgentKit

    AgentKit help agent developers build multi-agent networks with deterministic routing and rich tooling via MCP.

  • Agents

    Agents allows users to build AI-driven server programs that can see, hear, and speak in realtime.

  • AgentScope

    AgentScope is a multi-agent platform designed to empower developers to build multi-agent applications with large-scale models.

  • Agentset

    Agentset is an open-source production-ready RAG platform with built-in agentic reasoning, hybrid search, and multimodal support.

  • AgentStack

    AgentStack scaffolds your agent stack.

  • AgentTorch

    AgentTorch is a framework for building and running Large Population Models (LPMs) that enables differentiable simulations over millions of autonomous agents.

  • Agno

    Agno is a full-stack framework for building multi-agent systems with memory, knowledge, and tools.

  • AIOpsLab

    AIOpsLab is a holistic framework to enable the design, development, and evaluation of autonomous AIOps agents.

  • any-agent

    any-agent is a Python library providing a single interface to different agent frameworks.

  • AutoGen

    AutoGen is an open-source framework for building AI agent systems.

  • Chidori

    Chidori is a reactive runtime that supports building robust AI agents using languages like Node.js, Python, and Rust, with a focus on reactivity and observability in agent workflows.

  • Composio

    Composio equip's your AI agents & LLMs with 100+ high-quality integrations via function calling.

  • Concordia

    Concordia is a library to facilitate construction and use of generative agent-based models to simulate interactions of agents in grounded physical, social, or digital space.

  • CrewAI

    CrewAI is a cutting-edge framework for orchestrating role-playing, autonomous AI agents.

  • deepagents

    deepagents is a Python package that implements these in a general purpose way so that you can easily create a Deep Agent for your application.

  • Eko

    Eko is a production-ready JavaScript framework that enables developers to create reliable agents, from simple commands to complex workflows.

  • EvoAgentX

    EvoAgentX is an open-source framework for building, evaluating, and evolving LLM-based agents or agentic workflows in an automated, modular, and goal-driven manner.

  • GitHub Copilot SDK

    The GitHub Copilot SDK exposes GitHub Copilot's agentic workflows through a programmable SDK for Python, TypeScript, Go, and .NET, providing production-tested agent runtime with planning, tool invocation, and file editing capabilities.

  • Hephaestus

    Hephaestus is an open-source, semi-structured agentic framework where AI agents dynamically build workflows and tasks as they discover needs, instead of adhering to predefined plans.

  • kagent

    kagent is a Kubernetes native framework for building AI agents.

  • KAOS

    KAOS is a Kubernetes-native framework for deploying and orchestrating AI agents with tool access, multi-agent coordination, and seamless LLM integration.

  • LangGraph

    LangGraph is a library for building stateful, multi-actor applications with LLMs, used to create agent and multi-agent workflows.

  • Mastra

    Mastra is a TypeScript framework for building and shipping AI agents with workflows, memory, and observability.

  • Modelscope-Agent

    Modelscope-Agent is a customizable and scalable agent framework.

  • n8n

    n8n is a workflow automation platform that gives technical teams the flexibility of code with the speed of no-code.

  • OpenAGI

    OpenAGI is used as the agent creation package to build agents for AIOS.

  • OpenAI Agents SDK

    The OpenAI Agents SDK is a lightweight yet powerful framework for building multi-agent workflows. It is provider-agnostic, supporting the OpenAI Responses and Chat Completions APIs, as well as 100+ other LLMs.

  • PocketFlow

    PocketFlow is a lightweight framework for building and orchestrating AI agent workflows.

  • PydanticAI

    PydanticAI is a Python agent framework designed to make it less painful to build production grade applications with Generative AI.

  • RunAnywhere

    RunAnywhere provides on-device AI SDKs for mobile apps (iOS, Android, React Native, Flutter) to run LLMs, speech-to-text, and text-to-speech locally without cloud dependencies.

  • smolagents

    smolagents is a library that enables you to run powerful agents in a few lines of code.

  • Swarm

    Swarm is an educational framework exploring ergonomic, lightweight multi-agent orchestration.

  • Swarms

    Swarms is an enterprise grade and production ready multi-agent collaboration framework that enables you to orchestrate many agents to work collaboratively at scale to automate real-world activities.

  • TensorZero

    TensorZero is an open-source framework for building production-grade LLM applications. It unifies an LLM gateway, observability, optimization, evaluations, and experimentation.

Agent Observability5 libraries
  • AgentLab

    AgentLab is an open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

  • AgentOps

    AgentOps helps developers build, evaluate, and monitor AI agents from prototype to production.

  • IntellAgent

    IntellAgent is an advanced multi-agent framework that transforms the evaluation and optimization of conversational agents.

  • Judgeval

    Judgeval is an open-source framework for agent behavior monitoring. Judgeval offers a toolkit to track and judge agent behavior in online and offline setups, enabling you to convert interaction data from production/test environments into improved agents.

  • Manifest

    Manifest is open-source observability for AI agents. Track costs, tokens, messages, and performance — entirely on your machine.

Agent Protocols10 libraries
  • A2A

    Agent2Agent (A2A) protocol addresses a critical challenge in the AI landscape: enabling gen AI agents, built on diverse frameworks by different companies running on separate servers, to communicate and collaborate effectively - as agents, not just as tools.

  • ACP

    The Agent Client Protocol (ACP) standardizes communication between code editors (interactive programs for viewing and editing source code) and coding agents (programs that use generative AI to autonomously modify code).

  • AgentAPI

    Control Claude Code, AmazonQ, Opencode, Goose, Aider, Gemini, GitHub Copilot, Sourcegraph Amp, Codex, Auggie, and Cursor CLI with an HTTP API.

  • agents.json

    The agents.json Specification is an open specification that formally describes contracts for API and agent interactions, built on top of the OpenAPI standard.

  • ANP

    AgentNetworkProtocol (ANP) is an open-source communication standard designed to enable seamless connectivity and collaboration between intelligent agents, positioning itself as the foundational protocol for agent-to-agent interactions in the emerging AI ecosystem.

  • AP2

    AP2 (Agent Payments Protocol) is a protocol for building secure and interoperable AI-driven payments in agentic commerce workflows.

  • arcade-mcp

    arcade-mcp tool is a secure Python framework for building, authenticating, and deploying AI agent tools (MCP servers) at scale.

  • FastMCP

    FastMCP is an open-source Python framework designed to simplify the creation and management of servers and clients that adhere to the Model Context Protocol (MCP).

  • MCP Inspector

    MCP inspector is a developer tool for testing and debugging MCP servers.

  • UCP

    UCP (Universal Commerce Protocol) is an open standard enabling interoperability between commerce entities and AI agents to facilitate seamless, agentic commerce integrations.

Memory Management7 libraries
  • Graphiti

    Graphiti is a framework for building and querying temporally-aware knowledge graphs, specifically tailored for AI agents operating in dynamic environments.

  • LangMem

    LangMem provides ways to extract meaningful details from chats, store them, and use them to improve future interactions.

  • Mem0

    Mem0 ("mem-zero") enhances AI assistants and agents with an intelligent memory layer, enabling personalized AI interactions. It remembers user preferences, adapts to individual needs, and continuously learns over time—ideal for customer support chatbots, AI assistants, and autonomous systems.

  • MemOS

    MemOS is an operating system for Large Language Models (LLMs) that enhances them with long-term memory capabilities. It allows LLMs to store, retrieve, and manage information, enabling more context-aware, consistent, and personalized interactions.

  • SimpleMem

    SimpleMem is an efficient lifelong memory system for LLM agents that enables seamless memory retention and management across conversations.

  • supermemory

    supermemory intelligently extracts information from your conversations and apps and pieces together connections between memories to deliver seamless user experience.

  • Zep

    Zep is a memory platform for AI agents that learns from user interactions and business data.

Agent Security10 libraries
  • Agentic Radar

    Agentic Radar is a security scanner for LLM agentic workflows for potential vulnerabilities.

  • Agentic Security

    Agentic Security is a vulnerability scanner for agentic workflows, protecting AI systems from jailbreaks, fuzzing, and multimodal attacks.

  • AI-Infra-Guard

    AI-Infra-Guard is an infrastructure security tool for AI systems.

  • DeepTeam

    DeepTeam is a simple-to-use, open-source LLM red teaming framework, for penetration testing and safe guarding large-language model systems.

  • Inkog

    Open-source AI agent security scanner. Detects prompt injection, infinite loops, token bombing, SQL injection via LLM, and missing human oversight across 20+ frameworks. CLI + MCP server with compliance mapping to EU AI Act, NIST AI RMF, and OWASP LLM Top 10.

  • mcp-scan

    mcp-scan is an MCP security scanning tool for local and remote MCP Servers.

  • promptfoo

    promptfoo is an LLM red teaming and evaluation framework for testing jailbreaks, prompt injection, and vulnerabilities with adversarial attacks and CI/CD integration.

  • ps-fuzz

    ps-fuzz is a tool to test and harden GenAI system prompts against security vulnerabilities and adversarial attacks.

  • Purple Llama

    Purple Llama is a set of tools to assess and improve LLM security for building responsible GenAI models.

  • Rogue

    Rogue is an AI agent evaluator and red team platform for testing agents against business policies and security vulnerabilities.

Prompt Engineering8 libraries
  • ChainForge

    ChainForge is an open-source visual programming environment for battle-testing prompts to LLMs. Compare across models, prompts, and prompt parameters using built-in visualizations.

  • DSPy

    DSPy is the framework for programming—not prompting—language models. It allows you to iterate fast on building modular AI systems and offers algorithms for optimizing prompts and weights.

  • ell

    ell is a language model programming library that treats prompts as programs. Features automatic versioning, serialization, and rich tooling for prompt engineering with Ell Studio for visualization.

  • Latitude

    Latitude is the open-source prompt engineering platform to build, evaluate, and refine prompts with AI. Features prompt management, playground testing, AI gateway, and evaluations.

  • PromptIDE

    PromptIDE by xAI is an integrated development environment for prompt engineering and interpretability research, providing transparent access to Grok-1 with rich analytics and Python SDK support.

  • PromptLayer

    PromptLayer is a platform that allows you to track, manage, and share your GPT prompt engineering by acting as middleware to log all OpenAI API requests.

  • PromptSource

    PromptSource is a toolkit for creating, sharing and using natural language prompts. Contains a growing collection of prompts (P3: Public Pool of Prompts) written in Jinja templating language.

  • Prompty

    Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for AI applications. An asset class and format for LLM prompts designed to enhance observability, understandability, and portability.

Agent Interfaces3 libraries
  • A2UI

    A2UI is a framework for building agent-to-UI interactions.

  • Chat UI

    Chat UI is an open-source web application framework that provides the frontend interface and backend infrastructure for building conversational AI chatbots, serving as the codebase behind their HuggingChat platform.

  • ComfyUI

    ComfyUI is a node-based interface and inference engine for generative AI, specifically designed to work with Stable Diffusion and other AI models. It allows users to create complex workflows for image, video, and other content generation through a visual, graph-like interface.

02 — HOW IT STAYS CURRENT

How it stays current

New libraries are added continuously and summarised in monthly releases, so watching the repository doubles as a changelog for the agent tooling ecosystem. It is the agentic sibling of Awesome Production Machine Learning, and the weekly companion to both is the Machine Learning Engineer newsletter.

The on-domain catalogue above is a committed rendition of the canonical GitHub README. The GitHub repository remains the source of truth for updates and contributions.