mirrors/PocketFlow

Pocket Flow – 100-line minimalist LLM framework

Pocket Flow is a 100-line minimalist LLM framework

Lightweight: Just 100 lines. Zero bloat, zero dependencies, zero vendor lock-in.
Expressive: Everything you love—(Multi-)Agents, Workflow, RAG, and more.
Agentic Coding: Let AI Agents (e.g., Cursor AI) build Agents—10x productivity boost!

Get started with Pocket Flow:

To install, pip install pocketflowor just copy the source code (only 100 lines).
To learn more, check out the video tutorial and documentation
🎉 Join our Discord to connect with other developers building with Pocket Flow!
🎉 Pocket Flow now has Typescript, Java, C++, Go, Rust and PHP versions!

Why Pocket Flow?

Current LLM frameworks are bloated… You only need 100 lines for LLM Framework!

	Abstraction	App-Specific Wrappers	Vendor-Specific Wrappers	Lines	Size
LangChain	Agent, Chain	Many ^{_{(e.g., QA, Summarization)}}	Many ^{_{(e.g., OpenAI, Pinecone, etc.)}}	405K	+166MB
CrewAI	Agent, Chain	Many ^{_{(e.g., FileReadTool, SerperDevTool)}}	Many ^{_{(e.g., OpenAI, Anthropic, Pinecone, etc.)}}	18K	+173MB
SmolAgent	Agent	Some ^{_{(e.g., CodeAgent, VisitWebTool)}}	Some ^{_{(e.g., DuckDuckGo, Hugging Face, etc.)}}	8K	+198MB
LangGraph	Agent, Graph	Some ^{_{(e.g., Semantic Search)}}	Some ^{_{(e.g., PostgresStore, SqliteSaver, etc.)}}	37K	+51MB
AutoGen	Agent	Some ^{_{(e.g., Tool Agent, Chat Agent)}}	Many ^{_{[Optional] (e.g., OpenAI, Pinecone, etc.)}}	7K ^_(core-only)	+26MB ^_(core-only)
PocketFlow	Graph	None	None	100	+56KB

How does Pocket Flow work?

The 100 lines capture the core abstraction of LLM frameworks: Graph!

From there, it’s easy to implement popular design patterns like (Multi-)Agents, Workflow, RAG, etc.

✨ Below are basic tutorials:

Name	Difficulty	Description
Chat	☆☆☆ ^Dummy	A basic chat bot with conversation history
Structured Output	☆☆☆ ^Dummy	Extracting structured data from resumes by prompting
Workflow	☆☆☆ ^Dummy	A writing workflow that outlines, writes content, and applies styling
Agent	☆☆☆ ^Dummy	A research agent that can search the web and answer questions
RAG	☆☆☆ ^Dummy	A simple Retrieval-augmented Generation process
Batch	☆☆☆ ^Dummy	A batch processor that translates markdown into multiple languages
Streaming	☆☆☆ ^Dummy	A real-time LLM streaming demo with user interrupt capability
Chat Guardrail	☆☆☆ ^Dummy	A travel advisor chatbot that only processes travel-related queries
Majority Vote	☆☆☆ ^Dummy	Improve reasoning accuracy by aggregating multiple solution attempts
Map-Reduce	☆☆☆ ^Dummy	Batch resume qualification using map-reduce pattern
CLI HITL	☆☆☆ ^Dummy	A command-line joke generator with human-in-the-loop feedback
Multi-Agent	★☆☆ ^Beginner	A Taboo word game for async communication between 2 agents
Supervisor	★☆☆ ^Beginner	Research agent is getting unreliable… Let’s build a supervision process
Parallel	★☆☆ ^Beginner	A parallel execution demo that shows 3x speedup
Parallel Flow	★☆☆ ^Beginner	A parallel image processing showing 8x speedup
Thinking	★☆☆ ^Beginner	Solve complex reasoning problems through Chain-of-Thought
Memory	★☆☆ ^Beginner	A chat bot with short-term and long-term memory
Text2SQL	★☆☆ ^Beginner	Convert natural language to SQL queries with an auto-debug loop
Code Generator	★☆☆ ^Beginner	Generate test cases, implement solutions, and iteratively improve code
MCP	★☆☆ ^Beginner	Agent using Model Context Protocol for numerical operations
Agent Skills	★☆☆ ^Beginner	Route requests to reusable markdown skills and apply them in an agent flow
A2A	★☆☆ ^Beginner	Agent wrapped with A2A protocol for inter-agent communication
Streamlit FSM	★☆☆ ^Beginner	Streamlit app with finite state machine for HITL image generation
FastAPI WebSocket	★☆☆ ^Beginner	Real-time chat interface with streaming LLM responses via WebSocket
FastAPI Background	★☆☆ ^Beginner	FastAPI app with background jobs and real-time progress via SSE
Voice Chat	★☆☆ ^Beginner	An interactive voice chat application with VAD, STT, LLM, and TTS.
Judge	★☆☆ ^Beginner	LLM-as-Judge evaluator-optimizer loop for iterative content refinement
Debate	★☆☆ ^Beginner	Adversarial reasoning with two advocates and an impartial judge
Agentic RAG	★☆☆ ^Beginner	Agent-driven RAG that decides which documents to read
Self-Healing Mermaid	★☆☆ ^Beginner	Generate Mermaid diagrams with automatic error recovery
Heartbeat	★☆☆ ^Beginner	ClawBot-like always-on periodic monitoring with nested flows
Lead Generation	★★☆ ^Intermediate	Sales pipeline: scrape, enrich, score, and personalize emails
Newsletter	★★☆ ^Intermediate	AI newsletter curation: search, filter, summarize, and format
Invoice Processing	★★☆ ^Intermediate	Extract and validate invoice data from PDFs using vision
NotebookLM	★★☆ ^Intermediate	Turn documents into a podcast with two AI hosts
Deep Research	★★☆ ^Intermediate	Recursive map-reduce research with iterative refinement
Coding Agent	★★★ ^Advanced	Production coding agent with 6 tools, memory, and patch-as-subflow

👀 Want to see other tutorials for dummies? Create an issue!

How to Use Pocket Flow?

🚀 Through Agentic Coding—the fastest LLM App development paradigm-where humans design and agents code!

✨ Below are examples of more complex LLM Apps:

App Name	Difficulty	Topics	Human Design	Agent Code
Website Chatbot ^{_{Turn your website into a 24/7 customer support genius}}	★★☆ Medium	Agent RAG	Design Doc	Flow Code
Danganronpa Simulator ^{_{Forget the Turing test. Danganronpa, the ultimate AI experiment!}}	★★★ Advanced	Workflow Agent	Design Doc	Flow Code
Codebase Knowledge Builder ^{_{Life’s too short to stare at others’ code in confusion}}	★★☆ Medium	Workflow	Design Doc	Flow Code
Build Cursor with Cursor ^{_{We’ll reach the singularity soon …}}	★★★ Advanced	Agent	Design Doc	Flow Code
Ask AI Paul Graham ^{_{Ask AI Paul Graham, in case you don’t get in}}	★★☆ Medium	RAG Map Reduce TTS	Design Doc	Flow Code
Youtube Summarizer ^{_{Explain YouTube Videos to you like you’re 5}}	★☆☆ Beginner	Map Reduce	Design Doc	Flow Code
Cold Opener Generator ^{_{Instant icebreakers that turn cold leads hot}}	★☆☆ Beginner	Map Reduce Web Search	Design Doc	Flow Code

Want to learn Agentic Coding?
- Check out my YouTube for video tutorial on how some apps above are made!
- Want to build your own LLM App? Read this post! Start with this template!