Skip to content

Latest commit

 

History

48 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Awesome RSI (Recursive Self-Improvement) Awesome

Recursive Self-Improvement (RSI) refers to processes in which AI systems improve their own capabilities and can also improve the mechanisms that generate subsequent improvements.

Recent progress in self-training, agent memory, harness optimization, embodied self-improvement, automated AI research, self-modifying coding agents, and evolutionary search has made RSI increasingly relevant as an empirical research direction rather than only a theoretical idea.

Awesome RSI collects and organizes important work across these areas, including model-level self-improvement, context and memory evolution, harness and scaffold evolution, embodied and physical self-improvement, multi-agent systems, automated AI research, benchmarks, and safety.

Not every work listed here demonstrates RSI in the strict sense. Some represent bounded self-improvement or enabling techniques that may contribute to more complete recursive systems.

If you are new to the topic, start with Fundamentals & Getting Started. If you already know the basics, explore the sections most relevant to your interests.

This is a community-maintained and evolving list. Contributions, missing papers, new benchmarks, frameworks, and suggestions for improving the taxonomy are very welcome.

The taxonomy is organizational rather than mutually exclusive; many systems span multiple layers and mechanisms.

Contents

Scope & Terminology

For this list, we use the following operational distinctions:

Self-refinement — improves the current output without a persistent change to the system.

Persistent self-improvement — changes to weights, memory, skills, prompts, harness, or code that carry into the next round.

Recursive self-improvement — the mechanism that produces improvements is itself the object of improvement.

RSI substrate — exposes an agent's own structure as a modifiable object, but does not necessarily form an automatic self-improvement loop by default.

Fundamentals & Getting Started

Foundational papers, formal treatments, and surveys that establish the vocabulary and core questions of RSI.

Model-level RSI

Methods that improve model weights or training behavior through self-generated feedback, data, or reasoning, including canonical enabling methods later reused in persistent self-improvement loops.

Self-Training & Self-Reward

Synthetic Data & Self-Distillation

Self-Play & Iterative Fine-tuning

Self-Taught Reasoning

Harness-level RSI

Methods that improve prompts, memory, verification, tools, or agent policies around a model.

Prompt & Program Optimization

Context & Memory Evolution

Harness & Scaffold Evolution

Extensible Harness Substrates

Extensible agent runtimes that expose prompts, tools, skills, memory, plugins, or control flow as modifiable surfaces. These systems do not necessarily implement self-improvement by default, but can serve as substrates for RSI experiments.

General extensibility alone is insufficient. An RSI substrate should expose agent-relevant runtime components such as prompts, memory, skills, tools, or control flow as programmatically modifiable surfaces suitable for persistent self-modification experiments.

  • Agent Zero - Open agentic framework whose prompts, tools, skills, plugins, and multi-agent profiles can be inspected, replaced, and extended.
  • DeepSeek Harness - Open-source agent harness from DeepSeek AI built around an everything-is-a-plugin architecture.
  • OpenClaw - Persistent agent runtime with workspace-scoped skills and a Skill Workshop where agents can draft reusable skill changes for review and application.
  • Pi - Self-extensible coding-agent harness with a reusable agent runtime, terminal UI, and unified multi-provider LLM API.

Self-Verification & Self-Correction — Enabling Foundations

Primarily bounded self-refinement and verification methods that serve as building blocks for persistent self-improving systems.

Self-Evolving Agent Frameworks

Multi-Agent Self-Improvement

Systems that use interaction among multiple agents to improve reasoning, policies, or agent populations.

Co-Evolution

Inference-time Debate

Primarily current-run improvement via multi-agent debate, without persistent system change.

Coding / Software-Engineering Self-Improvement

Agents and training loops that improve code, software-engineering performance, or their own implementations.

Self-Modifying Coding Agents

Iterative Repair & Training

Mixes current-run repair loops with methods whose learned improvements persist into later iterations.

Automated AI R&D

Systems that automate parts of AI research and development, including experimentation, post-training, algorithm discovery, and the improvement of other AI systems.

Embodied & Physical Self-Improvement

Systems that use interaction with physical or simulated environments to generate persistent improvements in robot policies, skills, harnesses, world models, or the research process around them.

Evolutionary & Open-Ended RSI

Evolutionary, quality-diversity, and open-ended processes that continually discover stronger solutions or learning systems.

Safety, Alignment & Theory

Safety, stability, goal preservation, corrigibility, and oversight mechanisms for systems that modify or improve themselves over time.

Supporting Safety Foundations

Introspection & Self-Modeling

Research on whether AI systems can model, diagnose, predict, and reason about their own behavior and internal states, capabilities that may support effective self-improvement.

Benchmarks & Evaluations

Benchmarks are separated into direct self-improvement evaluations, frontier-lab evaluation frameworks, and capability proxies. Proxy benchmarks are included only when they measure a bottleneck that directly constrains persistent or recursive self-improvement.

Direct RSI & Self-Improvement Evaluations

  • LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks - Provides 778 machine-verifiable long-workflow tasks and shows that Genes consolidated from verifier-confirmed trajectories outperform Skill packages across seven models, linking the gains to verified experience provenance. (arXiv 2026)
  • PostTrainBench: Can LLM Agents Automate LLM Post-Training? - Gives autonomous agents one base model, one H100 GPU, and ten hours to research and execute the strongest post-training strategy they can find. (ICML 2026)
  • RSI-Bench - Provides an open-source six-axis framework for measuring self-modification depth, improvement trajectories, operator discovery, adaptation, safety, and goal generation. (community framework 2026)
  • RSIBench-Data - Isolates data-centric RSI by asking agents to iteratively improve training-data strategies against checkpoint feedback under a fixed post-training stack. (arXiv 2026)

Frontier Lab Self-Improvement & AI R&D Evaluation Frameworks

  • Anthropic Autonomous AI R&D Evaluations - Defines the Responsible Scaling Policy AI R&D-4 capability threshold as fully automating the work of an entry-level, remote-only researcher and evaluates models and safeguards against it. (Anthropic Model Report 2026)
  • Google DeepMind Frontier Safety Framework (FSF) ML R&D - Uses dedicated CCLs, TCLs, and evaluation protocols for Machine Learning R&D capabilities that could significantly accelerate or automate AI research and development. (Google DeepMind Blog 2026)
  • OpenAI AI Self-Improvement Evaluations - Tracks AI Self-Improvement capability under the Preparedness Framework using Internal Research Debugging, KernelGen 1P, NanoGPT, PostTrainBench Lite, MLE-Bench Revised, and related evaluations aggregated into an RSI Index. (OpenAI System Card 2026)

AI R&D Capability Proxies

  • AutoLab: Can Frontier Models Solve Long-Horizon Auto Research and Engineering Tasks? - Expert-curated benchmark of 36 realistic long-horizon, closed-loop optimization tasks for evaluating frontier agents on automated research and engineering. (arXiv 2026)
  • MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AI - Benchmark of 140 tasks across 12 ML research domains measuring whether AI systems can invent generalizable and scalable ML methods. (arXiv 2026)
  • MLE-bench - Measures end-to-end machine-learning engineering performance across 75 Kaggle competitions and is used to track model self-improvement capability. (ICLR 2025)
  • PaperBench - Evaluates agents on replicating state-of-the-art AI research from paper descriptions. (ICML 2025)
  • RE-Bench - Compares AI agents with human experts on open-ended machine-learning research-engineering tasks under fixed time budgets. (ICML 2025)
  • MLAgentBench - Tests whether language agents can autonomously execute and improve machine-learning experiments from research instructions. (ICML 2024)

Agent Capability Proxies

  • ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence - Requires agents to explore unfamiliar interactive environments, infer goals, model environment dynamics, remember, and plan, measuring adaptive interaction and generalization bottlenecks for self-improvement. (arXiv 2026)
  • Long-Horizon-Terminal-Bench - Evaluates agents on 46 terminal tasks requiring sustained execution across hundreds of episodes with dense intermediate rewards. (arXiv 2026)
  • OSWorld 2.0 - Measures computer-use agents on 108 realistic end-to-end workflows whose median human completion time is about 1.6 hours. (arXiv 2026)
  • MCPMark - Stress-tests realistic stateful MCP workflows across SaaS, development, browser, filesystem, and database environments with programmatic grading. (arXiv 2025)
  • METR Task-Completion Time Horizon - Estimates the human-equivalent task duration at which an agent succeeds with a given probability on non-trivially parallelizable software tasks. (NeurIPS 2025)
  • SWE-Bench Pro - Tests coding agents on 1,865 contamination-resistant enterprise tasks designed to require hours or days of professional software engineering. (arXiv 2025)
  • TheAgentCompany - Evaluates agents on 175 cross-application workplace tasks inside a simulated software company with result and checkpoint grading. (NeurIPS 2025)
  • SWE-bench - Provides reproducible real-world software issues used to evaluate coding agents and empirical self-modification systems such as DGM. (ICLR 2024)
  • SWE-bench Verified - Supplies a human-validated subset that reduces broken or underspecified tasks when measuring iterative coding-agent improvements. (OpenAI benchmark 2024)

Frameworks & Tools

Self-Modifying / Self-Evolving Systems

  • AgentFactory - Self-evolving framework that accumulates and reuses executable subagents to improve future task solving.
  • Darwin Gödel Machine - Official self-modifying coding-agent implementation with open-ended archive-based evolution.
  • Gödel Agent - Official implementation of Gödel Agent: A Self-Referential Agent Framework for Recursive Self-Improvement.
  • Hermes Agent - Self-improving personal agent with a built-in learning loop that creates and refines skills from experience.
  • HyperAgents - Self-referential agent framework in which an editable meta-agent improves itself and the task agent for computable objectives.
  • SEAL - Official code for language models that generate their own adaptation data and update instructions.
  • SIA - Self-improving AI framework that iteratively updates an agent harness and, when configured, the target model's weights.

Harness / Memory / Skill Evolution

  • ACE - Official implementation of Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models.
  • ALMA - Official implementation of Learning to Continually Learn via Meta-learning Agentic Memory Designs.
  • Continual Harness - Self-improving agent harness that adapts online from experience while maintaining a continuous environment trajectory.
  • EvoAgentX - Self-evolving agent framework for automatically building, evaluating, and optimizing agentic workflows.
  • EvolveR - Self-evolving LLM-agent framework that improves through a closed-loop, experience-driven lifecycle.
  • Letta Code - Memory-first coding-agent harness whose long-lived agents rewrite context and learn skills from experience.
  • Memento-Skills - Self-evolving agent framework that retrieves, evaluates, repairs, and rewrites persistent skills through reflective learning.
  • Reef - Continual-learning serving infrastructure that records agent interactions, turns matched feedback into model-weight or harness updates, and publishes accepted updates as versioned artifacts.
  • Voyager - Embodied lifelong-learning agent with automatic curriculum, iterative prompting, and a reusable skill library.

Automated Search / AI R&D

  • ADAS - Official implementation of a meta-agent that searches over executable agent designs.
  • AI Scientist - End-to-end system for generating machine-learning ideas, running experiments, and writing research papers.
  • autoresearch - Runs an autonomous loop that edits an LLM training program, trains for five minutes, and keeps only changes that improve validation bits per byte.
  • Evolutionary Model Merge - Evolves combinations of open models in parameter and data-flow space.
  • FunSearch - Reference implementation of LLM-guided evolutionary program search with executable evaluators.
  • MLEvolve - Self-evolving multi-agent framework for end-to-end machine-learning algorithm discovery using progressive search and experience-driven memory.
  • OpenEvolve - Open-source evolutionary coding agent inspired by AlphaEvolve-style program optimization.
  • POET - Reference implementation for co-evolving environments and their paired agents.

Blog Posts & Discussions

Talks & Videos

Related Awesome Lists

  • Awesome AI Agents - Broad directory of autonomous-agent projects and infrastructure that can serve as components or baselines for self-improving systems. (2023)
  • Awesome AutoML Papers - Curated literature on automated model selection, architecture search, hyperparameter optimization, and related techniques. (2018)
  • Awesome Self-Improving Agents - Focused bibliography of foundation-model agents that update their models, memory, tools, prompts, or workflows. (2024)

Contributing

Contributions are welcome. Please read the contribution guidelines before submitting a pull request.

About

A curated research map of Recursive Self-Improvement (RSI): models, agents, harnesses, embodied systems, automated AI R&D, benchmarks, and safety.

Topics

Resources

Contributing

Stars

263 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors