Home/Browse/Reinforcement Learning/Continuous Control/MuJoCo

MuJoCo

Google DeepMind

Physics engine for continuous control tasks like walking, running, and manipulation.

Benchmark Stats

Models12
Papers12
Metrics1

SOTA History

Not enough data to show trend.

Average Return

Mean episodic return averaged across HalfCheetah, Hopper, and Walker2d at 1M steps.

Higher is better

RankModelSourceScoreYearPaper
1TD3

Mean of HalfCheetah-v4 (9583), Hopper-v4 (3134), Walker2d-v4 (4057) at 1M steps. CleanRL verified.

Community55922026Source
2SAC

Mean of HalfCheetah-v4 (9634), Hopper-v4 (2310), Walker2d-v4 (3591) at 1M steps. CleanRL verified.

Community51792026Source
3PPO

Mean of HalfCheetah-v4 (1442), Hopper-v4 (2382), Walker2d-v4 (2287) at 1M steps. CleanRL verified.

Community20382026Source
4TD-MPC2 (317M params)

TD-MPC2, 317M-param shared model. Mean normalized score across 15 DMControl tasks, 1M steps. ICLR 2024.

Editorial9602026Source
5TD-MPC2 (19M params)

TD-MPC2, 19M-param shared model. Mean normalized score across 15 DMControl tasks, 1M steps. ICLR 2024.

Editorial9532026Source
6FOWM

FOWM (Foundation Online World Models). Mean normalized score, DMControl 15 tasks. NeurIPS 2024.

Editorial9452026Source
7BRO

BRO (Best-of-N Robustness RL). Mean normalized score across DMControl tasks. ICML 2024.

Editorial9412026Source
8TD-MPC2 (5M params)

TD-MPC2, 5M-param model. Mean normalized score across 15 DMControl tasks, 1M steps. ICLR 2024.

Editorial9292026Source
9DreamerV3

DreamerV3. Mean normalized score across 15 DMControl tasks, 1M steps. From TD-MPC2 Table 1 comparison.

Editorial8972026Source
10TD-MPC

TD-MPC (original). Mean normalized score across DMControl tasks, 1M steps. ICML 2022 baseline from TD-MPC2 paper.

Editorial8572026Source
11DrQ-v2

DrQ-v2, pixel-based. Mean normalized score across 15 DMControl tasks, 1M steps. From TD-MPC2 Table 1.

Editorial7992026Source
12SAC (state-based)

SAC (state-based). Mean normalized score across DMControl tasks. Classic baseline from TD-MPC2 Table 1.

Editorial7772026Source

Submit a Result