diff --git a/README.md b/README.md index fc5d188d..0d954a33 100644 --- a/README.md +++ b/README.md @@ -47,6 +47,12 @@ BrowserGym includes the following benchmarks by default: - [OpenApps](https://facebookresearch.github.io/OpenApps/) - [TimeWarp](https://timewarp-web.github.io) +### External related benchmarks + +The following independent benchmark is related to BrowserGym's web-agent evaluation scope but is not integrated with or supported by BrowserGym: + +* **[ClawBench](https://github.com/TIGER-AI-Lab/ClawBench)** — [paper](https://arxiv.org/abs/2604.08523) and [project page](https://claw-bench.com/). It evaluates web and computer-use agents on 283 tasks across 163 live platforms with isolated browser sessions, request-level outcome checks, and recorded action, screenshot, network, and message traces. See the project's own [runner and setup instructions](https://github.com/TIGER-AI-Lab/ClawBench#readme); task definitions are available on [Hugging Face](https://huggingface.co/datasets/NAIL-Group/ClawBench) and mirrored at [TIGER-Lab/ClawBench](https://huggingface.co/datasets/TIGER-Lab/ClawBench). + Designing new web benchmarks with BrowserGym is easy, and simply requires to inherit the [`AbstractBrowserTask`](https://github.com/ServiceNow/BrowserGym/blob/main/browsergym/core/src/browsergym/core/task.py#L7C7-L7C26) class. ## 🛠️ Setup @@ -304,4 +310,4 @@ Here is an example of how they can be used: We use the BrowserGym framework for our experiments \cite{workarena2024,chezelles2025browsergym}. ``` ## Traces -Traces from “The BrowserGym Ecosystem for Web Agent Research” paper are available in [Huggingface](https://huggingface.co/datasets/agentlabtraces/agentlabtraces/tree/main). +Traces from “The BrowserGym Ecosystem for Web Agent Research” paper are available in [Huggingface](https://huggingface.co/datasets/agentlabtraces/agentlabtraces/tree/main). \ No newline at end of file