camel-ai/crab
#742 of 783 by Stars among GitHub repos
424 Stars
🦀️ CRAB: Cross-environment Agent Benchmark for Multimodal Language Model Agents. https://crab.camel-ai.org/
About
CRAB is a framework for building LLM agent benchmark environments in a Python-centric way.
All datasets and experiment code are in crab-benchmark-v0 directory. Please carefully read the benchmark tutorial before using our benchmark.
Please cite our paper if you use anything related in your work:
Join us (Discord or WeChat) in pushing the boundaries of finding the scaling laws of agents.
[slack-url]: [slack-image]: [discord-url]: [discord-image]: [wechat-url]: [wechat-image]: [twitter-url]: [twitter-image]: [arxiv-image]: [arxiv-url]:
Excerpted from github.com/camel-ai/crab
Latest metrics
| Stars | 424 | 2026-07-16 |
|---|---|---|
| Forks | 61 | 2026-07-16 |
| Commits | 80 | 2026-07-16 |
| Releases | 3 | 2026-07-16 |
| Watchers | 7 | 2026-07-16 |
| Open issues | 34 | 2026-07-16 |
| Open PRs | 3 | 2026-07-16 |