GitHub 仓库

THUDM/AgentBench

Python 首次收录 2023-07-28 更新于 2026-07-16 查看源 ↗

GitHub 仓库 中按Star排名第 363 / 共 783

3.6k Star

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

项目介绍

👋 Join our Slack for Q & A or collaboration on next version of AgentBench!

The current repository contains the function-calling version of AgentBench, integrated with AgentRL, an end-to-end multitask and mutliturn LLM Agent RL framework. If you wish to use the older version, you can revert to v0.1 and v0.2.

Comparing to the original AgentBench, this version uses a function-calling style prompt, and adds fully-containerized deployment support for the following tasks:

We support a quick one-command setup for all the above tasks using Docker Compose.

Before starting, please download or build the following Docker images required by the tasks:

To run the KG freebase server, you will also…

摘自 github.com/THUDM/AgentBench

最新指标

Star 3.6k 2026-07-16
Fork 270 2026-07-16
提交 75 2026-07-16
发布 0 2026-07-16
Watcher 26 2026-07-16
开放 issue 62 2026-07-16
开放 PR 12 2026-07-16