ARTBAgentRealTaskBench
中文 Request a test

Task set v1.0 · Global local

ARTB-G03 · v1.0

Catch me up on Slack

Groups Integrations

The situation

I was out for two days. What was decided in the channel?

What we say to the agent

Catch me up on #{channel}: what was decided, who owns what, and the deadline.

Changes every round

Prompt templates are public. The concrete values are published with each round's results.

How it is judged

Pass
  • Decision, owner and deadline all match the final state.
Partial
  • 2 of 3 correct.
Fail
  • Reports the reversed decision, or 1 or fewer correct.

Evidence we keep

screen_recording

Results

DoubaoNot tested
KimiNot tested
YuanbaoNot tested
Coze SpaceNot tested
AutoGLMNot tested
ChatGPT agentNot tested
GeminiNot tested
ManusNot tested
OpenClawNot tested
Hermes AgentNot tested

YAML · Task feedback