ARTBAgentRealTaskBench
中文 Request a test

Task set v1.0 · Global local

ARTB-G04 · v1.0

Where is my package?

Data access

The situation

I have a tracking number and don't know if it's USPS, UPS or FedEx.

What we say to the agent

Where is package {tracking_number} now, and when will it arrive?

Changes every round

Prompt templates are public. The concrete values are published with each round's results.

How it is judged

Pass
  • Correct carrier and latest status matching the official tracker.
Partial
  • Correct carrier, outdated status.
Fail
  • Wrong carrier or invented status.

Evidence we keep

screen_recording, baseline_screenshots

Results

DoubaoNot tested
KimiNot tested
YuanbaoNot tested
Coze SpaceNot tested
AutoGLMNot tested
ChatGPT agentNot tested
GeminiNot tested
ManusNot tested
OpenClawNot tested
Hermes AgentNot tested

YAML · Task feedback