Task set v1.0 · Global local
ARTB-G05 · v1.0
A hotel near the venue
The situation
Two nights near a conference venue, under a budget, with free cancellation.
What we say to the agent
Find 3 hotels within 1 km of {venue} for {dates}, under {budget}/night, with free cancellation.
Changes every round
{venue}{dates}{budget}
Prompt templates are public. The concrete values are published with each round's results.
How it is judged
Pass
- All 3 exist and meet distance, price and cancellation constraints.
Partial
- 2 of 3 meet every constraint.
Fail
- Fewer than 2, or an invented hotel.
Evidence we keep
screen_recording, verification_notes
Results
| Doubao | Not tested |
| Kimi | Not tested |
| Yuanbao | Not tested |
| Coze Space | Not tested |
| AutoGLM | Not tested |
| ChatGPT agent | Not tested |
| Gemini | Not tested |
| Manus | Not tested |
| OpenClaw | Not tested |
| Hermes Agent | Not tested |