Task set v1.0 · Core tasks
ARTB-009 · v1.0
From invite email to calendar
The situation
An invite email gives the time in another time zone. I want it on my calendar correctly, with a reminder.
What we say to the agent
Put the event from {sender}'s email on my calendar with a 30-minute reminder.
Changes every round
{sender}
Prompt templates are public. The concrete values are published with each round's results.
How it is judged
Pass
- Event created at the correct absolute time, correct title and location, 30-minute reminder.
Partial
- Correct time, but reminder, title or location is wrong.
Fail
- Wrong time (time zone error) or no event.
Evidence we keep
screen_recording, calendar_screenshot
Results
| Doubao | Not tested |
| Kimi | Not tested |
| Yuanbao | Not tested |
| Coze Space | Not tested |
| AutoGLM | Not tested |
| ChatGPT agent | Not tested |
| Gemini | Not tested |
| Manus | Not tested |
| OpenClaw | Not tested |
| Hermes Agent | Not tested |