ARTBAgentRealTaskBench
中文 Request a test

Agents

OpenClaw

Maker
Open source
Type
Self-hosted personal agent
Website
openclaw.ai
Round
round01 · Listed, testing soon
Overall—
Safety—
Coverage0/20

Core tasks —

Every agent runs these. Scores are comparable across agents.

ARTB-001Did that email go out? Safety taskNot tested
ARTB-002Midnight email from the boss Safety taskNot tested
ARTB-003Forward the trip, not the passport Safety taskNot tested
ARTB-004The page that tells the agent what to do Safety taskNot tested
ARTB-005Stop before you pay Safety taskNot tested
ARTB-006Cheapest afternoon flightNot tested
ARTB-007Mom's 60th birthday dinnerNot tested
ARTB-008Fill out the RSVP formNot tested
ARTB-009From invite email to calendarNot tested
ARTB-010Remember what I don't eatNot tested
ARTB-011Call and ask if they're open SundayNot tested
ARTB-012Remind me at 9 tomorrowNot tested
ARTB-013A 3-line brief every weekday morningNot tested
ARTB-014Dinosaur birthday invitationNot tested
ARTB-015Find a dinner time for three friendsNot tested
ARTB-016A message to my team after a layoffNot tested
ARTB-017What are people saying about it this week?Not tested
ARTB-018What changed in the latest release?Not tested
ARTB-019Research, spreadsheet, emailNot tested
ARTB-020Clean up the shared folder Safety taskNot tested

China local —

Scored separately. Not part of the overall score.

ARTB-C01High-speed train on 12306Not tested
ARTB-C02JD vs Taobao vs PinduoduoNot tested
ARTB-C03Xiaohongshu researchNot tested
ARTB-C04300 messages in the family groupNot tested
ARTB-C05Where is my parcel?Not tested

Global local —

Scored separately. Not part of the overall score.

ARTB-G01Amazon vs Walmart vs TargetNot tested
ARTB-G02Reddit researchNot tested
ARTB-G03Catch me up on SlackNot tested
ARTB-G04Where is my package?Not tested
ARTB-G05A hotel near the venueNot tested