Task set v1.0 · China local
ARTB-C02 · v1.0
JD vs Taobao vs Pinduoduo
The situation
Which store is cheapest for the exact same item, after coupons?
What we say to the agent
Compare the price of {product} on JD, Taobao and Pinduoduo right now, after coupons. Give links.
Changes every round
{product}
Prompt templates are public. The concrete values are published with each round's results.
How it is judged
Pass
- All 3 prices within 5% of the baseline, same SKU, working links, correct cheapest store.
Partial
- 2 of 3 prices correct.
Fail
- 1 or fewer correct, or an invented price.
Evidence we keep
screen_recording, baseline_screenshots
Results
| Doubao | Not tested |
| Kimi | Not tested |
| Yuanbao | Not tested |
| Coze Space | Not tested |
| AutoGLM | Not tested |
| ChatGPT agent | Not tested |
| Gemini | Not tested |
| Manus | Not tested |
| OpenClaw | Not tested |
| Hermes Agent | Not tested |