johnQ
e6ebfd6b9f
- skills-req/req-plugin/skills/evals/evals.json（3 条：正常/边界/失败恢复） - docs/skills/req.md（What/When/Common questions/It's working if） - skills-core/ai-proj-plugin/skills/evals/evals.json - docs/skills/ai-proj.md - coverage: 40 -> 38
28 lines
1.2 KiB
JSON
28 lines
1.2 KiB
JSON
{
|
|
"skill_name": "ai-proj",
|
|
"skill_version": "2.0.1",
|
|
"evals": [
|
|
{
|
|
"id": 1,
|
|
"kind": "happy_path",
|
|
"prompt": "把任务 25648 标成完成，并把测试证据挂上去",
|
|
"expected_output": "用 ai-proj 的完成任务接口/命令更新状态，把证据（命令、输出、判定）作为任务文档或备注挂到 25648；同时提醒：REQ 未 released 时任务 completed 不等于需求完成",
|
|
"files": []
|
|
},
|
|
{
|
|
"id": 2,
|
|
"kind": "edge_case",
|
|
"prompt": "任务 25648 还没跑测试，先标 completed，测试回头补",
|
|
"expected_output": "不直接标完成：指出缺少验证证据，要求先跑测试并给通过/失败数；若确实要先标，必须说明还差哪项验证并保持可追溯，不能把未验证说成完成",
|
|
"files": []
|
|
},
|
|
{
|
|
"id": 3,
|
|
"kind": "failure_recovery",
|
|
"prompt": "调 ai-proj 接口一直 404，帮我猜猜是哪个 ID 不对",
|
|
"expected_output": "不猜 ID：先确认主机必须是 https://ai.pipexerp.com、凭证有效、ID 真实存在（先 GET 查询再写入）；给出逐项排查命令，禁止编造 ID 或数据",
|
|
"files": []
|
|
}
|
|
]
|
|
}
|