56 lines
1.7 KiB
Markdown
56 lines
1.7 KiB
Markdown
|
# T871 — precision and cost evaluation gate
|
|||
|
|
|
|||
|
|
> Status: `done`（2026-08-11）
|
|||
|
|
> Milestone: `M7`
|
|||
|
|
> Est. change: `~170 lines`
|
|||
|
|
|
|||
|
|
## Goal
|
|||
|
|
|
|||
|
|
完成後可重跑 evaluation，證明 recommended 前十 precision_at_10≥0.8、high 違規為 0，並記錄 AI ratio 與每筆有效商機成本 baseline。
|
|||
|
|
|
|||
|
|
## Depends on
|
|||
|
|
|
|||
|
|
- T850、T851、T860、T870
|
|||
|
|
|
|||
|
|
## Inputs
|
|||
|
|
|
|||
|
|
- `apps/backend/internal/module/radar/usecase/accuracy_fixture_test.go`
|
|||
|
|
- `apps/backend/internal/module/radar/usecase/product_accuracy_test.go`（若存在）
|
|||
|
|
- Plan §6.5、Spec 驗收 #23
|
|||
|
|
|
|||
|
|
## Outputs
|
|||
|
|
|
|||
|
|
### 程式變更（預期路徑）
|
|||
|
|
|
|||
|
|
| 路徑 | 動作 | 說明 |
|
|||
|
|
|------|------|------|
|
|||
|
|
| `apps/backend/internal/module/radar/usecase/opportunity_accuracy_test.go` | add/edit | precision、high hard gate、baseline comparison |
|
|||
|
|
| `docs/product/opportunity-inbox/ACCURACY.md` | edit | 結果、誤判類型、成本 baseline |
|
|||
|
|
| `docs/product/brand-product-radar/ACCURACY.md` | edit/ref | 與既有 T773 共用輸出 |
|
|||
|
|
|
|||
|
|
### 行為變更
|
|||
|
|
|
|||
|
|
- 未達 8/10 不得標示完成；回到召回／前處理／排序 task 調校。
|
|||
|
|
|
|||
|
|
### API / 契約（若有）
|
|||
|
|
|
|||
|
|
- evaluation 輸出 precision_at_10、high_without_required_evidence、provider_or_announcement_in_high、ai_judged_ratio、credits_per_valid_opportunity。
|
|||
|
|
|
|||
|
|
## Out of scope
|
|||
|
|
|
|||
|
|
- 不自動調整權重、不修改產品資料、不新增 P1 個人化排序。
|
|||
|
|
|
|||
|
|
## Acceptance
|
|||
|
|
|
|||
|
|
- [x] `precision_at_10 >= 0.8`、兩種 high 違規皆為 0。
|
|||
|
|
- [x] 成本只建立 baseline，不捏造未驗證 P0 目標。
|
|||
|
|
- [ ] 指令：
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
cd apps/backend && go test ./internal/module/radar/usecase -run 'OpportunityAccuracy|Precision' -count=1
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## Notes
|
|||
|
|
|
|||
|
|
報告要能區分「沒找到」與「找到但被前處理／預算延後」。
|