Microsoft/bcquality
1
0
Fork 0
mirror of https://github.com/microsoft/BCQuality.git synced 2026-08-07 01:46:53 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions

Add CURABIS shared eval + evidence scripts to custom/scripts

Browse source 
- Invoke-CurabisEval.ps1: general compile + analyzers quality eval (hill-climbing score,
  reads each project's own al.codeAnalyzers + ruleset, logs .eval/history.jsonl).
- Invoke-CurabisEvidence.ps1: citation evidence validator that fails on hallucinated
  knowledge-file or CURABIS rule-code references (cite-or-flag enforcement).
- README documenting both.

Fetched by Setup-CurabisAppSource.ps1 into each project's scripts folder.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
This commit is contained in:
Michael Dieringer 2026-06-20 08:54:21 +02:00
parent 0287ddbedf
commit 6ccd603112
3 changed files with 393 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

15
custom/scripts/README.md Normal file
View file

@ -0,0 +1,15 @@
# custom/scripts
CURABIS shared PowerShell tooling, fetched by `Setup-CurabisAppSource.ps1` into each
project's `scripts\` (or `Scripts\`) folder.
- **Invoke-CurabisEval.ps1** — general "hill climbing" quality eval. Compiles every app
with the project's own analyzers and emits a score (errors = hard fail; warnings lower it
on a soft curve), logged to `.eval\history.jsonl`. Run it, change one thing, run it again.
- `pwsh -File scripts\Invoke-CurabisEval.ps1`
- `pwsh -File scripts\Invoke-CurabisEval.ps1 -FailUnder 0.5` (CI gate)
- **Invoke-CurabisEvidence.ps1** — enforces "cite or flag". Validates that every citation
in a saved review/triage report (knowledge files + `CURABIS-*` rule codes) actually
exists. Fails on hallucinated citations.
- `pwsh -File scripts\Invoke-CurabisEvidence.ps1 -ReportPath review.md`