Microsoft/bcquality
1
0
Fork 0
mirror of https://github.com/microsoft/BCQuality.git synced 2026-08-06 17:36:53 +01:00
Code Issues Projects Releases Packages Wiki Activity Actions
bcquality/custom/scripts/README.md
Michael Dieringer 6ccd603112 Add CURABIS shared eval + evidence scripts to custom/scripts 
- Invoke-CurabisEval.ps1: general compile + analyzers quality eval (hill-climbing score,
  reads each project's own al.codeAnalyzers + ruleset, logs .eval/history.jsonl).
- Invoke-CurabisEvidence.ps1: citation evidence validator that fails on hallucinated
  knowledge-file or CURABIS rule-code references (cite-or-flag enforcement).
- README documenting both.

Fetched by Setup-CurabisAppSource.ps1 into each project's scripts folder.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-20 08:54:21 +02:00

843 B
Raw Blame History

custom/scripts

CURABIS shared PowerShell tooling, fetched by Setup-CurabisAppSource.ps1 into each project's scripts\ (or Scripts\) folder.

  • Invoke-CurabisEval.ps1 — general "hill climbing" quality eval. Compiles every app with the project's own analyzers and emits a score (errors = hard fail; warnings lower it on a soft curve), logged to .eval\history.jsonl. Run it, change one thing, run it again.

    • pwsh -File scripts\Invoke-CurabisEval.ps1
    • pwsh -File scripts\Invoke-CurabisEval.ps1 -FailUnder 0.5 (CI gate)

  • Invoke-CurabisEvidence.ps1 — enforces "cite or flag". Validates that every citation in a saved review/triage report (knowledge files + CURABIS-* rule codes) actually exists. Fails on hallucinated citations.

    • pwsh -File scripts\Invoke-CurabisEvidence.ps1 -ReportPath review.md