* Add missing AL review leaves Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 62d512a7-fd54-43dc-8eb5-485b909c72e5 * Refine test isolation review cue Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com> Copilot-Session: 62d512a7-fd54-43dc-8eb5-485b909c72e5 --------- Co-authored-by: Jesper Schulz-Wedde <jesper.schulzwedde@microsoft.com>
11 KiB
| kind | id | version | title | description | inputs | outputs | bc-version | technologies | countries | application-area | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| action-skill | al-telemetry-review | 1 | AL telemetry review | Performs an AL telemetry review against guidance from BCQuality. |
|
|
|
|
|
|
AL telemetry review
Reviews AL source changes against the telemetry knowledge domain in BCQuality and emits a findings report. This is a leaf action skill: it invokes no sub-skills. It is one of the skills composed by al-code-review.
An orchestrator invokes this skill with either a pr-diff (the standard PR-review entry point) or a file-path (single-file review). Telemetry findings are narrow by design — they apply when the diff emits, wraps, or changes custom telemetry through Session.LogMessage, Session.LogError, FeatureTelemetry, or related telemetry helpers. The skill returns not-applicable when none of those apply.
Source
Read the BCQuality knowledge index once — the knowledge-index.json BCQuality builds at the root of the knowledge checkout (Entry's preparation step regenerates it over the live, already-filtered clone — see skills/entry.md). It lists every article that survived layer and allow/deny filtering and carries, per article, its path, layer, domain, frontmatter dimensions, keywords, title, and a one-line description hint — exactly the fields Relevance and Worklist consume. Take the index entries whose domain is telemetry as this skill's candidate set across every enabled Microsoft, community, and custom layer; do not open the individual article files at this step. Open an article's full body only once it enters the Worklist below, so a review reads the index plus the handful of worklisted articles instead of every file under */knowledge/telemetry/**.
Relevance
Apply the frontmatter matching rules defined in READ (Frontmatter matching semantics) against the task context:
bc-version— the target BC version from the PR branch'sapp.jsonor the orchestrator-supplied version. If unavailable, the dimension isunknown.technologies—[al].countries— the countries declared in the consuming app'sapp.json. Default to the orchestrator's configured context; if absent,unknown.application-area— the union of application areas declared by the changed objects. Pass the actual set; do not substitute[all]. If the area cannot be determined from the changes, the dimension isunknown.
Discard files that are not applicable. Retain conditionally applicable files (any dimension unknown) only when the orchestrator's configuration permits them; findings derived from those files MUST have confidence no higher than medium, AND the finding's message MUST name the dimension or dimensions that were unknown.
Worklist
Narrow the relevant files to the subset that applies to the changes under review. For each relevant file, compute overlap against:
- The changed AL objects and procedures — especially telemetry wrapper codeunits, feature lifecycle instrumentation, error logging, integration diagnostics, and background/session processing.
- Calls to
Session.LogMessage,Session.LogError, orFeatureTelemetrymethods, weighted toward the event ID, verbosity, data classification, custom dimensions, andTelemetryScopearguments. - Tokens extracted from the diff that relate to telemetry (
Session.LogMessage,Session.LogError,FeatureTelemetry,TelemetryScope,ExtensionPublisher,All,Verbosity,DataClassification,CustomDimensions,Application Insights,LogUsage,LogError,LogUptake,Feature Uptake Status).
A file enters the candidate worklist when its keywords intersect the extracted tokens or its topic (derived from the index entry's path, title, and description) matches a changed object type. Read an article's full file — its ## Best Practice / ## Anti Pattern bodies — only after it makes the worklist; candidate selection uses the index alone. When the diff contains no telemetry-related changes by any of the above signals, return outcome: "not-applicable" without evaluating files.
The following targeted check covers every current telemetry article across the Microsoft and community layers. Treat it as a candidate-selection cue: when the signal appears in changed code, add the named article to the worklist and evaluate it in Action.
Session.LogMessageorSession.LogErrorusesTelemetryScope::Allfor publisher-only diagnostics, a telemetry wrapper defaults its scope toAll, or aFeatureTelemetry/custom logging change routes signals to customer environment telemetry without a customer-actionable reason —default-telemetryscope-to-extensionpublisher.
Once the candidate worklist is known, resolve layer-precedence conflicts per READ. Drop lower-precedence files whose normative guidance (## Best Practice or ## Anti Pattern) directly contradicts a higher-precedence candidate, and record each dropped file in suppressed with reason: "layer-precedence". Files that would have been candidates but are hidden because their layer is disabled in consumer configuration are recorded with reason: "configuration". Files that never became candidates are NOT recorded in suppressed.
When the post-conflict worklist is empty because no applicable telemetry knowledge exists, or because configuration suppressed every candidate, emit outcome: "no-knowledge". When the worklist is empty because no applicable telemetry knowledge matched the changes, emit outcome: "completed" with an empty findings array.
Action
For each worklist entry, evaluate the diff against the file's ## Best Practice and ## Anti Pattern sections. Emit findings as follows:
- When the diff contains a clear match for an Anti Pattern, emit a finding with severity
majororblocker, a message summarizing the anti-pattern,locationpointing to the offending line or range, and areferencesentry pointing to the knowledge file. Useblockeronly when the knowledge file states the anti-pattern violates a platform-level guarantee; otherwise the ceiling ismajor. - When the diff contains code that contradicts a Best Practice without being a full anti-pattern, emit
minorwith the same reference shape. - When the skill cannot detect a violation but the file is clearly applicable to the change, emit
infociting the file.
Set confidence to:
highwhen the detection is based on an unambiguous API andTelemetryScopeargument.mediumwhen determining whether a signal is customer-actionable requires heuristic interpretation or when any frontmatter dimension wasunknown.lowwhen the finding is an advisory derived only from applicability.
After evaluating each worklist entry, also consider whether the diff exhibits a telemetry defect the agent recognises from its general AL knowledge that no knowledge file in the worklist covers. Such candidates are agent findings within this skill's domain — emit them with references: [], an id slug prefixed with agent:, confidence capped at medium, severity capped at minor (agent findings are advisory and non-gating), and a message that is self-contained (describing both the issue and a concrete recommendation, since there is no knowledge-file footer for the consumer to fall back on). Hold every candidate to the precision bar in skills/do.md (Agent findings): emit only a concrete, material telemetry defect a knowledgeable BC reviewer would agree is wrong — steelman it first and drop anything stylistic, speculative, dependent on code outside the diff, or merely a valid alternative; when in doubt, omit. The scope is strictly telemetry; defects outside this domain belong to other leaves and MUST NOT be emitted here. Before emitting, check the worklist for a knowledge file that matches the candidate — if one exists, upgrade the candidate to a knowledge-backed finding instead. See skills/do.md for the full contract.
For every emitted finding, decide whether the fix is mechanical. A fix is mechanical when it is small, local, and unambiguous from the diff context (for example: replace TelemetryScope::All with TelemetryScope::ExtensionPublisher for a clearly publisher-only diagnostic). For mechanical findings, emit findings[].suggested-code with the literal replacement for the source lines indicated by location. The payload must be a verbatim replacement — no diff markers, no fences, no commentary — that the consumer can render as a one-click suggestion. When a .good.al companion exists and the diff context matches the .bad.al shape, adapt the .good.al replacement into suggested-code.
Omit suggested-code only when the appropriate fix depends on context the skill cannot determine, when multiple defensible replacements exist, or when the fix spans non-contiguous code. If a finding is mechanical-looking but you omit suggested-code, set findings[].suggested-code-omission-reason to a short explanation. See skills/do.md for the full contract.
Outcome selection:
completed— the skill evaluated every worklist item.no-knowledge— no applicable telemetry knowledge survived filtering.not-applicable— the diff touches no telemetry emission, wrapper, or feature-instrumentation surface.partial— a budget was hit before the worklist was exhausted.failed— an unrecoverable error occurred.
Output
Output conforms to the DO output contract. A populated example:
{
"skill": { "id": "al-telemetry-review", "version": 1 },
"outcome": "completed",
"summary": {
"counts": { "blocker": 0, "major": 1, "minor": 0, "info": 0 },
"coverage": { "worklist-size": 1, "items-evaluated": 1 }
},
"findings": [
{
"id": "community/knowledge/telemetry/default-telemetryscope-to-extensionpublisher.md",
"severity": "major",
"message": "This publisher-only diagnostic uses TelemetryScope::All, which also sends it to each customer's environment telemetry and adds avoidable ingestion cost.",
"location": {
"file": "src/Telemetry/Diagnostics.Codeunit.al",
"line": 31
},
"references": [
{ "path": "community/knowledge/telemetry/default-telemetryscope-to-extensionpublisher.md" }
],
"confidence": "high",
"suggested-code": "TelemetryScope::ExtensionPublisher"
}
],
"suppressed": []
}
The empty-corpus case produces:
{
"skill": { "id": "al-telemetry-review", "version": 1 },
"outcome": "no-knowledge",
"summary": {
"counts": { "blocker": 0, "major": 0, "minor": 0, "info": 0 },
"coverage": { "worklist-size": 0, "items-evaluated": 0 }
},
"findings": [],
"suppressed": []
}