Quality Reports

Quality Reports

Generate one standalone dashboard for scenario coverage, pull-request impact, execution, shadow validation, and replay history.

npx playwright-codegraph report \
  --artifacts test-selection-out \
  --out artifacts/pr-quality-report.html \
  --title "Checkout Pull Request Quality"

Report Structure

The interface uses a compact evidence workspace:

  • Branded header with icon-led, counted tabs
  • Editorial run brief with a scenario-readiness chart
  • Reusable evidence tiles and responsive chart grids
  • Theme-aware impact and journey graph gradients
  • URL-addressable tab state
  • 8 persisted themes, including 2 high-contrast themes
  • Settings for appearance, printing, and theme reset
  • Print mode that includes every section

Report Sections

Overview

Shows plan mode, selected-test count, scenario readiness, coverage gaps, selection flow, replay safety, execution status, fingerprint, and fallback posture.

Pull Request Impact

Shows changed files, changed projects, selected unit and Playwright tests, selection buckets, and reason codes.

Code Graph

Connects changed file nodes to scenario nodes and then to selected test nodes. The journey workflow renders each scenario as a node with directional dependency arrows.

Scenario Coverage

Shows happy-path, positive, negative, edge, and corner counts alongside criticality, declared code paths, static links, runtime observations, and gaps.

Execution and Safety

Shows runner commands, exit codes, test execution environment, shadow comparisons, replay history, fallback frequency, and missed failures.

Standalone CodeGraph run brief with scenario readiness, evidence tiles, selection flow, and replay safety charts.
Run brief: readiness, impact metrics, selection flow, and replay safety.
CodeGraph impact view with gradient nodes connecting changed files to scenarios and selected tests.
Code graph: theme-aware gradient nodes make change-to-scenario-to-test traceability easy to scan.
CodeGraph execution view showing outcome tiles, GitHub Actions environment details, and executed commands.
Execution: selection mode, command results, and the exact runner environment captured with the artifact.

The report is self-contained, responsive, keyboard accessible, printable, and safe to publish as a CI artifact. Open the interactive sample or download the standalone HTML template.

Standalone Security

  • Inline CSS and JavaScript only
  • No external fonts, scripts, stylesheets, or network requests
  • Strict Content Security Policy
  • Escaped repository paths, titles, arguments, and reason text
  • Injection-negative regression tests

Publish from GitHub Actions

- name: Generate quality report
  if: always()
  run: npx playwright-codegraph report --title "PR Quality"
 
- name: Publish quality report
  if: always()
  uses: actions/upload-artifact@v4
  with:
    name: codegraph-quality-report
    path: test-selection-out/

If no recognized artifact exists, report generation fails instead of creating a success-shaped empty dashboard.