name: umbraco-skill-test-runner
description: Run tests from skill examples and generate a report (project)
version: 1.0.0
location: managed
allowed-tools: Bash, Read, Glob

Skill Test Runner

Runs all tests from skill examples (unit, mocked, E2E) and outputs a JSON report.

Usage

cd .claude/skills/umbraco-skill-test-runner/scripts
npm install --silent
npx tsx run-tests.ts

Test Types

Environment Variables

Auto-Start Umbraco

If E2E tests are needed and Umbraco is not running, the script will automatically:
1. Start Umbraco from ./Umbraco-CMS.Skills/ using dotnet run
2. Wait for the instance to be ready
3. Run E2E tests
4. Stop Umbraco when done (if it was started by the script)

Output

Generates test-report.json in the project root with structure:

{
  "timestamp": "2024-12-26T12:00:00Z",
  "umbracoStarted": true,
  "summary": {
    "total": 10,
    "passed": 8,
    "failed": 1,
    "skipped": 1
  },
  "results": [
    {
      "example": "counter-dashboard",
      "path": "plugins/umbraco-testing-skills/.../counter-dashboard",
      "type": "unit",
      "status": "passed",
      "duration": 1234
    }
  ]
}

Integration

This skill is Phase 3 of the validate-skills command, running after:
1. Link validation (umbraco-skill-validator)
2. Code analysis (umbraco-skill-code-analyzer)