miles-knowbl

retrospective

1
0
# Install this skill:
npx skills add miles-knowbl/orchestrator --skill "retrospective"

Install specific skill from multi-skill repository

# Description

Analyzes completed journeys to extract learning and propose improvements. Identifies what worked, what didn't, and why. Generates skill amendment proposals, calibration adjustments, and pattern candidates. Feeds improvements back into the skills library to make future journeys more effective.

# SKILL.md


name: retrospective
description: "Analyzes completed journeys to extract learning and propose improvements. Identifies what worked, what didn't, and why. Generates skill amendment proposals, calibration adjustments, and pattern candidates. Feeds improvements back into the skills library to make future journeys more effective."
phase: COMPLETE
category: meta
version: "1.0.0"
depends_on: []
tags: [learning, improvement, metrics, feedback, core-workflow]


Retrospective

Learn from completed journeys.

When to Use

  • After system completion β€” Analyze the full journey
  • After significant milestone β€” Mid-journey learning
  • After failure β€” Understand what went wrong
  • Periodically β€” Aggregate learning across domains

Reference Requirements

MUST read before applying this skill:

Reference Why Required
retrospective-templates.md Templates for retrospective documents
root-cause-analysis.md 5 Whys methodology

Read if applicable:

Reference When Needed
amendment-process.md When proposing skill changes

Verification: Ensure RETROSPECTIVE.md is produced with root causes identified.

Required Deliverables

Deliverable Location Condition
RETROSPECTIVE.md Project root Always

Core Concept

Retrospective answers: "What should we do differently next time?"

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                         RETROSPECTIVE                                        β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚                                                                             β”‚
β”‚  INPUT                              OUTPUT                                  β”‚
β”‚  ─────                              ──────                                  β”‚
β”‚                                                                             β”‚
β”‚  Journey Data ─────────────────────▢ What worked well                       β”‚
β”‚  Verification Results ─────────────▢ What didn't work                       β”‚
β”‚  Metrics ──────────────────────────▢ Why (root causes)                      β”‚
β”‚  Team Feedback ────────────────────▢ Skill amendments                       β”‚
β”‚                                      Calibration adjustments                β”‚
β”‚                                      New patterns                           β”‚
β”‚                                      Process changes                        β”‚
β”‚                                                                             β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

The Retrospective Process

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                      RETROSPECTIVE PROCESS                                   β”‚
β”‚                                                                             β”‚
β”‚  1. GATHER DATA                                                             β”‚
β”‚     └─→ Load journey summary (from journey-tracer)                          β”‚
β”‚     └─→ Load verification results                                           β”‚
β”‚     └─→ Load metrics (estimate vs actual)                                   β”‚
β”‚     └─→ Collect any human feedback                                          β”‚
β”‚                                                                             β”‚
β”‚  2. ANALYZE WHAT WORKED                                                     β”‚
β”‚     └─→ Skills with good verification                                       β”‚
β”‚     └─→ Estimates that were accurate                                        β”‚
β”‚     └─→ Patterns that succeeded                                             β”‚
β”‚     └─→ References that provided value                                      β”‚
β”‚                                                                             β”‚
β”‚  3. ANALYZE WHAT DIDN'T WORK                                                β”‚
β”‚     └─→ Skills with partial/failed verification                             β”‚
β”‚     └─→ Estimates that were off                                             β”‚
β”‚     └─→ Gaps in skill application                                           β”‚
β”‚     └─→ References that were skipped                                        β”‚
β”‚                                                                             β”‚
β”‚  4. ROOT CAUSE ANALYSIS                                                     β”‚
β”‚     └─→ Why did things work/not work?                                       β”‚
β”‚     └─→ 5 Whys for significant issues                                       β”‚
β”‚     └─→ Contributing factors                                                β”‚
β”‚                                                                             β”‚
β”‚  5. GENERATE IMPROVEMENTS                                                   β”‚
β”‚     └─→ Skill amendment proposals                                           β”‚
β”‚     └─→ Calibration adjustments                                             β”‚
β”‚     └─→ New pattern candidates                                              β”‚
β”‚     └─→ Process change recommendations                                      β”‚
β”‚                                                                             β”‚
β”‚  6. PRIORITIZE                                                              β”‚
β”‚     └─→ Impact vs effort                                                    β”‚
β”‚     └─→ Frequency of issue                                                  β”‚
β”‚     └─→ Risk of not addressing                                              β”‚
β”‚                                                                             β”‚
β”‚  7. DOCUMENT & INTEGRATE                                                    β”‚
β”‚     └─→ Produce RETROSPECTIVE.md                                            β”‚
β”‚     └─→ Create amendment PRs                                                β”‚
β”‚     └─→ Update calibration data                                             β”‚
β”‚     └─→ Archive patterns                                                    β”‚
β”‚                                                                             β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Retrospective Document (RETROSPECTIVE.md)

Template

# Retrospective: [System Name]

**Domain:** [Domain Name]
**Date:** [Date]
**Journey Duration:** [X hours]
**Facilitator:** [Agent/Human]

---

## Summary

| Metric | Value |
|--------|-------|
| Skills Applied | [N] |
| Verification Pass Rate | [X%] |
| Estimation Accuracy | [X%] |
| Reference Utilization | [X%] |
| Rework Cycles | [N] |

**One-line summary:** [What happened in this journey]

---

## What Worked Well

### Skills
| Skill | Why It Worked | Pattern to Keep |
|-------|---------------|-----------------|
| | | |

### Processes
| Process | Outcome | Keep Because |
|---------|---------|--------------|
| | | |

### References
| Reference | Value Provided | Usage Rate |
|-----------|----------------|------------|
| | | |

---

## What Didn't Work

### Skills
| Skill | Issue | Impact | Frequency |
|-------|-------|--------|-----------|
| | | | |

### Gaps
| Gap | Where | Impact |
|-----|-------|--------|
| | | |

### Skipped Steps
| Skill | Step Skipped | Why | Impact |
|-------|--------------|-----|--------|
| | | | |

---

## Root Cause Analysis

### Issue 1: [Issue Title]

**Symptom:** [What was observed]

**5 Whys:**
1. Why? [First level]
2. Why? [Second level]
3. Why? [Third level]
4. Why? [Fourth level]
5. Why? [Root cause]

**Contributing Factors:**
- [Factor 1]
- [Factor 2]

**Category:** [Skill gap | Process gap | Knowledge gap | Tool gap]

---

### Issue 2: [Issue Title]

[Repeat analysis...]

---

## Improvement Proposals

### Skill Amendments

| Skill | Amendment | Rationale | Priority |
|-------|-----------|-----------|----------|
| architecture-review | Require ARCHITECTURE-REVIEW.md deliverable | Skill was skipped without explicit artifact | P0 |
| spec | Add non-web system guidance | Template assumes web app | P1 |
| test-generation | Add minimum coverage requirement | Easy to skip integration tests | P1 |
| entry-portal | Make GitHub publish optional | Not all projects use GitHub | P2 |

#### Amendment Detail: [Skill Name]

**Current State:**
[What the skill currently says/does]

**Proposed Change:**
[What should be added/modified]

**Rationale:**
[Why this change improves outcomes]

**Implementation:**
- [ ] Update SKILL.md section [X]
- [ ] Add reference document [Y]
- [ ] Update verification checklist

---

### Calibration Adjustments

| Category | Previous Multiplier | New Multiplier | Based On |
|----------|---------------------|----------------|----------|
| MCP Server | N/A | 0.3x | This journey (26h estimated, 4.5h actual) |
| TypeScript | 1.0x | 0.8x | [Evidence] |

**Note:** These are per-domain calibrations. Cross-domain patterns require more data.

---

### New Patterns Identified

| Pattern | Context | Template Candidate? |
|---------|---------|---------------------|
| Service + Tool architecture for MCP | MCP servers | Yes |
| Layered validation (Schema β†’ Service β†’ Tool) | Data-heavy systems | Yes |

#### Pattern Detail: [Pattern Name]

**Context:** [When this pattern applies]

**Solution:** [What the pattern is]

**Example:** [Brief example from this journey]

**Codify as:** [Reference doc | Template | Skill section]

---

### Process Changes

| Change | Current | Proposed | Benefit |
|--------|---------|----------|---------|
| Reference check | Optional | Required before skill | Higher quality |
| Build verification | Optional | Required in scaffold | Catch errors early |

---

## Action Items

### Immediate (This Session)

| Action | Owner | Status |
|--------|-------|--------|
| Create skill amendment for architecture-review | Agent | [ ] |
| Update calibration data | Agent | [ ] |
| Archive service-tool pattern | Agent | [ ] |

### Next Journey

| Action | When | Verification |
|--------|------|--------------|
| Read all required references | Before each skill | Check in journey log |
| Create ADRs for decisions | During architect | Check in verification |
| Run build after scaffold | After scaffold | Check in verification |

### Backlog

| Action | Priority | Effort |
|--------|----------|--------|
| Add MCP project template | P2 | Medium |
| Multi-language support for implement | P3 | High |

---

## Learning Integration

### Exported to Calibration Tracker
- [ ] Estimate vs actual: 26h β†’ 4.5h
- [ ] Skill-level timing data

### Pattern Candidates for Extraction
- [ ] Service-tool MCP architecture
- [ ] Layered validation pattern

### Skill Amendments Queued
- [ ] architecture-review: require deliverable
- [ ] spec: non-web guidance
- [ ] test-generation: minimum coverage

---

## Retrospective Meta

**What worked about this retrospective:**
- [Observation]

**What could improve:**
- [Observation]

---

*Retrospective completed by retrospective skill*

Learning Data Management

Per-Domain Learning

Each domain maintains its own learning data:

domain-memory/{domain}/
β”œβ”€β”€ learning/
β”‚   β”œβ”€β”€ retrospectives/
β”‚   β”‚   β”œβ”€β”€ 2025-01-17-system-1.md
β”‚   β”‚   └── 2025-01-20-system-2.md
β”‚   β”œβ”€β”€ calibration.json
β”‚   └── patterns.json

Calibration Data Format

{
  "domain": "skills-library-mcp",
  "estimates": [
    {
      "system": "Skills Library MCP",
      "date": "2025-01-17",
      "estimated": {
        "hours": 26,
        "complexity": "M",
        "confidence": "high"
      },
      "actual": {
        "hours": 4.5,
        "complexity": "M"
      },
      "ratio": 0.17,
      "notes": "Agentic execution much faster than estimated"
    }
  ],
  "adjustments": {
    "agenticMultiplier": 0.3,
    "complexityFactors": {
      "mcp": 0.8,
      "typescript": 0.9
    }
  }
}

Pattern Archive Format

{
  "domain": "skills-library-mcp",
  "patterns": [
    {
      "name": "Service-Tool MCP Architecture",
      "context": "Building MCP servers with multiple tools",
      "solution": "Layer: Tools β†’ Services β†’ FileService β†’ Filesystem",
      "example": "skills-library-mcp",
      "confidence": "medium",
      "uses": 1,
      "templateCandidate": true
    }
  ]
}

Improvement Lifecycle

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚                      IMPROVEMENT LIFECYCLE                                   β”‚
β”‚                                                                             β”‚
β”‚  1. IDENTIFY (Retrospective)                                                β”‚
β”‚     └─→ Gap or issue discovered                                             β”‚
β”‚     └─→ Documented in retrospective                                         β”‚
β”‚                                                                             β”‚
β”‚  2. PROPOSE (Amendment)                                                     β”‚
β”‚     └─→ Specific change proposed                                            β”‚
β”‚     └─→ Rationale documented                                                β”‚
β”‚     └─→ Priority assigned                                                   β”‚
β”‚                                                                             β”‚
β”‚  3. REVIEW                                                                  β”‚
β”‚     └─→ Human reviews proposal                                              β”‚
β”‚     └─→ Approve / Modify / Reject                                           β”‚
β”‚                                                                             β”‚
β”‚  4. IMPLEMENT                                                               β”‚
β”‚     └─→ Update skill SKILL.md                                               β”‚
β”‚     └─→ Update references if needed                                         β”‚
β”‚     └─→ Update verification checklist                                       β”‚
β”‚                                                                             β”‚
β”‚  5. VERIFY                                                                  β”‚
β”‚     └─→ Next journey uses updated skill                                     β”‚
β”‚     └─→ Check if improvement achieved                                       β”‚
β”‚     └─→ Adjust if needed                                                    β”‚
β”‚                                                                             β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

Anti-Patterns

What NOT to do

Anti-Pattern Problem Instead
Change everything Introduces instability Small, targeted changes
Skip root cause Treats symptoms Always do 5 Whys
No verification Don't know if it worked Plan verification in next journey
Over-optimize Diminishing returns Focus on high-impact issues
Blame Not constructive Focus on process, not individuals

Integration with Other Skills

Skill Integration
journey-tracer Provides input data
calibration-tracker Receives calibration adjustments
skill-verifier Uses updated verification criteria
loop-controller Uses updated process recommendations

Retrospective Verification Checklist

## retrospective Verification

### Process
- [ ] Journey data gathered
- [ ] What worked analyzed
- [ ] What didn't work analyzed
- [ ] Root cause analysis for major issues
- [ ] Improvement proposals generated
- [ ] Priorities assigned
- [ ] Action items identified

### Deliverables
- [ ] RETROSPECTIVE.md exists
- [ ] All sections complete
- [ ] Improvements are actionable
- [ ] Calibration data updated

### Quality
- [ ] Root causes identified (not symptoms)
- [ ] Improvements are specific
- [ ] Priorities are justified
- [ ] Integration points documented

β†’ See references/retrospective-templates.md for additional templates
β†’ See references/root-cause-analysis.md for 5 Whys methodology

Mode-Specific Behavior

Retrospective scope and improvement proposals differ by orchestrator mode:

Greenfield Mode

Aspect Behavior
Scope Full system journey analysis
Approach Comprehensive improvement identification
Patterns Free choice of retrospective format
Deliverables Full RETROSPECTIVE.md + improvement proposals
Validation Standard retrospective verification
Constraints Minimal - full learning extraction

Brownfield-Polish Mode

Aspect Behavior
Scope Gap-filling journey analysis
Approach Extend learning with integration focus
Patterns Should match existing documentation style
Deliverables Delta retrospective with gap focus
Validation Gap-specific learning verified
Constraints Don't restructure existing learnings

Polish considerations:
- What worked in integrating with existing code
- Gaps in understanding existing system
- Reference utilization for brownfield
- Pattern conformance issues

Brownfield-Enterprise Mode

Aspect Behavior
Scope Change-specific post-mortem only
Approach Surgical compliance-focused analysis
Patterns Must conform exactly to audit requirements
Deliverables Change post-mortem (audit trail)
Validation Full compliance verification
Constraints Requires approval for any improvement proposals

Enterprise retrospective constraints:
- Focus on process compliance, not improvement
- Amendments require change board approval
- Primary goal is audit trail, not optimization
- Pattern changes are out of scope

Enterprise retrospective format:

# Post-Implementation Review: [CR-12345]

## Compliance Summary
| Requirement | Met | Evidence |
|-------------|-----|----------|
| Change approval | βœ… | CR-12345 |
| Testing complete | βœ… | Test report |
| Rollback tested | βœ… | Staging test |

## Observations (Non-Binding)
- [Observation for future reference]

# Supported AI Coding Agents

This skill is compatible with the SKILL.md standard and works with all major AI coding agents:

Learn more about the SKILL.md standard and how to use these skills with your preferred AI coding agent.