agentic-kpi-tracking

# Agentic KPI Tracking Skill

Guide measurement and tracking of agentic coding KPIs to assess ZTE readiness.

## When to Use

- Measuring agentic workflow effectiveness
- Tracking progress toward ZTE
- Analyzing success patterns
- Identifying improvement areas

## Core KPIs

### Summary Metrics

| Metric | Calculation | Target |
| --- | --- | --- |
| **Current Streak** | Consecutive successes (Attempts <= 2) | Higher is better |
| **Longest Streak** | Best consecutive success run | Track improvement |
| **Average Presence** | Mean attempts across all runs | Target: 1 |
| **Total Plan Size** | Sum of all plan sizes | Track scaling |
| **Total Diff Size** | Sum of all changes (added + removed) | Track throughput |

### Per-Run Metrics

| Metric | Source | Meaning |
| --- | --- | --- |
| **Attempts** | Count of plan/patch runs | 1 = perfect, higher = retries |
| **Plan Size** | Lines in plan file | Task complexity |
| **Diff Size** | Lines added + removed | Change magnitude |
| **Files Changed** | Number of files modified | Change scope |

## Calculation Methods

### Attempts Count

Only count workflow restarts:

```python
attempts_incrementing = ["adw_plan_iso", "adw_patch_iso"]
attempts = count(workflow in all_adws if workflow in attempts_incrementing)
```

Build/test/review don't increment - only full replans.

### Streak Calculation

```python
current_streak = 0
for run in reversed(runs):
    if run.attempts <= 2:
        current_streak += 1
    else:
        break
```

### Diff Statistics

```bash
git diff origin/main --shortstat
# Output: X files changed, Y insertions(+), Z deletions(-)
```

## KPI File Format

Store in `app_docs/agentic_kpis.md` or equivalent:

```markdown
# Agentic KPIs

## Summary

| Metric | Value |
| --- | --- |
| Current Streak | 5 |
| Longest Streak | 12 |
| Average Presence | 1.3 |
| Total Plan Size | 450 lines |
| Total Diff Size | 2,340 lines |

## Detail

| Date | ADW ID | Issue | Class | Attempts | Plan Size | Diff +/- | Files |
| ---