PRISM Methodology
PRISM 07Telemetry

If it isn’t measured, it didn’t happen.

Every PRISM program runs on telemetry from week one — usage, adoption, cost, and impact, tracked weekly against a written baseline. Our fees are priced against it.

07 · Telemetry — the foundation
AdoptionImpactCostSafety

Every band reports into the same four dials.

Week 1
baseline methodology signed — before anything ships
84%
weekly active usage sustained at month six
5–20%
program-level targets, floor to ceiling
7–12 mo
to full P&L impact — plan against it

The framework

Four dials on every program.

If a number matters to the board, it lives on one of these.

DIAL 01

84%

weekly active

Adoption

The leading indicator — impact, cost, and safety all trail it by weeks.

DIAL 02

+2,140

hrs vs. baseline

Impact

Hours saved against the written baseline — the dial outcome pricing bills against.

DIAL 03

51%

volume on fast tier

Cost

Spend attributed per workflow — unit economics, not a lump sum labeled “AI.”

DIAL 04

27/27

evals passing

Safety

Incidents, overrides, eval pass rates — the dial diligence asks about.

Week one

The baseline is the contract.

ROI is defined per use case before the pilot — one claim each, measured, never claimed after the fact.

Week 1

Baseline signed

Current state measured, methodology agreed in writing.

Then

Agents ship

Skills go live inside the function.

Weekly

Delta measured

Hours and cycle times against the signed baseline.

Invoice

% of measured savings

If the number didn’t move, you don’t pay.

Why it holds

The baseline number is the contract. If the agents don’t move it, you don’t pay for them.

The console

What the CFO opens on Monday morning.

A real program week, reconstructed — all four dials on one screen.

Program console — week 23
Adoption · weekly activeBY FUNCTION
Finance91%
IT88%
Ops84%
Legal76%
Impact · hours vs. baseline+2,140 hrs

ANNUALIZED · METHODOLOGY v1.0, SIGNED WK 1

Cost · spend by model tier
Frontier18%
Standard31%
Fast51%

Anomaly · Marketing premium-tier usage 3.1× last month — routed for review.

Safety · eval gateGATE · PASS
27/27evals passing
0
incidents
4
overrides
0
drift flags

The same numbers go to the function owners, the committee, and the sponsor. Nobody gets a different version of the truth.

The silent margin killer

Unattributed AI spend erodes the margin it was meant to expand.

We treat inference cost as a margin line from day one — not a lump sum on the IT line that nobody owns.

Per-function unit economics

Cost per invoice coded, per ticket deflected — a unit cost the CFO puts next to the unit value.

Model routing as policy

Frontier models where the stakes are high, fast models for volume — a routing table, not a culture campaign.

Anomaly narration

The spend report explains itself: “Finance moved down a tier — spend fell 40% while throughput rose.”

The adoption curve

What actually happens after launch.

Every rollout follows the same curve — the difference is what happens in the trough.

WK 1 SPIKEWK 4–8 TROUGHMONTH 6 HABIT

Week 1

The novelty spike

Everyone tries it. Curiosity isn’t adoption — this week’s numbers predict nothing.

Weeks 4–8

The trough

Novelty fades and usage drops. This is where unmanaged programs die — one lapsed user at a time.

Month 6

The habit

Usage climbs past the spike and stays — 84% weekly active, sustained. It’s how the work gets done.

Leading indicators

Invocations per user, feedback volume, and time-to-second-use turn down weeks before the value line moves — so the intervention starts early.

The intervention playbook

A usage drop triggers office hours the same week. Killing a dead skill is telemetry working, not the program failing.

Honest benchmarks

The numbers the research actually supports.

The planning numbers we put in business cases — smaller than the headlines, measured in production, real.

Engineering

Lab conditions
56%
Measured in production
10–30%

Once review and coordination are counted — plan on the lower band.

Customer support

All users
+14%
Newer team members
+34%

Issues resolved per hour — gains concentrate where experience is thinnest.

Proposals & RFPs

Faster turnaround
40–50%
Higher win rates
+10%

Speed and quality move together on document-heavy work.

Program-level

Floor
5–10%
Ceiling
10–20%

Full P&L impact lands in 7–12 months — plan against the floor.

Buyer beware

Anyone quoting the lab numbers as planning numbers is selling you something.

The cadence

Weekly to the owners. Quarterly to the board.

The same four dials roll up three altitudes — no re-cutting, no reconciliation meetings.

WEEKLYMONTHLYQUARTERLY

Weekly

Function owners

Cost, safety, adoption, function KPIs — refreshed every week, no meeting required to read it.

Monthly

Governance committee

Dials reviewed, escalations cleared, expansions approved — thirty minutes when telemetry is healthy.

Quarterly

Board & sponsor

Hours against baseline, spend against budget, the safety record, what scales next.

Repeatable

One reusable page — baseline, measured result, cost, projected impact at scale — justifies expanding any pilot that proves out.

The point

Productivity without measurement is a vanity metric. Telemetry is what turns a pilot into a line item the board believes.

Ready to move

Start with the baseline.

We’ll come back with the current-state numbers, the methodology in writing, and the four dials we’d report against — before anything ships.

Talk to LightCI