Start with the same job
Compare the agent and person against one clear task and one acceptance standard.
A NEW REFERENCE FOR USEFUL WORK
APx asks a simple question:
How much finished, approved work did the agents produce?
Compare the same task. Count only accepted results. Include all elapsed time.
APx 3
START HERE / APx IN SIMPLE TERMS
A car engine needs horsepower so we can compare useful pulling power. Agent systems need APx so we can compare useful work. APx counts finished work that passes review. Busy agents, long runtimes and large amounts of code do not count by themselves.
to complete and approve one defined task
to deliver the same approved result
Eight times the human reference rate, shown as APx 3
Compare the agent and person against one clear task and one acceptance standard.
Broken, repeated or unverified output earns no credit. Its time and cost still count.
Measure waiting, retries, review, correction and human help from start to finish.
One sentence: APx tells you how quickly an agent system produces approved work compared with a qualified person doing the same job.
01 / THE UNIT
OUTPUT, NOT ACTIVITYTen agents running for an hour tells you how busy the system was. It does not tell you whether anything useful happened.
AP measures accepted work per hour against a qualified human reference. APx puts that multiplier on a simple doubling scale.
The same accepted output rate as a qualified human, on the same kind of task, under a declared protocol.
Eight reference hours of accepted work delivered in one elapsed hour by the declared system.
Two to the power of three equals eight. Each extra APx point doubles the output multiplier.
A proposed relative measure, not an SI unit, intelligence score, or employment replacement claim. Zero accepted output means 0 AP; its exponent is undefined.
02 / FEEL THE SCALE
Move the exponent. Watch the output grow.
The exponent is a display scale. It does not prove exponential improvement over time.
In one hour: the accepted work of 8 reference human hours. Cells are rounded; the numeric value is exact to the displayed precision.
03 / THE POWER LAB
SYNTHETIC SCENARIOChoose a kind of work. Change the assumptions. The math updates instantly. These are teaching examples, not industry averages.
Fix a reproducible bug, add regression tests, and pass maintainer review.
Unique accepted bug fixes. Failed work earns no credit.
A hypothetical baseline here. Real scores need observed human trials, including failures.
Includes retries, waiting, review, repair, and integration.
8 accepted outputs × 120 reference minutes = 16 human reference hours, delivered in 2 elapsed hours.
Working code, regression tests, security checks, maintainability, reviewer acceptance.
If a system sustains 20 AP for eight hours, it delivers 160 reference human hours: 20 working days. Sustained for 250 such days, that is 20 reference working years of accumulated output. Neither statement means 20 years of work in one day.
04 / A SPECTRUM, NOT A CROWN
12 STARTING DOMAINSA code fix, a book chapter, and a clinical workflow are not interchangeable. Compare like with like. A high score in one area says nothing about untested areas.
Fix a reproducible bug, add regression tests, and pass maintainer review.
Working code, regression tests, security checks, maintainability, reviewer acceptance.
A passing test alone does not establish a mergeable change.
These are proposed task profiles, not validated benchmark suites or measured occupational coverage. O*NET mappings require a versioned crosswalk and domain expert review.
05 / ONLY WORK THAT SURVIVES
Evidence moves through an acceptance gate. Errors, repeated artifacts, and unsupported claims do not get added to the score. Their time and cost still count.
Correct + reviewed
Regression test failed
Correct + reviewed
Same deliverable again
Correct + reviewed
Missing reviewer evidence
0 of 6 receipts processed. This replay illustrates accounting; it is not a live agent run.
Signatures prove origin and integrity. They do not prove that the work is correct.
06 / A MEASURE YOU CAN REPLAY
SPECIFICATION 0.1Keep measurement independent from optimization. The system can improve its approach. It cannot rewrite the exam to improve its score.
Freeze the job, input data, quality rubric, budget, tools, environment, and completion window.
Measure qualified humans with the same protocol. Include unsuccessful attempts in the reference rate.
Run declared candidates. Meter elapsed time, human help, compute use, failures, and all costs.
Use independent review and task checks. Reject unsafe, repeated, or unsupported outputs.
Calculate AP and APx. Report uncertainty, task coverage, assistance mode, and evidence grade.
Tune only on development tasks. Evaluate a separate holdout. Retain rollback and human approval.
Six browser checks exercise this explainer. The package contains the full Node test suite.
07 / BUILT ON EVIDENCE
RESEARCHED 07 SEP 2026APx combines established evaluation lessons into a proposed accounting layer. It does not replace domain benchmarks or claim to be an adopted standard.
The 3.1 workday figure uses summed agent runtime and an eight hour day. It is not a human productivity multiplier.
APx DESIGN RULEAPx reports runtime separately from accepted output.
06 SEP 2026Time horizons describe task difficulty at a stated success probability. They do not measure how long an agent ran or whether it can replace a job.
APx DESIGN RULEEvery APx score names a task family and reference cohort.
08 MAY 2026A followup productivity study identified selection bias and unreliable task timing when developers ran concurrent agents.
APx DESIGN RULEKeep wall time, agent runtime, and human labor distinct.
24 FEB 2026GDPval evaluates work across 44 occupations using expert judging. Reported inference speed comparisons omit oversight and integration.
APx DESIGN RULEInclude review, repair, and integration before crediting output.
25 SEP 2025APEX Agents provides 480 professional tasks with prompts, files, rubrics, and gold outputs.
APx DESIGN RULEAPx is a distinct measurement proposal, not Mercor’s APEX benchmark.
23 FEB 2026The occupational content model distinguishes tasks, work activities, context, skills, and abilities.
APx DESIGN RULEKeep job, function, capability, and environment as separate tags.
ACCESSED 07 SEP 2026A small study found that passing functional tests did not imply a change was ready to merge. Results were specific to its older model and tasks.
APx DESIGN RULERequire an independent acceptance gate beyond machine tests.
13 AUG 2025The voluntary AI risk framework supports contextual evaluation and trustworthiness across a system’s lifecycle.
APx DESIGN RULESafety failures block publishable scores. APx is not NIST certified.
AI RMF 1.0 · 2023THE FIRST SCORE SHOULD EARN YOUR TRUST.
The earlier 20 workday estimate and 100 million line count are not calibration data. A real score needs timed human reference trials and independently accepted agent outputs.
The next step: a matched pilot on bounded software maintenance tasks.