Measured workflow capability
Task performance, critical failures, reliability, latency, human correction, and uncertainty on a frozen case set.
Method
The public surface is a reading copy of the same governed engine partners use. It does not add a universal moat score, a composite winner, or an unsupported ROI claim.
Mixing capability, cost, structural rights, and modeled scenarios into one number is how diligence becomes marketing. Each plane has its own status, denominator, and decision implication.
Task performance, critical failures, reliability, latency, human correction, and uncertainty on a frozen case set.
All-attempt direct cost, tool and API charges, correction and QA labor, full cost per accepted output, and volume scenarios.
Data rights, exclusivity, flywheel evidence, rebuild path, switching costs, distribution, and services dependence. Dimensions stay separate; they are not averaged into a moat grade.
Vendor statements, scenario assumptions, and unverified hypotheses stay labeled. A failed measurement stays open. Judgments stay labeled as judgments.
The client decision selects the kind. The planes, comparison conditions, and claim labels do not change; the verdict object and the role of public-benchmark evidence do. Published benchmarks attach to the job, not the vendor. Two competing products in the same category share those benchmarks and differ in their company-specific findings.
An investor evaluating a software target: is the asset defensible, replicable, or exposed, and on what evidence.
Verdict object. A structural finding about the asset.
Annex role. Published benchmarks bound what a generic system already does in the category. They never score the vendor. Software analyses ↗
A software company choosing which AI features to build: is each feature feasibility-supported today, and what must a pilot still establish.
Verdict object. A feature thesis with per-feature feasibility floors.
Annex role. Published benchmarks bound whether models can do the task type. They say nothing about the product's data, users, or exceptions. Advisory records ↗
An investor or operator of a services business: which workflow components are exposed to automation, at what evidence tier, and what stays human.
Verdict object. Two modeled objects, never blended: an automatable share of minutes, and a chain-completion bound that fails closed.
Annex role. Published benchmarks supply a floor only where the task mapping is strong. Weak mappings never borrow a score. Automation records ↗
Automation-diligence records break a workflow into components and map each to a public floor only where the mapping is honest. The rules keep a decomposition from turning into a blended score.
Competitive dynamics often arrive as reporting and practitioner accounts: a vendor's model strategy, a first-party product from a model lab, a customer building in-house. That material is admissible only as an attributed, dated structural judgment.
For each priority workflow, the method asks for the current process, the raw model surface, a reproducible generic system, the target system, and authorized ablations. Missing conditions stay on the page.
The incumbent process, included only when it was actually observed.
A generally available model with no product-specific setup.
A declared alternative with the same job, tools, and budget.
The system under review, tested with authorized access.
Included only when access and rights permit. Missing comparisons stay visible.
A cheaper model that still clears the gates is a finding. A frontier model that does not beat the generic comparator on the same frozen cases is also a finding.
The web app is a thin workspace over the engine. Browser input cannot freeze a study, approve a claim, or mark a report released.
Access grants, rights, and spend authority are recorded before any live call.
Study definition, cases, budgets, and models are frozen. Amendments create a new revision.
Every report number resolves to a structured analysis field and then to evidence hashes.
Truth validation, claim approval, and visual inspection remain human-gated.
Draft, verified simulation, and released are distinct. A failed gate is indeterminate.