Enterprise resource
ARI Evaluation Checklist
Structured checklist for scoring autonomous reliability infrastructure platforms across architecture, governance, execution, and TCO.
Checklist
- Document control plane vs execution plane placement for each environment
- Confirm System Graph coverage for critical services and dependencies
- List required execution surfaces: web, API, desktop, VDI, enclave
- Define capability matrices and data-class restrictions
- Require human authorization for production-impacting remediation
- Validate signed capsule workflow for segmented networks
- Review telemetry types, retention, and redaction policies
- Test root-cause analysis on a recent production incident
- Run targeted regression triggered by graph change impact
- Measure flaky-test hours before and after pilot
- Export audit bundle sample for security review
- Verify CI/CD and issue tracker integrations
- Confirm PAM or secrets brokering approach
- Score agent specialization vs monolithic bot claims
- Evaluate remediation staging and PR-based workflows
- Check outbound-only endpoint agent registration
- Assess evidence egress modes: local-only, sanitized, metadata
- Define PoC success metrics and timebox
- Complete weighted scorecard across architecture pillars
- Review TCO including maintenance and incident hours
- Validate rollback and verification requirements
- Confirm no vendor claim of unsupported certifications
- Align rollout phases with change management/CAB
- Executive readout template with escape rate and MTTR trends
