| Implementation speed for first production course | 25% | Team ships first approved course with tracking enabled and QA signoff inside planned launch window. | Score how quickly IDs can author, package, and upload SCORM into your LMS with minimal rework. | Score how quickly SMEs can build and publish directly in LMS-native builders without custom packaging steps. |
| Update velocity for recurring policy/process changes | 25% | Minor updates can be shipped weekly without breaking completions or version history. | Measure cycle time for editing source files, republishing SCORM, and validating completion sync. | Measure cycle time for in-LMS edits, approvals, and learner-visible rollouts across active cohorts. |
| Data fidelity and reporting depth | 20% | Learning records are consistent enough for compliance audits and manager coaching decisions. | Validate SCORM/xAPI event capture, completion logic, and edge-case behavior in your target LMS. | Validate native event granularity, export quality, and ability to track required assessment evidence. |
| Governance, version control, and handoffs | 15% | Ownership stays clear across IDs, admins, compliance reviewers, and regional stakeholders. | Check authoring ownership model, source control discipline, and rollback process for packaged assets. | Check permissioning granularity, approval routing, and audit logs inside LMS-native content workflows. |
| Total operating cost per maintained course | 15% | Cost and team effort decline as library size grows and refresh cadence increases. | Model tool licensing + specialist authoring effort + QA overhead for each update cycle. | Model LMS seat/feature cost + admin dependency + any limits on advanced interaction design. |