Phase 01
Research
- Literature review
- Stakeholder interviews
- Construct definition
- Framework development
- Competency mapping
- Job/Task Analysis (JTA) — AERA Std 11
- Legal & regulatory scan (GDPR, ADA, Title VII, local)
- Technical advisory committee
Lifecycle
Ten phases. One transparent economic model.
AES prices every activity across the full assessment lifecycle — aligned to AERA/APA/NCME 2014, ITC, ISO 10667, and ISO/IEC 17024. The ones organizations remember to budget for, and the ones they don't.
Phase 02
Assessment Design
- Blueprint & test specifications
- Domain definition
- Item specifications
- Scoring model (dichotomous / polytomous / partial credit)
- Standard-setting method selection
- Content-validity evidence plan
Phase 03
Item Development
- Item writing
- SME review
- Editing
- Bias / DIF review
- Fairness & sensitivity review
- Accessibility (WCAG, accommodations)
- Item banking / metadata / versioning
- Translation & back-translation
- Cognitive interviews
Phase 04
Pilot Testing
- Sampling
- Recruitment
- Data collection
- Monitoring
- Data cleaning
- Field testing (embedded operational seeding)
Phase 05
Psychometric Analysis
- CTT
- Rasch
- IRT
- DIF
- Reliability & validity
- Dimensionality (EFA/CFA)
- Measurement invariance
- Equating & linking
- CAT simulation
- Item calibration
- Technical manual
Phase 06
Norming
- National norms
- International norms
- Percentiles & standard scores
- Scaling
Phase 07
Standard Setting
- Angoff panel
- Bookmark method
- Ebel method
- Contrasting groups
- Panelist recruitment & facilitation
- Cut-score validation
- Periodic re-set
Phase 08
Technology
- CBT
- CAT
- Mobile testing
- API
- Security
- Cloud infrastructure
- Reporting
- Proctoring (in-person / online / AI)
- Test security & item exposure control
Phase 09
Deployment
- User training
- Go-live
- Documentation
- Helpdesk
- Candidate registration & scheduling
- Score reporting & credential issuance
- Appeals & rescore
- ISO/IEC 17024 accreditation
Phase 10
Maintenance
- Item bank refresh
- Recalibration
- Software updates
- Security patches
- Hosting
- Technical support
- Periodic validity re-studies (3–5 yrs)
- Item retirement & replacement