Choosing a Learning Technology Under Pressure
A 300-person healthcare nonprofit wants to replace its aging LMS within one quarter. Requirements surfaced from stakeholders: nurses need mobile-friendly microlearning they can complete between shifts; the compliance team needs automatic certification tracking and audit-ready reports; the IT team (two people) wants minimal maintenance; and the CFO wants predictable annual cost. Vendors are pushing AI-generated content tools and social/community features. Your current LMS costs $18k/year; leadership has hinted the new one should be 'around the same.' You have no dedicated procurement staff and must run the selection yourself.
1. How do you turn these competing stakeholder needs into selection criteria you can actually evaluate vendors against?
Read the worked answer
Convert vague wants into weighted, testable criteria, and separate must-haves from differentiators.
Must-haves (pass/fail):
- Mobile-responsive delivery and offline/interrupted-session resume (nurses between shifts).
- Automated certification tracking with exportable, audit-ready reports (compliance; this is a legal risk, not a nice-to-have).
- Low administrative burden and a documented admin interface (two-person IT team).
- Total cost of ownership at or near $18k/year, including implementation, integrations, and support-not just license.
Weighted differentiators:
- Microlearning authoring and delivery quality.
- Integration with existing HR/credentialing systems.
- Vendor support responsiveness and references from similar-sized healthcare orgs.
Explicitly deprioritize AI content generation and social/community features unless a stakeholder can tie them to a must-have. They're vendor upsell unless they solve a defined problem.
Put weights in writing and get stakeholder sign-off before demos, so the decision is defensible and vendors can't steer it with flashy features.
2. How should you structure demos and evaluation so you don't get swayed by vendor sales tactics?
Read the worked answer
Control the demo instead of letting vendors run it.
- Use a scripted, scenario-based demo. Give every vendor the same tasks: 'Show a nurse completing a 4-minute module on a phone with an interruption,' 'Show me pulling an audit report for one certification,' 'Show the admin adding a user.' Watch them do it live rather than accept a canned slide deck.
- Score against the criteria in real time using a rubric tied to the weights, with at least two evaluators (you plus a compliance or nursing representative) to reduce single-person bias.
- Separate the price conversation. Require all-in TCO in writing (license, implementation, integration, training, support, renewal escalation) so the CFO compares apples to apples.
- Check references from comparable orgs, and ask specifically about post-implementation support and hidden costs.
- Beware the AI/social upsell. If a feature isn't on the criteria, it doesn't score-regardless of how impressive the demo is.
- Build a short pilot or sandbox trial for the top two if time allows; a quarter is tight, but a two-week trial de-risks a multi-year commitment.
3. Midway through selection, the CFO says the top-scoring vendor is over budget. What do you do?
Read the worked answer
Treat budget as a constraint to design around, not a reason to abandon the must-haves.
- Re-examine the TCO, not just the license. The over-budget figure may include optional modules. Ask the vendor to quote a stripped configuration that still meets must-haves; sometimes implementation or add-ons are inflating the number.
- Revisit the second-ranked vendor against the same rubric-don't default to cheapest, but re-weight cost if leadership signals it's now a must-have rather than a differentiator.
- Quantify the cost of not meeting compliance must-haves. If a cheaper option can't produce audit-ready certification reports, the savings carry legal risk; make that explicit to the CFO.
- Consider a phased or multi-year structure if the vendor allows it, but read renewal escalation clauses so 'predictable annual cost' isn't violated later.
- Document the trade-off and get the decision made by the accountable stakeholder (CFO/leadership), not silently by you. Your job is to present a clear, criteria-based recommendation with the risk stated-not to absorb a decision that belongs to them.