Questions to Ask When Evaluating LMS Vendors

Discover the best Learning Management System (LMS) for your needs by evaluating vendors efficiently. Compare features, pricing, and reviews to make informed decisions

Brett Ungashick
OutSail HRIS Advisor
July 4, 2023
user comparing HRIS systems

When evaluating a new Learning Management System (LMS), it can be helpful to prepare some questions before your meeting, so that you can be the one driving the evaluations, not the one sold to.

Typically an LMS evaluation will involve meeting with each vendor 2-3 times. Here are questions to consider for each of those meetings.

1st Meeting - The Intro Call

Organizational Match
  • What do your customers love most about working with you?
  • What is the most common reason that a customer fails to have success with your team?
  • Why do you feel your company is uniquely positioned to win our business?
  • How have you helped companies of our size & industry achieve an ROI?
Product Viability
  • From a product standpoint, what would you say are the key differentiators for your platform in the marketplace?
  • Can you tell us about the innovation cycles at your company?
  • How frequent are updates rolled out?
  • Do customers inform that roadmap?
  • What are some new features that are expected in 2022?
  • How do you prioritize building enhancements to existing technology vs. building new, innovative technology?
  • Has any part of your system been acquired or white labeled from a 3rd party?

2nd Meeting - The Product Demonstration 

Admin Experience

User Controls
  • Does your system offer role-based security?
  • Can there be different user types with different levels of access and visibility?
  • Aside from manual entry, in what ways can we ensure that the active users on the platform are consistent with our active employee population (SSO, SAML, HRIS integrations, etc.)?
Content Generation
  • Please show us the experience for creating a new training course from scratch, as well as creating a new training course from an existing PPT deck
  • If we wanted to buy pre-built content and upload it into the system, do you have preferred or integrated content partners? What are the costs of those courses?
Content Administration
  • Can your system proactively alert us about compliance trainings that are required for our employees (harassment, bribery, ethics, etc.)
  • Can your system support both in-person and online trainings?
  • Please show how your system will allow us to set up multiple employee groups, assign a specific course to one particular group, then automate the notifications to that employee until the course is completed
  • Also show how an admin will be alerted if a course is almost past due
  • Please show us how your reporting tools will deliver insights into our employee population
  • Please show us how your reporting tools will deliver insights into the quality of our content

Employee Experience

Learning Experience
  • Please show us how an employee is notified that they have a required course to take, the course experience and the ability to test comprehension after
  • Can your learning platform be branded to fit our company aesthetic?
  • Can employees get courses recommended to them, based on jobs they want or skills they want to develop?
  • Is your mobile app available in the App Store and Google Play store?
  • Please show us the user experience in the mobile app:
  • Can employees without a corporate email still use the mobile app?
  • Is your app available in multiple languages?

3rd Meeting - The Executive Overview

  • What does the process look like for getting integrated with our HR system of record?
  • I.e., Are there additional costs? Is the integration bi-directional or one way? Who maintains the integration - our team, yours or the HRIS company?
  • What are other common integrations that your customers are leveraging today?
  • Is multi-factor authentication standard in the platform?
  • Is your system SOC II, HITRUST and GDPR compliant? Please provide documentation
  • Does your platform support single sign-on, SAML or other authentication mechanisms?
  • How will you help our company stay compliant, especially as new laws go into effect around ACA and EEO?
Support & Deployment Services
  • Can you disclose your year over year customer retention rate?
  • What are the most common reasons that a client is unsuccessful on your platform?
  • What is your approach to customer success?
  • Is there a single point of contact?
  • How will you share knowledge and strategies so our power users can grow in the system and continue to be successful?
  • What is the ratio of support reps to clients?
  • What is your implementation methodology?
  • How is the system configured to match our processes?
  • Who will comprise our project management team?

2024 HRIS 
Landscape Report
Read OutSail's 2024 HRIS Report with write-ups on 30+ leading vendors
Thank you! You can download your report at this link
Oops! Something went wrong while submitting the form.
Unsure about your software needs?
Use our HRIS Requirements Builder to quickly identify your must-have & nice-to-haves
Brett Ungashick
OutSail HRIS Advisor
Accelerate your HRIS selection process with free support
Thank you! Our team will reach out to you shortly
Oops! Something went wrong while submitting the form.

Meet the Author

Brett Ungashick
OutSail HRIS Advisor
Brett Ungashick, the friendly face behind OutSail, started his career at LinkedIn, selling HR software. This experience sparked an idea, leading him to create OutSail in 2018. Based in Denver, OutSail simplifies the HR software selection process, and Brett's hands-on approach has already helped over 1,000 companies, including SalesLoft, Hudl and DoorDash. He's a go-to guy for all things HR Tech, supporting companies in every industry and across 20+ countries. When he's not demystifying HR tech, you'll find Brett enjoying a round of golf or skiing down Colorado's slopes, always happy to chat about work or play.


Everything you need to know about OutSail
What is OutSail?
OutSail is the first-ever broker of HR Software. We offer market insights, evaluation tools & advisory services to help organizations research, evaluate and select the right HR software. And best of all - OutSail is free!
How is OutSail free?
OutSail is free due to our one-of-a-kind software broker model. When a company makes a purchase through OutSail, the winning vendor owes us a small fee for making the introduction.

No Hidden Fees - You don't pay for our services and the vendors don't pass our costs along either
Vendor Agnostic - OutSail partners with 220+ HR Tech vendors including every market leader
What are the benefits of OutSail?
1.) Market Insights: Access the industry's most trusted data. Read user reviews of every leading HRIS vendor. Access verified pricing data. Use proprietary tools to sort & filter by your selection criteria.
2.) Evaluation Tools: Access to project plans & timelines. Customize your own scorecard tools. Leverage expert-generated demo questions. Collaborate with your team
3.) Advisory Services: Work with HRIS industry experts. Assistance during proposal review and guidance for negotiations. Implementation readiness
What if I'm a broker, consultant or vendor?
We love partnering with brokers & consultants and bringing innovative vendors to our customers. Follow those links to learn more about how we can partner together and bring OutSail's benefits to your customers.

The Future of Software Buying

See why modern buyers prefer OutSail's broker model when buying their next HRIS