Phillips ROI Model: The 5 Levels of Training Evaluation

Phillips ROI Model: The 5 Levels of Training Evaluation (2024)
Vasupradha-Srinivasan-expert

Expert: Vasupradha Srinivasan As Whatfix’s Head of Market Research, Vasu brings years of experience as a Principal Analyst at Forrester. Her research expertise focuses on digital adoption, core system transformation, and customer experience.

The cost of formal learning programs in enterprise settings rose 34% in 2024 to $874 per employee annually. With L&D budgets growing, executives are rightfully demanding to know if these investments move the needle.

The data says yes: a Harvard Business School research study found that a single targeted training program drove frontline employees to complete 10% more work, while their newfound self-sufficiency significantly boosted the productivity of their managers, too. However, bridging the gap between those operational performance gains and undeniable, bottom-line financial value remains a challenge for most L&D teams.

This article explores how the Phillips ROI model is a powerful training evaluation framework that expands on traditional learning metrics to help you calculate the exact financial return of your training initiatives. We will break down the model’s five levels, explain how to isolate the direct business impact of your programs from outside factors, and walk through the formulas you need to confidently prove the monetary value of your L&D strategy to the C-suite, as well as provide an interactive Phillips ROI calculator for you to benchmark your training program’s ROI.

What Is the Phillips ROI Methodology?

The Phillips ROI Model is a methodology and process for L&D and HR teams to tie the costs of training programs with their actual results. You may see this model also use the words “methodology”, “process”, and “model” interchangeably to describe the Phillips ROI Model.

Phillips ROI Model builds on the Kirkpatrick Model, one of the most commonly used models for corporate training evaluation. It classifies data from different types employee training programs to measure:

  • the reaction of participants
  • the actual learning of participants
  • the behavior change from these learning
  • the final result

But organizations that spend millions – or potentially billions – of dollars on training programs want more than results. To sanction large budgets, they need to see the monetary actual value of these programs – their return on investment (ROI).

Phillips ROI Model

The Phillips ROI Model clearly demonstrates the monetary benefit for organizations by adding a fifth layer to calculate each program’s ROI. This additional level compares learning business impact outcomes to total training costs.

The Phillips Methodology isolates the program’s effects from other influencing factors at all levels of the training program’s evaluation. This filtered data empowers L&D teams to accurately estimate net monetary benefits for various training programs.

Phillips ROI Model Calculator

(A summation of design and development costs + venue costs + training material costs + travel costs + other administrative costs)
Net Program Benefits: $10,000.00
ROI: 200.00%

The Five Levels of the Phillips ROI Framework

The Kirkpatrick Model was the de facto model of training evaluation in the 1970s and 1980s. With his book on training evaluation, Jack Phillips expanded on its shortcomings to include considerations for the return on investment (ROI) of training programs.

As discussed earlier, Phillips’ expanded approach to the Kirkpatrick Model is used to build the Phillips ROI Model. The ROI model of training evaluation that Jack Phillips proposed includes five steps:

  1. Reaction
  2. Learning
  3. Application and Implementation
  4. Impact
  5. Return on Investment

Level 1 – Reaction

At the first level in the Phillips ROI methodology, training managers use short surveys to gather data about participants’ reactions to their training. This step is not too different from the Kirkpatrick Model, but the data gathered here doesn’t offer too many direct benefits to the organization. Positive data on this level is an indicator of how cohesive your L&D strategy is.

Level 2 – Learning

In this step, participants complete multiple-choice questions (MCQs) surveys or quizzes before and after the training. Training managers interpret the responses to determine how much knowledge they’ve acquired. Once again, the Kirkpatrick Model evaluates learning in the same way.

Level 3 – Application & Implementation

Unlike the Kirkpatrick Model, the Phillips Model doesn’t only collect data to find if the training worked or not. The new ROI-based model also evaluates the WHY behind the success/failure of the training.

When a program fails, the Kirkpatrick model data doesn’t tell organizations what went wrong, why it happened, and where it occurred. However, the Phillips Model adds qualitative feedback to the data process to help organizations improve their training programs. Training evaluation teams can thus understand what specific changes to the program will improve its output.

For example, let’s say 50 new recruits in the software developer pool receive training for a new programming language. If they pass level 2 (same for both models), we know they learned the language well. If their assignments don’t produce results due to faulty input data, the Kirkpatrick Model level 3 will only tell you that students failed them. Level 3 in the Phillips ROI model will also tell you the cause of these failures.

Level 4 – Impact

On level 4 of the Kirkpatrick Model, only the business results and impact is measured. The Phillips ROI model expands the focus of level 4 from unilateral results to multi-dimensional impact. The new model lets you analyze the impact of training content and other factors that contribute to participants’ final performance.

In the programming language training example above, the Phillips ROI model could analyze the impact of YouTube creators or other programming trainers on participants.  Companies also use innovative techniques to measure training effectiveness and overall impact.

Level 5 – Return on Investment (ROI)

On the fifth level, the Phillips model uses cost-benefit analysis to map impact data to tangible monetary benefits and a set of intangible benefits. Training managers can use this data to measure and communicate the benefits of their program to other departments in the company and provide hard evidence to executives on the value of their training programs.

How to Calculate Training ROI with The Phillips Model

Throughout the first four levels of the Phillips ROI Methodology, data helps identify reasons for positive or negative ROI in the resulting fifth level. This model suggests that the final ROI of the training program is a result of a series of events:

  • Transfer of knowledge and skills (in level 2)
  • Application of learned knowledge and skills (in level 3)
  • Business impact of training (in level 4)

Assuming the program clears level 1, each next level evaluated under the Phillips ROI Model checks if the change was a result of the program or various external factors.

To show the calculation of ROI under Jack Phillips’ model, let’s reiterate our previous example of 50 software developers receiving training on a new programming language. 

Let’s put the use case through the Phillips ROI model and see how to calculate the ROI of this training program.

Consider these precautions before following the Phillips ROI Model for training evaluation

The Phillips Model presents a complex and sensitive process. Make sure the following conditions are met before you put the process to use:

  • Conduct a needs assessment for your training program. Don’t use the ROI method when no needs assessment data is available.
  • Include one or more strategies to isolate the training effect.
  • Base the estimates only on the most reliable and credible sources.
  • Calculate costs and benefits with a conservative approach.
  • Don’t compare the training ROI with other financial returns until it’s absolutely essential.
  • Don’t isolate the management from the ROI calculation process.
  • Be cautious in deciding what’s measurable and what’s not. Take input from business teams on inclusion/exclusion of sensitive factors.

Step 1 – Gather data before the training starts

Before software developers start their training, they fill out a questionnaire to assess any trends over 6 months until the start. The questionnaire also examines their pre-training knowledge in concepts related to the new programming language. This will help understand how the training program helped different types of learners.

Step 2 – Gather data after the training ends

Post-program data comes from performance records of the company and/or through follow-up questionnaires of the following types:

  • Participants fill out questionnaires
  • The company assesses its performance
  • Subordinates, peers, and supervisors/seniors of participants fill in observational surveys
  • Other relevant internal/external groups.

Collect this data for all model levels as required.

Step 3 – Isolate the effects of lessons from the training program

The Kirkpatrick Model assumes improvements come from the training program. The Phillips ROI Model attempts to find other causes for training results, including the training impact. Some of the possible factors that contribute to improved post-training performance include:

  • Recent performance bonuses
  • Competitive conditions in the company/department (for example, were there any impending promotions after the training program?)
  • Any marketing/employer branding programs
  • Any other seasonal/non-seasonal programs that offered incentives to participants

To isolate the effect of the training program, some techniques include:

  • Trend line analysis
  • Control groups
  • Forecasting models
  • Training impact estimation from participants, supervisors, experts, and customers.

Step 4 – Extract the monetary benefits of the program from the data

After filtering the data and isolating training program effects, the monetary dimension lets us move one step closer to ROI.

In the example of training on a new programming language, we assume a profit of $5,800 per developer from the new project that employs 50 trained developers. This profit margin considers the effect of only the training program; overall profit figures may be higher due to other factors

Total profit from the training program = $5,800 / developer X 50 developers = $2,90,000.

Step 5 – Add up all program costs

This is a straightforward calculation that brings together all costs for the training program. The total program costs will be a summation of the following categories:

  • Costs to design, develop, and administer the program (including payment to training staff and their travel, lodging, and miscellaneous expenses)
  • Training venue costs
  • Training material costs (physical paper, electronic hardware, training, and evaluation software, and other administration costs)
  • Travel, lodging, meal, and miscellaneous costs of participants
  • Salary of participants and their employee benefits for the time they will devote to training
  • Other administrative costs incurred during the training program.

In the example of training on a new programming language, let’s assume the total program costs were $2,34,900.

Step 6 – Calculate the return on investment (ROI)

ROI (%) = (Net benefits of the training program / total program costs) X 100

= (($2,90,000 – $2,34,9000) / $2,34,900) X 100

= ($55,100 / $2,34,900)  X 100 = 23.457%

Step 7 – Find the intangibles

A training program will have more than monetary benefits alone. Such intangible benefits are often more valuable than the hard data coming out of the ROI calculation process.

You can identify such abstract measures at any stage of the ROI calculation process through discussions with the project’s sponsors.

  • during the needs assessment
  • when you convert data into monetary values (step 4 in this section)
  • in a separate follow-up evaluation.

Each program type will have its own set of intangible benefits. The table below mentions the common categories.

Benefits category Relevant indicators
Customer service Customer satisfaction surveys, customer complaints, customer response time.
Employee satisfaction Attitude surveys, employee grievances, discrimination complaints, stress reduction, organizational commitment
Employee withdrawal Employee churn, absenteeism, transfer, tardiness
Team effectiveness Quick decisions, smooth communication, reduced conflicts, better cooperation

Phillips ROI Model Calculator

(A summation of design and development costs + venue costs + training material costs + travel costs + other administrative costs)
Net Program Benefits: $10,000.00
ROI: 200.00%

Advantages of Using the Phillips ROI Model for Training Evaluation

It’s best to compare the Phillips ROI model with the Kirkpatrick Model to bring out the advantages of the former.

1. Traces the complete chain of impact

According to Jack Phillips, the model’s creator, the business impact observed in level 4 and the ROI calculated in level 5 are not independent. Data across all preceding levels affects the final ROI produced by the model.

A chain of impacts develops as participants gain skills and knowledge (level 2), apply them on the job (level 3), and generate business impact (level 4). So, measuring data across all levels helps evaluate the training program with high precision.

If level 5 produces positive ROI, data from past levels will show the specific impact of the training program without any other factors. Without this data, the success of the training program would only be guesswork.

Also, detailed data from the chain of impact allows the training program to be debugged if level 5 produces a negative ROI figure. Training managers can pinpoint the exact reason for failure.

None of this is possible with the Kirkpatrick Model.

2. Measures intangibles

The Phillips ROI model accepts that you cannot measure certain outcomes in monetary value and the final ROI won’t represent such outcomes.

Outcomes such as customer satisfaction, employee satisfaction, and team bonding are hard to measure in numbers. Therefore, the Phillips Model measures such “soft” outcomes in addition to “hard” numerical outcomes.

The Kirkpatrick Model measures business impact in only numbers and does not consider intangible benefits during evaluation.

Disadvantages of Using Phillips ROI Model for Training Evaluation

While the Phillips Model is a significantly better way to evaluate training programs than the Kirkpatrick Model, it is not without its fair share of criticisms.

1. Late measurement of ROI

The ROI of a training program evaluated with the Phillips Model is not known until the training program is over. It would be impossible to make changes if we find out that the training program was a failed project after the project is over.

Jack and Patti Phillips address the problem of delayed ROI in their 2010 book “The Consultant’s Guide to Results-Driven Business Proposals: How to Write Proposals That Forecast Impact and ROI”.

This book presents strategies to help estimate ROI, determine goals, plan execution, and set a budget for a training program. These strategies help to predict training outcomes before the organization decides to make a large financial commitment.

2. Useful for only 5-10% of training programs

The Phillips Model provides more than enough data until level 4 to know how successful or unsuccessful a training program is. The ROI calculation in level 5 is good to know, but it’s not necessary in most cases.

According to Jack Phillips:

    • All programs need level 1 evaluation
    • About 90% of programs need level 2 evaluation
    • About 30% of programs need level 3 evaluation
    • 10-20% of programs need level 4 evaluation
    • Only 5-10% of programs need level 5 evaluation

Various factors such as visibility of the training program, its goals, and its costs will decide if a level 5 study is necessary. Jack also remarks that these 5-10% of programs are usually the most expensive training programs with the largest audiences and an extraordinary amount of time and resources.

With the Phillips ROI model, you get precise data on how effective your training program is and how much profit it can generate. It also allows you to gauge intangible benefits arising from your training programs. Impact and ROI forecasting strategies can help you predict which profitable training programs to start and which unproductive ones to drop.

Drive Training ROI with Whatfix

The Phillips ROI Model provides a powerful framework for proving the financial value of your training programs, but measuring ROI is only half the battle. To actually maximize those returns, organizations must move beyond traditional, forgettable training methods and adopt strategies that guarantee knowledge retention and application.

When training directly translates into improved productivity, fewer errors, and lower support costs, your Level 4 (Business Impact) and Level 5 (ROI) metrics will naturally soar. That is where a digital adoption platform (DAP) becomes your ultimate L&D asset.

Whatfix helps L&D leaders transform static learning into hands-on practice and guidance in the flow of work that drives training ROI. With Whatfix, you can:

  • Improve user readiness pre-launch: Leverage risk-free simulation training and AI roleplay so employees can master complex software and soft skills before they ever touch a live system.
  • Provide guidance in the flow of work: Replace lengthy manuals and classroom sessions with interactive, step-by-step walkthroughs that guide employees through processes exactly when they need to perform them.
  • Offer self-help support at the moment of need: Empower users to find answers instantly through an integrated knowledge base without ever leaving their applications, drastically reducing friction and IT support tickets.
  • Identify training improvements and gaps with analytics: Track user behavior, drop-offs, and engagement to pinpoint exactly where employees are struggling, allowing you to continuously optimize your training content and maximize its impact.
  • Accelerate time-to-proficiency: Cut down on direct training costs and time-away-from-desk by delivering contextual, bite-sized learning that makes employees productive from day one.

Ready to see how Whatfix can transform your training outcomes and prove your L&D impact? Request a demo today!

FAQs
While the Kirkpatrick Model evaluates training across four levels (Reaction, Learning, Behavior, and Results), it stops short of measuring exact financial returns. The Phillips Model introduces a fifth level specifically designed to convert those Level 4 business results into a quantifiable, monetary ROI percentage.
To calculate training ROI, you first subtract the total program costs from the total program benefits to determine your net program benefits. Then, you divide those net benefits by the program costs and multiply by 100 to get your final ROI percentage.
No, calculating ROI is resource-intensive and should be reserved for high-cost, highly strategic, or highly visible training initiatives. For standard compliance or basic onboarding courses, measuring up to Level 3 (Behavior) or Level 4 (Business Impact) is usually sufficient.
A negative ROI isn’t a failure; rather, it provides actionable data indicating that the program’s costs outweighed its direct financial benefits. L&D teams should use this insight to identify bottlenecks, reduce delivery costs by utilizing tools like digital adoption platforms, or redesign the training to better target actual business needs.
DAPs improve training ROI by replacing costly, forgettable classroom sessions with contextual, in-app guidance that accelerates an employee’s time-to-proficiency. Because employees learn in the flow of work and make fewer errors, organizations see a much higher business impact alongside drastically lower training and support costs.
Table of Contents

Accelerate Software Adoption with Whatfix

Deliver in-app guidance. Train faster with AI simulations. Optimize workflows with analytics.

Get started now

Smarter adoption strategies, right to your inbox.

Tap into exclusive insights from the digital adoption experts with our newsletter.

module-transition
whatfix-g2-review
Software Clicks With Whatfix
From contextual in-app guidance, simulation training, AI roleplay, and workflow analytics, Whatfix is a unified digital adoption platform to ready users, govern workflows, drive adoption, and maximize enterprise software ROI.