The Pulse of Higher Ed

Perspectives on Online and Professional Education
from UPCEA’s Research and Consulting Experts

When Institutions Shop Themselves: What We Learn—and Often Miss

A person (Jim Fong) smiling

By Jim Fong

As my retirement last year eases into a stage of semi-retirement or what some have labeled as “micro-retirement,” I have had eight months of reflection on my nearly four decades of doing research. After a few months of total abstention, I could no longer keep myself away from the higher education field that I so loved. I slowly eased myself back in by casually reading articles, blogs, and research papers. Then, I read the UPCEA Secret Shopping Benchmarking Report and went down a rabbit hole I should not have.  

I started reflecting on my early market research career, some of which included corporate mystery (or “secret”) shopping analyses. I remember sending teams of people to hotels for check-ins, malls for shopping experiences, restaurants for dining and service engagements, and to car dealerships to test the customer service process. For every client, despite each having a strong plan or strategy, either something was broken or the competition was outperforming them. More recently, I remember the institution that called me on average three times a day for three months to see what my interest was in a data analytics degree. 

Secret shopping is still relevant, as it unmasks problems, shortcomings, and opportunities. While it is a simple concept, given the amount of disruption in higher education and the lack of true knowledge regarding generational behavior, secret shopping and understanding the consumer purchasing process is probably more critical today as it would have been decades ago. Today, we are in a market that is shrinking by some definitions, while pre-Millennium was a major growth market for higher education and mistakes could be made. 

The UPCEA report is important because customers and students are a precious asset, the lifeblood for colleges and universities. Every long-term profitable student and potential student lead should matter. While I am sure to irk the purest academic, “profitability” does not always mean dollars and cents in every case. Every profitable student helps contribute toward a long-term sustainable model. One important statistic from the UPCEA study is that 44% of inquiries go unanswered. This is a lost opportunity, impacting not only profitability, but institutional reputation. 

Responding to the inquirer and potential student is also important given the technology and artificial intelligence tools upstream or at the top of the enrollment funnel. In numerous articles and blogs, Will Scott of Search Influence points out that many colleges and universities are getting leads driven to them through AI-enhanced search or other tools.  As a result, we no longer have the luxury of a three-strikes-before-you’re-out approach. We need to understand the potential student immediately. We need to engage them more efficiently and effectively. As a result of upstream AI, they are likely to be more informed and a better match for the institution and thus more prepared and ready to make a faster purchase decision. This is further supported by a recent EducationDynamics study that shows that potential students apply to two schools on average.  Shockingly, 45% apply to just one. This implies either greater readiness or frugality. Institutions need to be ready to not only persuade the searcher, but also to close the deal with the more informed. 

The UPCEA report shows some shocking numbers regarding institutional follow-up using technology or via a human response. For example, nearly two thirds of email inquiries went unanswered, as compared to 37% originating through a request for information (RFI) form. It also highlights the numbers and percentages of those using advanced enrollment tools, as well as response times. As compared to past UPCEA studies, response times have gone in the wrong direction, increasing from just over 7 hours in 2023 to 14 hours in 2025. Every college or university, especially those serving adult and corporate learners, should have a plan or goal for how they respond, how fast they should respond, what metrics are considered good and what their goals and aspirations should be. We are in a time of chaos right now, with many factors out of our control. Managing the lead generation and nurturing process should not be one of them. We have the capability and resources to manage our own processes and should do so with intention and strategy. 

For 2026, what can institutions do?  

For starters, an institution should consider shopping itself with the intent of fixing processes. However, when doing this, the institution needs to be careful and not weaponize the data. The impact of secret shopping can be significant, but also destructive if not managed correctly. When institutions embark on a secret shopping initiative, those managing the process will be eager to immediately fix things and react, often forgetting about the impact to individuals. UPCEA can help you manage your own secret shopping initiative and guide you through the process. 

Another consideration would be to secret shop the competition to better understand their approach and strategy. This too is an area to avoid weaponization. I’ve seen College A do this and run to staff or leadership saying “University XYZ does it this way and we should as well.”  While it may be true, it may be off strategy for College A. 

Upon completing a secret shopping initiative, key staff need to objectively map out the results and identify process improvements. Before, during and after process improvements are being put in place, metrics and realistic goals need to be put in place. 

Secret shopping, on the surface, seems easy, but can have meaningful, long-lasting results if done correctly. A successful secret shopping initiative can strengthen an institution’s efforts, improve student relationships and lead to a more streamlined process. 

 

Jim Fong is the Chief Advisor for Research, Strategy, and Innovation and a Strategic Advisor for UPCEA Research and Consulting. To learn more about UPCEA Research and Consulting, please contact [email protected]. 

 

Authored by

Learn more about UPCEA's expert consultants. 

Do you need help with your PCO unit or campus? We can help. Contact UPCEA Research and Consulting for a brief consult. Email [email protected] or call us at 202-659-3130.

Trusted by the nation's top colleges and universities, UPCEA Research and Consulting provides the best value in the industry today. UPCEA's industry experts have years of experience in Online and Professional Continuing education - put them to work for you!

UPCEA Research and Consulting offers a variety of custom research and consulting options through an outcomes-focused pricing model. Find the option(s) that best suit your institution.

Learn more about UPCEA Research & Consulting


The UPCEA Difference

Unmatched Experience: For more than 100 years, UPCEA consultants have exclusively served the needs of online and professional continuing education programs. UPCEA consultants leverage their extensive industry expertise to expedite solutions, anticipate upcoming shifts, and offer distinct best practices, effectively aiding clients in achieving their goals.

Cost Effectiveness: As a nonprofit, member-serving organization, we provide unmatched value, allowing you to maximize limited research and consulting budgets.

Action in Motion: Our cadre of experienced, skilled authorities and expert practitioners propels you forward, translating research and consulting into impactful implementation, a distinctive hallmark of UPCEA. Our team of current and former institutional leaders will support you, turning research and consulting into action.

Mission Alignment: Like you, our mission is to enhance and expand educational opportunities and outcomes for adult and other non-traditional learners. We share your values and work in partnership with you to advance access and excellence in education.

Other UPCEA Updates + Blogs

COLO Compass | Who Leads Next? Building the Pipeline of Online Leaders

COLO Compass: Evidence and practical direction for chief online learning officers. Throughout National Distance Learning Week, I’ve written about how much online learning leaders are now expected to handle: AI governance, the financial case for online education, relationships with policymakers, financial aid fraud, and operations that extend well beyond their own units. The question for…

COLO Compass | The COLO’s Job Got Bigger. Has the Authority Kept Up?

COLO Compass: Evidence and practical direction for chief online learning officers. When UPCEA published its 2016 Hallmarks, online education was still moving from innovation to mainstream adoption, and a central challenge was legitimizing it. The 2026 Hallmarks of Excellence in Digital Learning Enterprises begin from a different premise. As Vickie Cook, a contributing editor of…

COLO Compass | Sustaining Online Learning Takes Evidence Inside and Out

COLO Compass: Evidence and practical direction for chief online learning officers. National Distance Learning Week runs November 2 through 6, and one of USDLA’s themes this year is the “Sustainable Future of Distance Education.” For those responsible for online enterprises, sustainability means having the financial resources, operational capacity, and institutional support to continue serving learners. …

COLO Compass | The COLO as Institutional Integrator: When Online Learning Is Everyone’s Business, Who Leads It?

COLO Compass: Evidence and practical direction for chief online learning officers. For years, one of the challenges facing online learning leaders was convincing the institution that online education belonged in the mainstream of academic life. That argument is increasingly behind us. Online learning now intersects with enrollment strategy, academic planning, technology, student support, workforce development,…

COLO Compass | Advancing AI Starts With How Your Institution Decides

COLO Compass: Evidence and practical direction for chief online learning officers. National Distance Learning Week runs November 2 through 6 this year. USDLA’s 2026 theme includes advancing AI, global education through open educational resources, and the sustainable future of distance education. For those of us in online and digital learning, the past three years have…

ED Issues Workforce Pell FAQs; Courts Continue Changing Professional Degree List | Policy Matters (October 2026)

Major Updates U.S. Department of Education Provides Workforce Pell Grant FAQs The U.S. Department of Education has released FAQs on Workforce Pell Grants for short-term programs. The guidance covers items like the baseline eligibility standards: programs be at least 8 but fewer than 15 weeks or 150 to 599 clock hours and operational for a…

The Nation's Top Universities Choose UPCEA Research and Consulting

Informed decisions. Ideas that work. The data you need. Trusted by the top universities in the nation.