This article originally appeared on The SmartVideo Blog as How You Should Be Measuring Business Video Impact posted by James Dicso on April 18, 2012, and is republished here through a content partnership with SundaySky
Companies want to prove that business video delivers a measurable financial impact to justify the investment.
In the current online business environment, all companies need to invest in solutions that have a clear and measurable ROI and payback period. Sure, vendors of business video solutions tout the impact of video on targeted business metrics, such as conversion rate, churn rate, engagement rate, call rate, and customer satisfaction as drivers of ROI. But, do they prove that business video is actually delivering these results? If vendors only compare the metrics of video viewers to non-viewers, without controlling for volume of video views and the effects of self-selection bias, the actual ROI results will be inaccurate.
True SmartVideo solutions are designed to address these concerns. Every program starts with defined goals that are measurable. The initial phase of the program includes a persistent control group that separates visitors into a test group (has access to video) and control group (no access to video). Performance of the video group vs. the control group is measured for each metric. This addresses the volume of video views on the total performance and also controls for self-selection bias. The aim is to measure transactional impact (short term) and lifetime impact (longer term) on key metrics.
I’ll use an example to illustrate these points.
A common statement is that “video-viewers convert at 3x the rate of non-viewers”. If non-viewers convert at 2%, this means that video viewers convert at 6%. Without using a control group to address video view rate and self-selection bias, the ROI projections would not be accurate or realistic. Consider the below visual.
This illustration demonstrates the impact of self-selection bias on the test visitors who don’t view video (slightly lower conversion rate) and also reflects the impact of scale of visitors who choose to view the video. Although video viewers convert at 3X non-viewers, the actual lift in conversion is 5% when comparing total video group vs. control group (2.1% conversion rate for the video group vs. 2.0% for the control group).
To effectively measure impact of business video, it is critical to define the success criteria and metrics before kicking off the program. Then, establish a control group to measure the overall effect of video on the target metrics, instead of measuring only actions of video viewers vs. non-viewers.
Is your business video program delivering measurable financial impact? If not, consider adopting a SmartVideo approach.
Visit The SmartVideo Blog for current articles or subscribe the RSS Feed
SmartVideo delivers a compelling, personalized, real-time video experience designed to reach people with what they need to know in the most engaging, entertaining and informative way possible. SundaySky’s innovative convergence of technology and creativity has advanced the use of SmartVideo to more effectively engage people at every step of the customer lifecycle. Our platform generates hundreds of thousands of SmartVideos daily that attract traffic, retarget prospects, convert prospects to customers, support customers and enhance customer relationships. SundaySky SmartVideo users include leading consumer-facing organizations like AT&T, Office Depot and Tiger Direct. Follow SundaySky on Twitter and Facebook.