Thanks @GenefaMurph976 . Of course, it would need a good use case workflow. Here is one idea of what it could look like. In brief:
Two pages, A is the main page, B is the alternate.
B page is deactivated by default, can be activated by the instructor.
If B is activated, each of A and B are shown 50% of the time by Udemy.
On the conversions statistics page, if B activated for a given course, two lines are shown with the conversion statistics for A and for B.
One could improve this easily, probably innovate for some time.
Release V2: On each page, a copy button. On the B page, "Copy A to B", for when the instructor wants to modify their usual A page on the B page. And on the B page, "Copy B to A", for when the B page is found to work better and the instructor want to make that the default A page.
Release V3: Every time the B page is activated, or changed, Udemy resets conversion comparison statistics and starts measuring the difference in performance, and provides an email when appropriate to the instructor such as:
"A meaningful number of visitors has been tested on both your A and B pages, and we thought you would want to know the A to B conversion comparison is 5.6% to 6.2%, so the B page is 10.7% doing better. You may wish to copy your B page to your A page and deactivate B, or copy B to A and then modify B further to see if you can get an even better performing B page. Since B is outperforming A by a significant percentage, if you do not make these modifications yourself within five days, we will swap the A and B pages and deactivate B for you, and notify you by email."
Or the very similar, but if B is not doing better: "A meaningful number of visitors has been tested on both your A and B pages, and we thought you would want to know the A to B conversion comparison is 5.8% to 4.9%, so the A page is doing 18% better. You may wish to deactivate your B page or make further modifications to reset the conversion comparison. Since B is under-performing A by a significant percentage, if you do not make further modifications to B to reset the test or deactivate B within 5 days, we will deactivate B for you and notify you by email."
Many of the instructors on Udemy are more than sophisticated enough to use this A/B test functionality to steadily improve their landing page. This would result in steadily improving conversion statistics, and benefit both Udemy and instructors.
If only we had data, we would no longer be blindly making updates to our landing page, with no idea if they are improving conversions, and perhaps half the time probably just making conversion worse.
Thanks, Bill
... View more