📊 Introducing A Powerful New Insights Feature for Instructors 📊

Hi @MarinaT ,

I have been using this over the past day, and it can give some good feedback.

When you use the AI Assistant, you are given sample prompts, and a lot of the feedback is in fact the prompts. Unless, of course, someone did ask the AI to give it questions which “test higher cognitive levels based on Bloom’s taxonomy”. ;-)

One important and easy to overlook feature is the date range in the top-left hand corner. I have gone through all of my courses using "Last month" and "All time" for different insights.

Having reviewed all of the "All time" insights, I think I will be using it once a month and using the "Last month" date range.

I'm hoping they can do similar with the notes that students leave in the videos. That would be useful feedback as well - at the minute, all we can see are that "18 people have left a note here", which is not helpful.

Kind regards,

Phillip

Hi @PhillipBurton,

Great to hear you’ve already had a chance to explore the AI Assistant Insights feature, and even better that you like it!
I completely understand your point about notes being helpful for instructors. I’ve shared your feedback with the internal team, and we’ll see if they will develop something along those lines.

Fingers crossed!

This looks like it could be very useful. Quick question, are the 'Sampled Interactions' just 'examples' or actual insights?

GREAT!,

Big Hug Marina and GOOD LIVE TO RESSTLESS MINDS!

Looks like it could be a great feature. Will the ability to see the AI responses to these interactions be added to this page?

I checked out the AI Insights. There were only a few suggestions there, which is (probably) a good thing as it does not overwhelm me. These insights are definitely useful and specific enough to be actionable.

I am looking forward to see more insights as the tool learns more from the student interactions.

In addition, I have to say, it is so much more to see a distilled version of what students want and what they struggle with, rather than trying to develop these insights manually while trying to help students.

Nice work team :-)

I also checked it out. It seems to be very helpful in the long run.

As an instructor, knowing which questions students ask about a course will be valuable. So, I can see what they are looking for and tailor my courses accordingly.

Thanks to the team!

Hi @Robin_Slee,

We're glad to hear you find this tool helpful! To answer your question: Yes, those are real questions learners have asked. However, they’ve been paraphrased slightly to protect the learners' anonymity.

Hi @KylePew,

Thank you for your feedback. I get your point, that it would be helpful to see the AI assistant’s output alongside the questions students are asking. I’ll forward this to our internal team, and we’ll keep you updated!

Hi @peter_dalmaris,

Thank you for your feedback! 😊 We know you have a lot on your plates, so we aimed to provide insights that are useful and easy to digest. It's great to hear it worked! If there’s anything else you’d like to see, please feel free to share.

Hi @MarinaT,

Thank you for the update. I’m wondering if we’ll be able to see student actions after they interact with the AI, specifically, whether they continue with the lecture or quit. For example, if a student asks for a course summary, it would be valuable to know what they do after receiving the answer. This kind of insight would help us understand not just what they ask, but also how it influences student behavior like completing a lecture or starting the full course.

Hi @EvrimKanbur,

Thanks so much for your thoughtful comment! I totally see how understanding what learners do after interacting with the AI-assistant would be helpful to you. I’ll pass your suggestion along to the team, and we’ll keep you posted on any updates 😊.

Hi @EmreYilmaz,

So glad to hear you found it helpful. I’ll definitely pass your feedback along to the team, I’m sure they’ll appreciate it.
If there’s anything you feel is missing or would like to see added, feel free to share!🙌

Thanks

@MarinaT the title of the post is "Introducing Two Powerful New Insights Features", but you mentioned only one.

What's the other insights feature?

Hi @MichaelPog,

Thanks for flagging this! The headline was updated to better reflect the content of the post.
Apologies for any confusion caused.

Hey @MarinaT I get "No data available. There is not enough learner interaction data to report for the specified time period. Please select a different time period or come back later." What do I need to do to benefit from this new feature?

Thanks for letting us know @MarinaT!

It looks really powerful, happy to see more AI features on Udemy as it's the new era of doing things with it :)

Best Regards,

Krystian Wojtarowicz

I have tried out the AI Assistant and I am very impressed. It works very well. I am skeptical of these things in general, but I am sold on this. I went to my wife's computer (yes, she bought a few of my courses) and as a student I went to a lecture on motivation and asked a question to see if it answered using the material in my course. In a lecture on stimulus control (antecedents to behavior) I asked "how does stimulus control impact the motivation of a software engineer?"

The first thing that appears is the statement "I'm searching the content of this course for the best answer for you." Then it delivers an answer that is from my course and as good an answer as I could have given myself. The fact that the Assistant is drawing answers from my course is the most critical thing. This was my concern about the Role Play feature. I think this AI Assistant is much more important, useful, and will impress students and clients.

Congratulations, Team!

Hi @SoyMarketer,

Thank you for your great question! Have you made sure to select “All Time” in the timeframe setting? If so, it’s possible that there hasn’t been enough learner interaction with the AI assistant yet to generate insights. We recommend continuing to check back periodically. Interactions may start appearing over time as more learners engage.

Hi @LawrenceMMiller,

Thanks so much for your kind words. I'm glad to hear the AI Assistant made such a strong impression! I’ll pass your feedback along to the team. I'm sure they’ll be thrilled to hear it.

Hi @MarinaT,

Thank you for the update :)

Hi @Jilsonrs,

You're very welcome! If there's anything you'd like to see added to this feature, feel free to share your thoughts 😊.