Many of us use AI to create summaries of meetings and research reports, but I often don’t know if the people sharing the information have checked the text for accuracy. George Veletsianos provides a brilliant checklist and sample text to add to the AI summary to help readers understand the the accuracy. Thank you! Link to the open access editorial & checklist: https://doi.org/10.1007/s11528-025-01127-4
1 Like
Thanks Doug, the thing is when you initially review a summary it often does feel like a reasonable review. The question is how deep a review is done? Thanks for the reference to George’s paper, that checklist looks like a reliable process.
The riddle is, one you go through this work to check and review, is the end result truly one that has “saved time” versus a human summary (which itself calls for review and fact checking regardless)?
That’s the initial assumption isn’t it? That the time for creating the prompt and checking the accuracy of the AI generated summary is about the same effort for a human to create the summary. I’m finding that if I tell my expectations in the prompt, and dangers to look out for f the accuracy is exceptional. Human biases and machine biases do have different perspectives. Of course we need to be familiar with the article and therefore be the final gatekeeper. I am finding it is faster for the AI to the corrections once identified as well.
My use case is to create a video of the journal article because just feel people in my course won’t read the assignment due to English being their second language. After creating the summary and checking it, I asked GenAI, Claude, in my case create a video script based on the summary to create a max 5 min video. Once I checked the script and adjusted the timing and visualized a storyboard, I used the text as the narration in a AI generated video program with and without Avatars. I found the participants were able to retain the concepts better with the summary + video than reading the original English article. That was my goal - better retention of the concepts. Creating a video from the summaries requires some advanced knowledge and experience on communication strategies and instigates some good conversations.
1 Like
Thanks for the specific example from your own teaching, Doug. In the end, seeing that your students’ understand was better and that it stimulated more conversations is the best result. It’s helpful to hear your process.
Thanks Alan, I appreciate your comments, I will continue to also think about George’s check list to integrate in my projects too.