Generative AI to create interactive content that supplements Pressbook

Like everyone else in this community, i’ve been impressed with @cogdog 's work with H5P to add interactivity to textbook materials.
Today, i found this post on LinkedIn: How to turn academic papers into games with AI | Ethan Mollick posted on the topic | LinkedIn In it, Prof. Ethan Mollick (Wharton School, heavily invested in building bridges between highered and AI) demonstrates using AI to generate an educational game that is generated by uploading a paper to a generative AI, and then prompting it to create some game based on the content of the paper.

The approach reminds me strongly of H5P interactive gadgets, which were created largely to foster text comprehension and retention.

I have yet to test whether the H5P format specifically works, but i wouldn’t be surprised at all that it does. And maybe that doesn’t even matter if embeds that are not H5P are possible where the textbook are posted.

The scenario i’m thinking of is having AI systematically generating interactive games at the end of every chapter of a Pressbook/Openstax resource. This would help learners self-assess concept retention and such, thus improving learning.

This would eventually work in any LMS, of course.

As usual with AI in these early years, a human would have to check for hallucinations, verify that key ideas are well represented, etc. Or you could add a subroutine to have users report issues…

Thanks Vahid- whether one wants to have this done automagically is one thing, but there has been much folks have done using GenAI to create H5P content.

There was/is the “Smart Import” capability on H5P.com that looks like it uses GenAI to create H5P content types from uploaded documents or chunks of text. So that capability is sort of there.

Also, the founder of H5P Svein-Tore Griff (aka “Falcon”) has done many demos, a big one at a recent MoodleMoot, on prompts that can be used to reate the content types that have a specific text structure.

It’s basically a prompt that prescribes the text format of the output.

See

And I am not finding now, but there was a handful of startups selling tools to do this.

I would say yes, something likely could be done as additional practice at the end of a piece of content/chapter, that might generate activities based on the content looks technically feasible.

1 Like

… all subject to accessibility requirements.

1 Like

Why is someone not vibing this in the mix? :wink:

1 Like

We have an approach to using AI to generate H5P in the works. Well, technically it’s an approach to generate Quiz content that can then be converted to H5P (or any other format you may want).

Here’s a quick video overview:

While it’s still in it’s early stages, the idea is to allow AI generated (OE)resources to be format agnostic - e.g. let the end-user decide which format they need it in. This might help someone create an accessible alternative, for example.

2 Likes

That’s beyond impressive, Yasin. It’s been too long since we talked about Learnful. I’d definitely be keen to have you perhaps do a live demo sometime (if interested) for our OEG live series.

So some questions:

  • Is there a corpus content Spark Studio is trained on, that its drawing from, or is it all from OpenAI? You mentioned that it aligns with a set of subject areas, which sounds to me like it is somehow tuned to educational content, not just the big vat of internet.
  • What varieties of H5P content types can it generate? Is it mostly the bread and butter basics of multiple choice, fill in the blank, does it do more?
  • I know its just a demo, but wondering how specific one can get on the prompt-- Just asking for a quiz on Managerial Accountability seems very general, and it might not have much relevance to my course or student body. Do you get very detailed on the ask for the quiz?
  • I am very appreciative that it generates the H5P metadata as in my experience of looking randomly at H5P collections, most metadata is incomplete.
  • And also that it generates the feedback, again, contextual feedback when I last was seeing H5P content was sparsely done.
  • Does it do any content with generated images? And thus likely it would generate metadata and alt-text?

To me I can see it maybe as a first cut for building a quiz or practice set- nothing stops an educator from opening it in H5P and tailoring it to their content, course.

Thanks again for sharing the video (sorry I just edited your post to put the YouTube URL on a blank line so it autoembeds)

1 Like

Hi Alan,

I’d be thrilled to do a live demo - the platform needs a bit more time in the oven and I plan on inviting testers in a few weeks, so maybe once we get passed those milestones we can schedule a more open demo :slight_smile:

Re: your questions:

  • The demo makes use of GPT 4o-mini. The platform is model agnostic and the entire app or each individual tool/agent can use a different model. We don’t have any plans to create our own trained model, but we would like members to create their own Knowledge Base which can be used as context within each tool call.

  • Currently only H5P Quiz (Question Set) is configured. We have some good progress on Course Presentation as well. Eventually all types will be available, but this will likely take time. Planning on getting the community to help prioritize which types get integrated first.

  • Yes, the prompt can be very long (~10 pages). We will also enable file and link integration into the prompt. Integration into the Knowledge Base a user can create is our final goal.

  • Auto-population of the metadata is my favourite part - I like to think that this will take the guess work out of making something “open” and let folks just create and share.

  • Currently each tool works in isolation and is purpose built for a specific task, so Quiz Generator only generates a specific format for a quiz. We have text-to-image and image-to-text tools as well - again they work in isolation. We do have designs for tool-within-tool integration and AI tools directly within the H5P editor. Also, I should mention that Tools can be created by users using a no-code interface. The goal is to let folks build the tools they need and even share these tools openly.

To me I can see it maybe as a first cut for building a quiz or practice set- nothing stops an educator from opening it in H5P and tailoring it to their content, course.

^^ Yes, that’s exactly the goal - let AI handle the first draft to save time, fill in metadata, and spark ideas. The output can be easily converted into flexible formats like Word, H5P, slides, etc., depending on how the educator wants to use it. There’s nothing stopping them from opening it in H5P, editing questions, adding multimedia, or aligning it more closely with their curriculum. It’s about giving educators a head start without taking away their ability to customize or the need for their intervention.

The AI draft, the prompt, and the “finalized” resources are all connected and discoverable in the repository - letting others expend, remix, reuse as they need.

1 Like

Awesome, Will you ponder a Tuesday in August that works? I am scheduling out a series of Live Demo Webcasts “no dead slides just live screens”? I will reach out by email.

1 Like