Tuesday, August 17, 2010

Real-time lecture input using Google Docs

As a lecturer, I constantly struggle to optimize audience engagement while teaching to the level of the learners. What added value does my lecture provide beyond the learner simply reading a textbook chapter on the topic? Am I covering topics that are too basic or too advanced?

What's been done?
  • I have seen a few multi-day CME conferences end each day by answering anonymous slips of paper with questions from the audience. Great idea, but more engages audience AFTER rather than DURING the talk.
  • I have used the audience-response system (ARS) that allows audience members to vote on multiple-choice questions. Cool engaging concept, but requires some tech setup and equipment.
  • I have heard of people using Twitter feeds in the background on a second projector keeping track of audience conversations and questions. I can imagine that this can be quite distracting, especially not managed well.
A nifty trick: Use Google Docs in realtime

Recently at our residency conference, I gave a talk on Acute Limb Ischemia. Since our EM residents are so easy-going, super-smart, vocal, and ready to try anything, I felt safe trying out a new teaching approach.

After presenting a brief sample case of a patient with acute leg pain, I displayed a URL link to a public Google Docs page that I created the night before. To eliminate technological barriers, I made this page completely public. That means you don't need a login to view or edit the document. I then asked the residents to input either a burning question that they had or an important learning tip about acute limb ischemia.

See the page:

What happened after I gave out the link? You could see the residents immediately typing away on the screen (see below). Each user had a different cursor bar color. Letters were flying across the screen throughout the document in real-time. It was totally amazing. For instance, there were 5 users on this screenshot.


At the upper right corner of the screen, you could see how many people were actively viewing the document.
At the end of the talk, I read aloud the questions and launched into my talk. I specifically referenced the questions when I got to the appropriate areas in my lecture and spent an extra minute more than I had planned focusing on the issue. And finally, at the end of the talk, I returned to the questions on the Google Docs page to make sure that all questions were answered.

Overall, I think this approach went over surprisingly well.

Some reflective thoughts:
  • This real-time, free-form approach requires audience members to be online.
  • Only 50 people can edit simultaneously.
  • This approach is a great way to engage the learners and for me to assess their baseline knowledge. Because the questions can be submitted anonymously, no one has to feel shy or stupid for asking what they might consider a novice question.
  • The approach is a little risky, as a speaker, because you may not be able to answer the questions. Fortunately, there was always a resident or faculty member with the answer.
  • There is definitely the uncomfortable feeling of not being able to plan exactly how your talk is going to turn out. As a speaker, you have to be flexible.
  • You have no control of what the audience writes. If you are really concerned about this, you can have a "patroller" to watch for inappropriate comments. In this case, the residents policed themselves.
  • Caution: This document is at risk of being deleted by any user. Because document access doesn't require a login, anyone with the link has total administrative control of the document.
Has anyone else used Google Docs or other interactive feature in their talks?

10 comments:

  1. You will now think I am a stalker but when it comes to IT and medicine... I just can't shut up!

    You can even take this online collaboration a bit further, allowing users to vote up and down questions so that the ones the audience finds most important get answered first... Check out Google moderator for that!

    http://www.google.com/moderator

    ReplyDelete
  2. Hey David: I always look forward to your comments and insight into IT and medicine. I saw google moderator a while back when the White House and U.S. senate used it for their website to encourage public comments. It is also huge in soliciting for solutions to the BP's oil spill.

    I'm still a little torn about having a background discussion going on in the background of a talk. Trying to minimize too many distractions. That being said, I didn't know that there was a feature to move Q's up and down the priority list. Will investigate more. Thanks!

    ReplyDelete
  3. Great tip Michelle as always - thank you! Was the room set up with computers or did the participants use their own iPhones etc. ?
    Cliff

    ReplyDelete
  4. Cliff: I loved it! The conference room is set up with wireless. Almost all our residents are using laptops during conference -- taking notes, looking up answers to questions, and likely the occasional Facebook check-in. So their hitting a Google Docs URL link wasn't a big deal. I don't think they used their iphones.

    ReplyDelete
  5. Love the idea. I've floated this type of thing for didatic lecture in PA school, initially my idea was to use google forms/spreadsheets to poll the class. This way you could have more than 50 responders. Have you tried this with any success?

    Gabe the PA student

    ReplyDelete
  6. Hey Gabe: I haven't used the other Google options, although I think Google Spreadsheets also has a limit of 50 simultaneous users. Two options that I can think of: 1) Have users ask their questions and then close their link so that others can type. 2) Create multiple open Google Docs (perhaps 1 for the front half of the room and another for the back half of the room). You'll just have to toggle between the two forms.

    If you were just polling the class, you can definitely use Google Forms. I, however, wanted to get more free text questions before the talk started. You should try it out! I really loved how it got the audience invested in the talk.

    ReplyDelete
  7. Very cool idea- thanks for sharing Michelle.
    Chris

    ReplyDelete
  8. Thanks! I'm hoping to use it again in the near future. May incorporate Google Forms, as Gabe suggests.

    ReplyDelete
  9. +1 for Google Moderator. This is EXACTLY what it was made for.

    ReplyDelete
  10. @nerdalert: Thanks for the vote. Will DEFINITELY have to pursue this more.

    ReplyDelete