Evaluating Instructional Videos

June 8, 2022

This week I will be evaluating three videos based off of recommendations for an effective educational video as discussed in Brame’s 2015 article on the same topic. I will also be considering material from other course readings in my evaluation.

Engagement in e-Learning is important for learning transfer, or proper processing and storing of information by the learner. However, you must also keep in mind that too much engagement is possible and can lead to the learner feeling overwhelmed. This is also referred to as extraneous cognitive load, one of three types of cognitive load that you must balance as an instructional designer.

Extraneous cognitive load can be any effort that is unnecessary for aiding the learner in reaching the learning goal. Examples of this may be extra information, overly detailed animations, and complicated instructions. The goal should always be to minimize extraneous cognitive load.

That being said, multimedia e-learning can still take advantage of the way we [humans] process information in our working memory to create effective learning material. The two channels that exist in our working memory for processing information are the visual/pictorial channel and the auditory/verbal channel, otherwise known as the dual channel.

Demonstrative of dual channel. Spoken words are processed by the ears, printed words and pictures are processed by the eyes.

These two channels can work together, such as when text and graphics are presented together in an e-Learning, enhancing the quality of learning and learning transfer (Clark & Mayer, 2016). There are many techniques for reducing extraneous cognitive load while managing the other two types of cognitive load, and I will be comparing how various content creators align with those recommendations as I review 3 different instructional videos. I will start by sharing notes that I took as I watched the videos, and follow up with final thoughts. 

Video 1

Blurring Backgrounds & Objects in Adobe XD - https://youtu.be/G8CYKd-SvVY

This is a tutorial lead by Daniel Scott, an Adobe instructor.

Things I think Daniel does well that kept me engaged:

- He maintained pretty conversational language throughout the video, really connecting with me as a person.

- He kept it short. Nothing about what he did or said felt long-winded, and there was no excess of unnecessary information. The video segment was right about six minutes long, keeping it short but effectively engaging.

- He spoke quickly and with enthusiasm. He spoke quickly enough that I did not feel the need to speed up the video as I often do. His tone of voice, though it did not change much throughout, suggested he liked sharing his knowledge.

Things I think Daniel does well based off the recommendations from Brame:

- He used very effective matching modality, where he narrated a process as he demonstrated it on the screen.

Video 2

Binging with Babish: Macarons from The Mandalorian (ft. John Favreau) - https://youtu.be/IGS0JouUgjM

This is a cooking tutorial lead by Andrew Rea, a filmmaker and culinary hobbyist. 

Things I think Andrew does well that kept me engaged:

- Maintained a very consistent, conversational style of voice throughout the video. He also incorporated his humor into the narration.

- Though the video was just over 10 minutes, his narration was quick and matched very well with what he was doing in the video.

- He really made the video feel unique and the content was specific to The Mandalorian. I think this is similar to the “student engagement” section of Brame’s article where he suggests making sure the material feels like it is “for these students in this class” For those who click on the video looking for Mandalorian content, you certainly get it. He even makes several jokes and references reflecting content from the show.

Things I think Andrew does well based off of the recommendations from Brame:

- Matching modality was done well in this video. His narration was consistent with what he was demonstrating in the video, not taking away from anything he was doing on screen.

- I also think he did a good job with weeding, or eliminating unnecessary information from his content. The background music was not distracting or overwhelming, there was no text on the screen to interfere with his narration, and there were no extra features/graphics/animations in the video that might take away from his tutorial.

Video 3

The Absolute Worst Thing About Butterflies - https://youtu.be/GSyBginQAF8

This video is a production of the YouTube channel SciShow, is narrated by Hank Green, and is purely for informative educational purposes.

Things I think Hank does well that kept me engaged:

- He maintained a very conversational style, which helped with the feeling that he was actually speaking to me.

- He was speaking both quickly and in an excited tone the entire video, and his enthusiasm was almost contagious.

- The video was kept short and to the point, falling under six minutes in length for the content.

- The graphics were relevant to understanding the material.

Things I think Hank does well based off of the recommendations from Brame:

- Something I saw in this video that I did not see in the other two was signaling. Throughout the video, if they wanted to bring your attention to something, a small snippet of words would appear next to Hank that matched exactly what he was saying. Within those, if a word or group of words were more impactful than others, they were highlighted or otherwise focused on by making them larger or a slightly different color.

- The weeding is done well in this video, as there is no background music and the videos that they show of butterflies do not have sound. The background itself behind Hank is also not busy or interruptive, and the slide transitions are consistent with one another.

- I thought the matching modality was done well, and I never felt as though two things were fighting for my attention. The only times there were words on the screen together with narration was when there was an emphasis on something, and the words were verbatim.

Thoughts

Altogether I watched three different instructional videos, with the third being a non-tutorial style so that I could compare techniques used in it to the other educational videos. As a recap:

1. Blurring Backgrounds & Objects in Adobe XD: this was a screencast type of instructional video. Out of the three videos, I think it likely took the least amount of planning since the content was based off of what was happening on his screen.


2. Binging with Babish: Macarons from The Mandalorian (ft. John Favreau): this cooking tutorial was very concise and showed every step of the process. I think this video comes close to the third video in terms of the amount of planning that went into producing it, so it is a close second. This video was well edited to only show the necessary steps in the lengthy baking process, every step was narrated, and he mentions being out of his comfort zone with the content. This suggests he may have spent a while researching and putting together recipes to make it work for him.


3. The Absolute Worst Thing About Butterflies: this informative video was full of little-known information about a unique thing that butterflies can do. It is very concise yet packed full of digestible information that anyone could understand or enjoy. I think this video may have taken the most time to plan, as I imagine a lot of research was sifted through to understand this topic. They then had to write a script that was both effective and engaging without overly complex language, and Hank had to deliver it all in front of a camera. They also supplemented the information with demonstrative videos to show the viewer exactly what they were trying to convey.

Overall, considering all the points I have touched on thus far, I think Binging with Babish: Macarons from The Mandalorian (ft. John Favreau) and The Absolute Worst Thing About Butterflies were equally the most successful at being effective educational videos. They both aligned well with recommendations from Brame, as well as in terms of learner engagement.

Between these two videos, although I felt that they were both very conversational, I would say that Binging with Babish: Macarons from The Mandalorian (ft. John Favreau) used more conversational language than the SciShow. There was a lot of use of the words “we,” “us,” and “our.” I also think it is possible that the nature of the video lends itself better to conversational language, as a baking video, or skill that a lot of people are familiar with already. I would tie the cooking video with Blurring Backgrounds & Objects in Adobe XD in terms of conversational language, however, since Scott does a great job at making the video feel casual with his choice of language.

On the other hand, I would place the tone of the videos from most enthusiastic [and least monotone] to least as 1. The Absolute Worst Thing About Butterflies, 2. Binging with Babish: Macarons from The Mandalorian (ft. John Favreau) and 3. Blurring Backgrounds & Objects in Adobe XD. I was very bored with the tone used in the Adobe XD video, as it stayed relatively the same and Scott did not seem very excited about his content to me. The Binging with Babish video was a bit of the same, despite having engaging language. Andrew did not change his tone hardly at all throughout the video. Lastly, in the SciShow about butterflies, Hank was enthusiastic the whole time and changed his tone frequently to match what he was saying.

Finally, the only video that made me feel as though I was being spoken to was Video 3, The Absolute Worst Thing About Butterflies. This was also the only video that had the narrator on the screen most of the time talking and gesturing directly to the camera, which I am sure are contributing factors to that feeling. Hank’s enthusiasm and excitement made it feel like he was sharing the information directly with me.

References

Babish Culinary Universe. (December 1, 2020). Binging with Babish: Macarons from The Mandalorian (ft. John Favreau) [Video]. YouTube. https://youtu.be/IGS0JouUgjM

Brame, C.J. (2015). Effective educational videos. Retrieved from http://cft.vanderbilt.edu/guides-sub-pages/effective-educational-videos/.

Bring Your Own Laptop. (May 4, 2022). Blurring Backgrounds & Objects in Adobe XD [Video]. YouTube. https://youtu.be/G8CYKd-SvVY

Clark, R. C., & Mayer, R. E. (2016) E-Learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning. John Wiley

& Sons, Incorporated.

SciShow. (June 1, 2022). The Absolute Worst Thing About Butterflies [Video]. YouTube. https://youtu.be/GSyBginQAF8