Retrieval Practice: Multiple-choice or short answer questions?

Multiple Choice or Short Answer?

Saturday morning homework with the preteen – the part of the week when time normally standstill. A couple of weeks ago, biology homework involved her completing two quizzes. The first quiz was a multiple-choice quiz; the second was a short answer quiz. Both were based on content from the previous lesson. So, how did it go? My preteen flies through the multiple-choice quiz, getting all the questions correct on her first attempt. Next up, the short answer quiz. Despite covering similar content, she finds it a lot more challenging and finishes with a score of 63%.

After the homework was complete, we discussed the two approaches to quizzing. My preteen told me she preferred the multiple-choice questions because she found them easier to complete. Why? Because in many cases, she quickly identified the correct answer as seeing it triggered a memory response. When she did not immediately know the correct answer to a multiple-choice question, she worked through a process of elimination to find the correct answer. She also correctly guessed a couple of solutions. However, the short answer questions she found more challenging because she could not always recall the correct answer without a prompt being available. This is likely because she had not yet fully learned what had been taught in class. At this point, I will also add, that after looking at the multiple-choice questions, the distractors were not always plausible!

What surprised me was the difference in my daughter’s performance using multiple choice and short answer questions. Had my daughter not completed the short answer questions, both she and I might have come to the false conclusion that she knew her stuff about the topic being tested. Seeing my daughter using the two quiz formats for the first time led me to stop and reflect on how quizzing is used in learning.

A range of research suggests low-stakes testing/quizzing is beneficial to learners. There is no denying that frequent quizzing can reduce test anxiety; the work of Smith, Floerke, and Thomas in 2016 illustrates this. Students who receive an intervening test after the initial learning experience generally perform better on a later final test than subjects given only the final test. This phenomenon has come to be referred to as the testing effect. It has been demonstrated with diverse study stimuli, including word lists (Darley & Murdock, 1971), paired associates (Runquist, 1986), pictures (Wheeler & Roediger, 1992), general knowledge facts (McDaniel & Fisher, 1991), and prose passages (LaPorte & Voss, 1975; for a review, see Roediger & Karpicke, 2006a).

However, how often do we reflect on the format low-stakes quiz/test questions should take? Multiple choice and short answer formats are probably two of the most common. When completing short answer questions, students must think of and produce the correct answer. In contrast, multiple-choice questions provide several possible solutions and require the learner to choose the correct one. But which is best? 

Research by Kang, McDermot and Roediger (2007)1 suggests that short-answer questions improve learning more than multiple-choice questions as they require students to produce the answer. So, does this mean we need to stop using multiple-choice quizzes in favour of short answer quizzes? Certainly not. In geography, students are often faced with multiple-choice quizzes in the exam, so they need to be well versed in completing them. Additionally, a study by Smith and Karpicke (2014)2 has indicated that students who practised retrieval (either multiple choice or short answer quizzes) performed better than those in a control group. However, the differences between the performance of the students using the two forms of retrieval (short answer and multiple-choice) were small.

Considering this, it is clear that both approaches to quizzing for retrieval practice have a place in geography. However, it is worth considering when each is most appropriate. For example, in the short term, after teaching a concept or topic, multiple-choice questioning (containing effective distractors – take a look at these tips) might be well suited to support embedding learning. Following this, the scaffolding that multiple-choice questions can provide to students can be removed, transitioning to short answer questions to check for knowledge and understanding. This way, students have to work harder to by having to retrieve their answers from memory.

Tectonics Short Answer Questions

Tectonics Short Answer Questions available to Internet Geography Plus subscribers

To support Internet Geography Plus subscribers in developing the use of short-answer questions. We’re creating a bank of questions and answers that can be shared with students in Word documents along with a bank of self-marking Google Forms/Microsoft Forms that subscribers can copy over to their accounts. To get the ball rolling we’ve added a bank of short answer questions (and answers) covering hazards, tectonics and plate margins in Word, Google Form and Microsoft Form format that Internet Geography Plus subscribers can access now. Log in or take out a low-cost subscription to Internet Geography.

We’ve also developed an example of a hybrid quiz containing multiple choice and short answer quiz questions available in the 4Rs of Revision area in Internet Geography Plus.

If you’ve experience combining the use of multiple-choice and short answer questions as part of your retrieval strategy, please share in the comments below.

Anthony 


  1. Kang, McDermot, and Roeriger (2007), Test format and corrective feedback modify the effect of testing on long-term retention – https://www.scinapse.io/papers/1981846272#fullText.
  2. Smith and Karpicke (2014), Retrieval practice with short-answer, multiple-choice, and hybrid formats

Geography in the News Self-Marking Homework Pilot

Geography in the News Self-Marking Forms

From this week until the half-term holiday in October we are piloting a new approach to Geography in the News homework. Each week will we be sharing a quiz in Google Forms and Microsoft Forms based on a news article relevant to the geography curriculum. Teachers can copy the form with the click of a link then share it with students to complete for homework. Each form will be self-marking to help reduce workload. This week we explore the gas shortage facing the UK this winter covered in an article on the BBC news website.

We’ve also recently released Geography in the News Plus for subscribers to Internet Geography Plus. Each week we publish GCSE exam-style questions based on an event in the news. These can be downloaded from the member area of Internet Geography Plus, just log in to access.

Geography in the News is free for teachers to access. It is funded by the lovely people who subscribe to Internet Geography Plus. If you don’t already subscribe please consider supporting us by taking out a low-cost annual subscription starting from just £24.99. To access the free Geography in the News forms please head over to the Geography in the News area of Internet Geography.

If your are copying the Google Quiz please make sure you are logged into your Google account first.

Tweet Treats #13

It’s been a while since we shared Tweet Treats, a collection of useful tweets relating to #geography and #geographyteachers. The world of Twitter can be a busy place so we’ve pulled together some great tweets recently posted on Twitter.

The collection of tweets below are in no particular order.

Looking for ready-made displays? Take a look at the resources shared by Kelly Pippin.

Loving this great activity to challenge locational knowledge by Chris Hoare.

Teaching volcanoes at convergent plate boundaries and an editable diagram to download from Luke Taylor.

An incredible set of threads containing subject knowledge updates by Anti-racist Geography Curriculum. This is a must-read!

Check out the recent RGS-IBG podcast with Ofsted inspector and subject lead Iain Freeland!

Kate Otto shares some great scenario questions being used to encourage thinking.

Alistair Hamill shares a video on how he uses GIS to teach biomes.

BBC Weather has shared a great video exploring whether global warming will make devastating storms like Hurricane Ida more likely?

Equipment for Microclimate Investigation

Coastal erosion at Skipsea

Skipsea is a village located 6 miles north of Hornsea and 10 miles south of Bridlington on the Holderness Coast, East Yorkshire. Skipsea lies on soft boulder clay and experiences the highest rate of erosion in Europe. A combination of stormy weather and rising sea levels caused more than 10 metres of the cliff to disappear from a 2-mile stretch of coast in just nine months last year, compared with the annual average of 4 metres. In just six months, three strips of coastline lost nearly double what they expected to lose in a year.

The average annual erosion rate remains about 2 metres a year for the 52-mile Holderness coastline. In Skipsea, there is anger that sea defences have protected neighbouring towns and villages such as Hornsea and Bridlington but their parish, with its population of about 700, has not. Sea defences are decided on a cost-benefit analysis, with large urban areas and important industries prioritised over farmland and individual houses. On that basis, Skipsea must brave the waves.

Until recently, 19 properties sat adjacent to the coast along Green Lane. Now, there are 16. It has been suggested that the remaining residents will need to vacate their properties within a couple of years. However, a single erosion event could put the properties at imminent risk within the next year.

Green Lane properties at Skipsea

Green Lane properties at Skipsea

Some residents on Green Lane feel the council has not done enough to protect them from erosion or help them to move nearby. As it stands, they have to pay around £6000 towards the cost of demolishing their homes. The East Riding of Yorkshire council provides some financial support to help residents cover the cost of demolishing their properties – which can cost between £15,000 and £40,000 – but they are continuing to ask the Government for funding.

Vacant plots on Green Lane

Vacant plots on Green Lane

La Soufrière Eruption 2021

JCQ GCSE Geography Grade Descriptors

The JCQ have published guidance for determining GCSE/A Level grades for 2021.

How much use the grade descriptors are is another question.

Below are links to published resources.

Quick links: 

Guidance statement – web page

Guidance Document – PDF file

All guidance downloads – web page with links to PDFs

GCSE Grade Descriptors (all GCSEs) – PDF

GCSE Geography grade descriptors in Word format – provided by Internet Geography

Internet Geography has developed assessment materials for AQA GCSE geography, in the style of past papers and come with a comprehensive mark scheme. There are available to Internet Geography Plus subscribers. Log in here or access for one year with a low-cost subscription.

Mount Etna

Europe’s most active volcano, Mount Etna, has been hitting the headlines recently after a series of spectacular eruptions. In Etna’s first eruption of 2021, explosive lava fountains reached over 1500 m in one of the most amazing eruptions in decades.

Mount Etna, located on the island of Sicily, has been largely dormant for the past two years. The stratovolcano (composite) dominates the skyline of the Italian island, where it sits on the eastern coast.

Located between the cities of Messina and Catania, it is the highest active volcano in Europe outside the Caucasus – a region between the Black Sea and the Caspian Sea – and the highest peak in Italy south of the Alps.

The recent activity is typical of a strombolian eruption among the normal activities of the more than 3,300-metre-high volcano. The recent eruption is the strongest explosion in the southern crater since it was discovered in 1971.

On Monday 22nd February 2021, at around 11 pm, the lava fountains, surrounded by gigantic clouds of smoke, exceeded 1,500 metres (4,900ft) in height, while thousands of rock fragments, some the size of fridges, were thrown from the crater into the sky for several kilometres.

Etna is a hyperactive volcano with over 3,500 years of historically documented eruptions. The volcano has been erupting on and off since September 2013. Since September 2019, it’s been erupting from its various summit craters virtually continuously. In December 2020, Etna’s explosive activity and lava output began to spike, and in February 2021, it has been launching fluid lava skywards.

Etna is an unusual volcano in that it can produce explosive eruptions of runny lava and release slower flowing, thick lava flows. Scientists are still trying to work out why this is the case.

The magma from the latest eruption appears to be coming up from deep within the mantle. Extremely hot, fluid magma is rapidly rising through the network of conduits within and below the volcano. However, there is another factor that is contributing to the current explosive eruptions.

There are high quantities of water vapour in Etna’s magma, which makes it explosive. The water does not cool the magma. As the molten magma approaches the surface, the pressure drops, and the bubble of water vapour expands violently, leading to lava being ejected out of the volcano.

Following each explosive lava fountain, less gassy magma lingers just below the vent. This is then cleared when a new volley of gassy magma rises from below. These explosive eruptions are known as volcanic paroxysms.

Authorities have reported no danger to the nearby towns, however, local airports have been temporarily closed, as has the airspace around the volcano. Etna’s last major eruption was in 1992. Despite the explosive nature of the recent eruption, there is no risk to the population, other than from the ash that covers buildings and smoke that can, after a few hours, cause breathing problems. In March 2017 vulcanologists, tourists and a BBC film crew were injured during an eruption when a flow of lava ran into snow, producing superheated steam that sent fragments of rock flying in all directions.

Further reading

For a Volcanologist Living on Mount Etna, the Latest Eruption Is a Delight – Advisory – this article contains expletives (swear words).

In Pictures: Mount Etna eruption lights up Sicily’s night sky

Mount Etna: BBC crew caught up in volcano blast

Mount Etna illuminates night sky with 1,500-metre lava fountain

 

 

Thoughts on Catch Up

The gap between advantaged and disadvantaged students, which unfortunately exists anyway, is likely to have widened over the last year. How will the proposed funding of £80 per pupil (for all schools) narrow this gap? The gap will continue to exist if all students access ‘catch up’ (whatever that may be). According to Gavin Williamson, catch up can be academic or support mental health. Disadvantaged children will likely be in greater need of MH support. Meanwhile, those students who have had parental support throughout home-learning may be more likely to receive academic support.

If an extra couple of weeks of summer school is the magic bullet (which I don’t think it is), why has this not been proposed in recent years to narrow the gap?

Imagine being a student returning to school after this challenging period, where many have struggled with isolation and home learning, to be told you now need to ‘catch up’; that this catch up might include losing holiday time and/or spending longer days at school. I know my head would be hitting the table.

The small amount of extra funding allocated to schools, who will be accountable for ensuring students’ catch up’, appears to be a token gesture to show the government is doing something about education. In practice, what will this ‘catch up’ look like? My guess is a cycle of baseline assessments, targeted intervention, more assessments, updating spreadsheets, rinse and repeat.

Might it be better if we were to focus on rekindling a love of learning in our students, along with them experiencing the sense of success in education that comes with effective retrieval practice?

For ourselves, might it be better that we have the opportunity to hone our skills, to use the most effective teaching methods possible (including integrating some of the best of remote learning into our offer). We could sustainably improve the quality of teaching and learning, rather than everyone burning out ‘catching up’? We have an amazing opportunity to reflect on what works well for our students and embed effective practice to support future generations. Or, we could just ‘catch up’.

None of the above will be possible unless we trim down the curriculum to provide a level playing field. Without making changes to the curriculum, we will pile further pressure on students and teachers on the back of the pandemic’s untold impact. To plough through already content-heavy specifications/curriculums as well as catching up on ‘lost’ learning is a recipe for disaster.

The government must take proactive steps; otherwise, we subject students and teachers to time-heavy, reactionary interventions, all in the name of ‘catching up’.

Perhaps we need to draw a line in the sand and allow schools and students time to get back to normal (in addition to implementing Covid testing etc.). Perhaps the government could support students and schools by rationalising the curriculum over the medium term rather than dishing out nominal funds and expecting everyone to do even more to meet an arbitrary curriculum’s needs.

This would allow schools to identify students who have a genuine need for academic and mental health support. Specialist intervention can then be given to those that genuinely need it. This will help narrow the gap by elevating those that are underprivileged or are most in need of support.

We now have the opportunity to be proactive in improving the life chances of all students. Reactionary ‘catch up’ will be counter-productive for everyone involved.

Anthony

10 tools for home teaching

 

Anthony explores useful kit to support remote teaching and working from home. 

Looking for tools to support home teaching? Since working on Internet Geography full-time, I’ve picked up some kit proven to be incredibly useful for home working. In the interest of being transparent, this post may contain affiliate links (at no extra cost to you).

Sit-Stand Desk

An electric, ergonomic height-adjustable sit-stand desk helps maximise the health benefits of alternating between standing and sitting while working. Long sitting hours on top of uncomfortable homeworking conditions can pose serious health risks such as high blood pressure, muscle loss and cardiovascular diseases. A sit-stand desk will help reduce your sitting hours and support you to work more efficiently.

Depending on your budget and resources, you’ve got the option to get a fully integrated frame and desk, or pick up a frame and attach a desktop of your own.

Desk frames start from around £179. The Flexispot EC1 is a single motor, heavy-duty steel desk to add your own desktop.

Monitor Stand 

Raise your monitor to a comfortable, ergonomically correct height while maximising desk space with a monitor stand.

Monitor stands range from a simple adjustable desktop stand, such as the AmazonBasics adjustable stand to mounting solutions for one, two and three monitors.

Laptop Stand 

Getting aches and pains from being hunched over your laptop? You might want to consider getting a laptop stand to raise your device to eye level. When combined with a Bluetooth mouse and keyboard, you can wave goodbye to aches and pains. I’ve got a VMEI laptop stand which I’ve been very impressed with.

Bluetooth Keyboard and Mouse

If you’re using a laptop as your primary device, you should really consider investing in a Bluetooth keyboard and mouse. A Bluetooth keyboard and mouse allows you to position yourself at a distance from your laptop or desktop, and generally have a much more flexible work area. If you are in the market for a Bluetooth keyboard and mouse you might want to consider the Logitech MK270 Wireless Keyboard and Mouse ComboCombined with a VMEI laptop stand, the days of hunching over the laptop are over!

Headphones and Microphone

Unless you’re in a soundproof room, you are going to be competing with outside sounds. A quality headset will ensure you hear only what’s important – your students. Having had online meetings using both the mic and speakers on my laptop and Bluetooth headphones with in-built microphone, I have to say the headphones were much better. If you have the budget, then consider getting Apple AirPods. If you are looking for a cheaper solution, then the Mpow M30 wireless Earbuds are worth considering.

Second Monitor 

There are many benefits to using multiple monitors, including enhanced productivity, better multitasking, easier cutting and pasting and displaying multiple windows at once. If you’re still using a single screen, you might want to consider moving to an additional screen (or two).

If you’ve already got a tablet that can be used as a second monitor, a gooseneck tablet holder, such as this one by Lamicall, is a great way to hold your tablet and give you the freedom to place it wherever it works for you.

If you are in the market for a cheap second monitor, it’s worth having a look on Facebook Marketplace. Alternatively, if you have a new monitor budget, I would recommend an HP 27f or BenQ GW2280.

Graphics Tablet 

Graphics tablets are great for drawing diagrams, annotating images and providing feedback. My go-to graphics tablet is a Wacom Intuous. However, the cheaper XP-Pen G430S Graphics Tablet is worthy of your consideration.

Visualiser
Visualisers are cameras that can be attached to a computer and used to model answers etc. to students. The benefit of a visualiser is that once it’s set up, there’s no faffing around setting it up each time you want to use it as it’s plug and play. The Okiolabs Okiocam S is well worth considering if you are in the market for visualiser. Alternatively, if size is important the A3 Okiolabs Okiocam T version is also available.

Goose Neck Phone Holder
Not got the budget for a dedicated visualiser? Most smartphones can be used as a visualiser. A Lamical, gooseneck phone holder is a great way to suspend your phone while you model answers and geographical techniques live from your desk.

Desk Mat

Protect your desktop and reduce the noise of an external mouse by investing in a desk mat. I recommend this world desk mat by Jailong.