Craig Barton's online courses/6. The four ingredients of retrieval

  • £25

6. The four ingredients of retrieval

How can we help our students remember what they once knew?

Course overview

 If students cannot remember what they once knew, then we are all wasting our time.

For years, my students' apparent lack of retention was the most frustrating thing about my job, and it was equally frustrating for my students. How could they do something one day, and then completely forget the next? An understanding of the working of long-term memory has been so important in the way I have changed my teaching in recent years. In this course we look at the key distinction between performance and learning, and delve into understanding of why and under what circumstances we should make learning more difficult. What is the Illusion of Retrieval? What are the key considerations in terms of the scheduling and difficulty of the content of our retrieval opportunities? How can we make our Starters and Homeworks as effective as possible? How can we interleave prior knowledge into the current Learning Episode? And then we turn our attention to the process that possibly had the biggest impact on our students: Low-Stakes Quizzes. How do they work, what role do confidence scores play, what can go wrong, and how have schools around the world made them work for their students and their contexts?

Please see the bottom of the page for FAQs about suitability, cost, payment options, and more. 

Contents

Introduction

What can you expect to learn if you sign up to this course?
1. Introduction
Preview
My model of a Learning Episode
Preview
2. The benefits of online courses
Preview
3. Getting the most out of the course
Preview
4. Where are you at?
Preview

How does memory work?

What is the new theory of disuse, the distinction between learning and performance, and what are the implications for teaching? 
1. The new theory of disuse
Podcast: Robert and Elizabeth Bjork - Memory, Forgetting, Testing, Desirable Difficulties
Paper: On the Symbiosis of Learning and Forgetting
2. Retrieval and storage strength
3. Learning versus performance
Paper: Learning versus performance
4. Desirable difficulties

Desirable difficulties

What are the testing effect, the spacing effect, the interleaving effect, and how can you avoid reaping any of the benefits from them????
1. The Testing Effect
The forgetting curve
Paper: Making Things Hard on Yourself, But in a Good Way: Creating Desirable Difficulties to Enhance Learning
Paper: Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
2. The effortful act of retrieval
3. The Spacing Effect
Paper: Using Spacing to Enhance Diverse Forms of Learning
Paper: Spacing effects in learning: A temporal ridgeline of optimal retention
Blog: Optimal Time For Spacing Gaps
4. The Interleaving Effect
Paper: Interleaving Helps Students Distinguish among Similar Concepts
5. How not to tap into the benefits of desirable difficulties
6. Making sure these difficulties are desirable

Four retrieval opportunities

What are the four retrieval opportunities that we will be discussing in this course?
1. The Carpenter et al (2012) paper
Paper: Using Spacing to Enhance Diverse Forms of Learning
2. Introducing my four ingredients of retrieval
3. Where am I supposed to find the time?

Scheduling the content of retrieval opportunities

What are some of the key considerations when it comes to scheduling the content of our retrieval opportunities?
1. A question...
2. It won't be perfect
3. Three factors to consider when scheduling in retrieval opportunities
4. What do we want our students to remember?
5. Creating a retrieval schedule
Blog: Retrieval Practice Update
Blog: Spacing Concepts, Facts and Skills
6. Including flexibility

Deciding the difficulty of the content of retrieval opportunities

1. A question...
2. Ramping up the difficulty
Podcast: Naveen Rizvi – Part 1: Scripted lessons, examples and social media

The illusion of retrieval

What is the "illusion of retrieval", and how can we avoid it?
The illusion of retrieval

Ingredient 1 - Starters

How can we make the start of our lesson into an effective retrieval opportunity?
1. The start of a lesson
2. Do students take Starters seriously?
Podcast: Mark McCourt: Teaching for Mastery
3. Are our Starters worth taking seriously?
4. Helping students take the start of the lesson more seriously
Podcast: Julia Smith: Teaching GCSE resit and the 5Rs approach
5. Where do you get your Starter questions from?
6. My favourite sources of Starter questions
Link: Corbett Maths
Link: Maths Box
Link: Maths teacher hub
Link: SSDD Problems
Link: Mr Chadburn
Link: Diagnostic Questions
Link: Maths Bot
Link: Maths4Everyone
Link: Maths made easy
7. Starter structures
Link: R-infinity starters
Link: MathsBot retrieval starter
Link: Mini White Board
Resource: Do now (blank) by Nathan Day
Resource: Do now (example) by Nathan Day
8. Starters and Atomisation
9. How long should my Starter last?

Ingredient 2 - Homework

How can we make homework into an effective retrieval opportunity?
1. Three questions...
2. What we used to do with homeworks
3. What our homeworks look like now
4. An interesting homework resource
Link: Interleaving & spacing the GCSE Mathematics curriculum

Ingredient 3 - Low-Stakes Quizzes

What are Low-Stakes Quizzes, how do we run them, and what have I learned from other schools who have made Low-Stakes Quizzes work for them?
1. Two questions...
2. What I used to think
3. The benefits of testing
Paper: Ten Benefits of Testing and their Application to Educational Practice
Link: The testing section of my research collection
4. Topic-specific versus cumulative
5. What our Low-Stakes Quizzes look like
6. We call them quizzes not tests
7. We tell students why we are introducing Low-Stakes Quizzes
The forgetting curve.png
8. Where possible we print the quizzes out
9. Students do the quizzes initially in silence and on their own
Paper: The Testing Effect in a Social Setting: Does Retrieval Practice Benefit a Listener?
10. The quizzes are not open-book
Paper: Strengthening the Student Toolbox
11. There is a time limit
12. If students finish the quiz early
Resource: Prompts of students finish early
13. Research into confidence
Resource: Confidence versus accuracy
Resource: Girls versus boys
Resource: Confidence at different ages
14. Two benefits of assigning confidence scores
15. What confidence scores look like in low stakes quizzes
16. Confidence - what other schools do
Resource: Low Stakes Quiz (blank) by Nathan Day
Resource: Low Stakes Quiz (example) by Nathan Day
17. Confidence - what other schools do - Extra!
18. Going through the answers
19. Who marks the quiz?
Book: What does this look like in the classroom?
20. Start with your highest confidence errors
21. Two issues with corrections
22. Review cards
Thread: Review cards
Podcast: Oliver Lovell: Planning, running a maths department and Cognitive Load Theory
23. Review cards - what other schools do
24. Paired discussion
Resource: Paired discussion prompts
25. AfL check
26. What to do with the marks?
27. Content - same or different?
28. Content - how difficult?
29. Sources of questions for Low-Stakes Quizzes
Twitter: Using Dr Frost for Low-Stakes Quizzes
Link: Corbett Maths
Link: Brockington College Homework booklets
Link: Miss B's resources
Link: Maths Box
Link: Diagnostic Questions
Link: Maths4Everyone
Link: CIMT MEP materials
30. Who writes the quizzes?
31. Messaging to students
32. What do students say?
33. LSQ-DQ Combo
34. Quiz-Homework-Quiz combo
35. Making Low-Stakes Quizzes work

Ingredient 4 - Future Learning Episodes

How can we make use of Future Learning Episodes to help students remember things from the past?
1. A question...
2. What is interleaving really about?
Blog post: Authentic Interleaving In Mathematics Lessons
Link: Interweaving by Will Emeny
3. High-value topics
4. Interweaving during Atomisation
Resource: Midpoint of two numbers
5. Interweaving during Fluency Practice
Link: Increasingly difficult questions
Resource: Brackets questions
Resource: Sequences questions
Resource: Graphs and geometry
Twitter: Miss Konstantine
6. Interweaving during Intelligent Practice
Resource: Positive integer powers
7. Interweaving during Method Selection
Resource: Percentage operations
Resource: Factorising quadratics
8. Interweaving during SSDD Problems
Resource: SSDD Problem with two points
9. Interweaving during Goal-Free Problems
10. Interweaving using UKMT questions
Link: UKMT questions on Diagnostic Questions
11. Golden Interleaving Rules

Other things to include in retrieval opportunities

What are some of the other things we might want our students to remember that we could include in our retrieval opportunities?
Other things to include in retrieval opportunities?

Software to improve retrieval

A look at some of the incredible software out there to help us all remember stuff better
Software to aid retrieval
Podcast: Daisy Christodoulou - Teachers versus Tech
Podcast: Ollie Lovell interview
Link: Anki
Link: Guide to Anki
Link: Anki essentials
Link: Quizlet
Link: Tips for using Quizlet
Link: Dendro
Link: Ollie Lovell blog post on Dendro

Useful links - from others

A selection of links from a variety of sources relevant to this course about retrieval 
researchEDHome 2020 Daisy Christodoulou: How to remember anything, forever
Damian Benney: Using Desirable Difficulties to make learning easier (rEDLoom)
10 Techniques for Retrieval Practice by Tom Sherrington
Bjork Learning and Forgetting Lab - videos and research summaries
How to not screw up retrieval practice by Adam Boxer
Why do we forget stuff? Familiarity vs recall by David Didau
Memories are made of this by Dylan Wiliam
Interleaving: are we getting it all wrong? by Mark Enser

Conclusion

Just before we say goodbye, it is time to bring everything together and reflect on what we have learned
1. Where to next?
2. Wrap-up
Preview
Course feedback
Course certificate
My online courses
Preview

Useful links - from me

A selection of links to some of my other work
My research paper collection
Book: How I wish I'd taught maths
Book: Reflect, Expect, Check, Explain
Mr Barton Maths website
Mr Barton Maths Podcast
Diagnostic Questions
Variation Theory
SSDD Problems
Maths Venns

FAQs

Is this course suitable for primary school teachers?

I am a secondary school maths teacher by training, and I make no claim whatsoever to have any expertise in the domain on primary teaching. However, I have been lucky enough to run this Retrieval course many times with primary colleagues, and it seems to go down well. I believe that the key principles are transferable, and I try my best to use a wide variety of examples that are suitable for all age groups. The challenge - as it is with everyone who takes the course - will be to think hard about what they would need to do to make the ideas work for them and their students.

Is this course suitable for non-maths teachers?

The key principles I cover in this course - spacing, interleaving, the testing effect - are generic and transferable. However, the vast majority of the examples I use are from the world of mathematics. So, if you choose to take the course, the onus will be on you to think about how the examples and ideas could transfer to your domain.

Is this course suitable for non-UK teachers?

Yes! I have been lucky enough to work with teachers all around the world, and I ensure wherever possible that my courses are not tied to any specific curriculum or specification. I am confident that aside form my weird accent, teachers from other countries will find most of the ideas relevant and transferable. 

How long can I access the course content for?

As long as this platform exists! That is one of the key advantages of an online course - you can go back over the content again and again.

If, for whatever reason, the platform shuts down or I need to remove content, I will give you as much notice as possible (I will aim for at least 6 months) so you can complete the courses. 

In addition, from time to time I will update the course content with new videos, resources and ideas. I will email you when this happens and you will have access to this as well for no extra cost.

Can I pay with an invoice instead of online?

The easiest way to pay is online. The service accepts all major cards as well as PayPal. Paying this way gives you immediate access to the course.

But if you need to pay via invoice, then no problem!  Just send an email to mrbartonmaths@gmail.com with details of:
1. The email addresses of the delegates taking the course
2. Your school name and address
3. Who to email to invoice to
Then I will send you an invoice and register your colleagues on the course 

Can I get a VAT receipt?

Of course!

If you have paid online, just login, click on the drop-down menu next to your picture on the top-right of the screen, select Billing and you can print off your VAT receipt(s) there.

image.png 26.79 KB


If you pay-offline (by emailing me as described above) then I will email you an invoice which will serve as your VAT receipt.

Can I buy one pass and then share it with my colleagues?

I am afraid not. The price of each course is per person.

Each person who pays for the course has their own log-in details, so the platform can keep track of their individual progress. This allows you to log back on using any device and pick up where you left off. 

Are there discounts available?

If you want to purchase a bundle of passes for the courses - perhaps you have a large department or you are part of an Academy chain - send me an email telling me what you have in mind, and hopefully we can reach a deal!

My email is mrbartonmaths@gmail.com 

Can I show the videos as part of a meeting or training event?

I am afraid not. The prices of the course are per person.

If you wish to discuss using the materials as part of a meeting or training event, please email me at mrbartonmaths@gmail.com.

About Craig Barton

​Craig Barton has been involved in teaching maths for 15 years. He was the the TES Maths Adviser for 10 years and is now the Head of Education at Eedi.  Craig is the author of the best-selling books “How I wish I’d taught maths” and "Reflect, Expect, Check, Explain", the host of the Mr Barton Maths Podcast, the creator of mrbartonmaths.com, diagnosticquestions.com, variationtheory.com, ssddproblems.com and mathsvenns.com, and Visiting Fellow at the Mathematics Education Centre at the University of Loughborough.