Craig Barton's online courses/6. The four ingredients of retrieval

  • £25

6. The four ingredients of retrieval

How can we help our students remember what they once knew?

Course overview

 If students cannot remember what they once knew, then we are all wasting our time.

For years, my students' apparent lack of retention was the most frustrating thing about my job, and it was equally frustrating for my students. How could they do something one day, and then completely forget the next? An understanding of the working of long-term memory has been so important in the way I have changed my teaching in recent years. In this course we look at the key distinction between performance and learning, and delve into understanding of why and under what circumstances we should make learning more difficult. What is the Illusion of Retrieval? What are the key considerations in terms of the scheduling and difficulty of the content of our retrieval opportunities? How can we make our Starters and Homeworks as effective as possible? How can we interleave prior knowledge into the current Learning Episode? And then we turn our attention to the process that possibly had the biggest impact on our students: Low-Stakes Quizzes. How do they work, what role do confidence scores play, what can go wrong, and how have schools around the world made them work for their students and their contexts?

Please see the bottom of the page for FAQs about suitability, cost, payment options, and more. 

Contents

Introduction

What can you expect to learn if you sign up to this course?
1. Introduction
  • 4 mins
  • 139 MB
Preview
My model of a Learning Episode
  • 75.7 KB
Preview
2. The benefits of online courses
  • 6 mins
  • 66.8 MB
Preview
3. Getting the most out of the course
  • 8 mins
  • 116 MB
Preview
4. Where are you at?
  • 1 min
  • 11.1 MB
Preview

How does memory work?

What is the new theory of disuse, the distinction between learning and performance, and what are the implications for teaching? 
1. The new theory of disuse
  • 6 mins
  • 92.1 MB
Podcast: Robert and Elizabeth Bjork - Memory, Forgetting, Testing, Desirable Difficulties
    Paper: On the Symbiosis of Learning and Forgetting
      2. Retrieval and storage strength
      • 6 mins
      • 95.1 MB
      3. Learning versus performance
      • 9 mins
      • 138 MB
      Paper: Learning versus performance
        4. Desirable difficulties
        • 2 mins
        • 35.9 MB

        Desirable difficulties

        What are the testing effect, the spacing effect, the interleaving effect, and how can you avoid reaping any of the benefits from them????
        1. The Testing Effect
        • 7 mins
        • 104 MB
        The forgetting curve
        • 82.2 KB
        Paper: Making Things Hard on Yourself, But in a Good Way: Creating Desirable Difficulties to Enhance Learning
          Paper: Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping
            2. The effortful act of retrieval
            • 5 mins
            • 75.2 MB
            3. The Spacing Effect
            • 8 mins
            • 159 MB
            Paper: Using Spacing to Enhance Diverse Forms of Learning
              Paper: Spacing effects in learning: A temporal ridgeline of optimal retention
                Blog: Optimal Time For Spacing Gaps
                  4. The Interleaving Effect
                  • 7 mins
                  • 146 MB
                  Paper: Interleaving Helps Students Distinguish among Similar Concepts
                    5. How not to tap into the benefits of desirable difficulties
                    • 5 mins
                    • 145 MB
                    6. Making sure these difficulties are desirable
                    • 3 mins
                    • 79.6 MB

                    Four retrieval opportunities

                    What are the four retrieval opportunities that we will be discussing in this course?
                    1. The Carpenter et al (2012) paper
                    • 4 mins
                    • 76.1 MB
                    Paper: Using Spacing to Enhance Diverse Forms of Learning
                      2. Introducing my four ingredients of retrieval
                      • 5 mins
                      • 94.3 MB
                      3. Where am I supposed to find the time?
                      • 7 mins
                      • 150 MB

                      Scheduling the content of retrieval opportunities

                      What are some of the key considerations when it comes to scheduling the content of our retrieval opportunities?
                      1. A question...
                      • 1 min
                      • 16.8 MB
                      2. It won't be perfect
                      • 4 mins
                      • 65.7 MB
                      3. Three factors to consider when scheduling in retrieval opportunities
                      • 7 mins
                      • 110 MB
                      4. What do we want our students to remember?
                      • 6 mins
                      • 201 MB
                      5. Creating a retrieval schedule
                      • 8 mins
                      • 235 MB
                      Blog: Retrieval Practice Update
                        Blog: Spacing Concepts, Facts and Skills
                          6. Including flexibility
                          • 6 mins
                          • 139 MB

                          Deciding the difficulty of the content of retrieval opportunities

                          1. A question...
                          • 1 min
                          • 10.5 MB
                          2. Ramping up the difficulty
                          • 8 mins
                          • 167 MB
                          Podcast: Naveen Rizvi – Part 1: Scripted lessons, examples and social media

                            The illusion of retrieval

                            What is the "illusion of retrieval", and how can we avoid it?
                            The illusion of retrieval
                            • 5 mins
                            • 73 MB

                            Ingredient 1 - Starters

                            How can we make the start of our lesson into an effective retrieval opportunity?
                            1. The start of a lesson
                            • 3 mins
                            • 54 MB
                            2. Do students take Starters seriously?
                            • 10 mins
                            • 174 MB
                            Podcast: Mark McCourt: Teaching for Mastery
                              3. Are our Starters worth taking seriously?
                              • 4 mins
                              • 53.3 MB
                              4. Helping students take the start of the lesson more seriously
                              • 9 mins
                              • 161 MB
                              Podcast: Julia Smith: Teaching GCSE resit and the 5Rs approach
                                5. Where do you get your Starter questions from?
                                • 1 min
                                • 14.6 MB
                                6. My favourite sources of Starter questions
                                • 14 mins
                                • 385 MB
                                Link: Corbett Maths
                                  Link: Maths Box
                                    Link: Maths teacher hub
                                      Link: SSDD Problems
                                        Link: Mr Chadburn
                                          Link: Diagnostic Questions
                                            Link: Maths Bot
                                              Link: Maths4Everyone
                                                Link: Maths made easy
                                                  7. Starter structures
                                                  • 10 mins
                                                  • 232 MB
                                                  Link: R-infinity starters
                                                    Link: MathsBot retrieval starter
                                                      Link: Mini White Board
                                                        Resource: Do now (blank) by Nathan Day
                                                        • 34.5 KB
                                                        Resource: Do now (example) by Nathan Day
                                                        • 44.6 KB
                                                        8. Starters and Atomisation
                                                        • 7 mins
                                                        • 157 MB
                                                        9. How long should my Starter last?
                                                        • 9 mins
                                                        • 203 MB

                                                        Ingredient 2 - Homework

                                                        How can we make homework into an effective retrieval opportunity?
                                                        1. Three questions...
                                                        • 2 mins
                                                        • 29.2 MB
                                                        2. What we used to do with homeworks
                                                        • 5 mins
                                                        • 79.1 MB
                                                        3. What our homeworks look like now
                                                        • 6 mins
                                                        • 87.7 MB
                                                        4. An interesting homework resource
                                                        • 6 mins
                                                        • 282 MB
                                                        Link: Interleaving & spacing the GCSE Mathematics curriculum

                                                          Ingredient 3 - Low-Stakes Quizzes

                                                          What are Low-Stakes Quizzes, how do we run them, and what have I learned from other schools who have made Low-Stakes Quizzes work for them?
                                                          1. Two questions...
                                                          • 1 min
                                                          • 6.79 MB
                                                          2. What I used to think
                                                          • 3 mins
                                                          • 37.4 MB
                                                          3. The benefits of testing
                                                          • 6 mins
                                                          • 128 MB
                                                          Paper: Ten Benefits of Testing and their Application to Educational Practice
                                                            Link: The testing section of my research collection
                                                              4. Topic-specific versus cumulative
                                                              • 6 mins
                                                              • 89.3 MB
                                                              5. What our Low-Stakes Quizzes look like
                                                              • 5 mins
                                                              • 109 MB
                                                              6. We call them quizzes not tests
                                                              • 3 mins
                                                              • 32.5 MB
                                                              7. We tell students why we are introducing Low-Stakes Quizzes
                                                              • 2 mins
                                                              • 25 MB
                                                              The forgetting curve.png
                                                              • 82.2 KB
                                                              8. Where possible we print the quizzes out
                                                              • 5 mins
                                                              • 104 MB
                                                              9. Students do the quizzes initially in silence and on their own
                                                              • 7 mins
                                                              • 125 MB
                                                              Paper: The Testing Effect in a Social Setting: Does Retrieval Practice Benefit a Listener?
                                                                10. The quizzes are not open-book
                                                                • 4 mins
                                                                • 105 MB
                                                                Paper: Strengthening the Student Toolbox
                                                                  11. There is a time limit
                                                                  • 9 mins
                                                                  • 148 MB
                                                                  12. If students finish the quiz early
                                                                  • 5 mins
                                                                  • 94 MB
                                                                  Resource: Prompts of students finish early
                                                                  • 60.2 KB
                                                                  13. Research into confidence
                                                                  • 13 mins
                                                                  • 237 MB
                                                                  Resource: Confidence versus accuracy
                                                                  • 274 KB
                                                                  Resource: Girls versus boys
                                                                  • 53.8 KB
                                                                  Resource: Confidence at different ages
                                                                  • 43.2 KB
                                                                  14. Two benefits of assigning confidence scores
                                                                  • 12 mins
                                                                  • 219 MB
                                                                  15. What confidence scores look like in low stakes quizzes
                                                                  • 6 mins
                                                                  • 101 MB
                                                                  16. Confidence - what other schools do
                                                                  • 10 mins
                                                                  • 210 MB
                                                                  Resource: Low Stakes Quiz (blank) by Nathan Day
                                                                  • 35.4 KB
                                                                  Resource: Low Stakes Quiz (example) by Nathan Day
                                                                  • 72.1 KB
                                                                  17. Confidence - what other schools do - Extra!
                                                                  • 12 mins
                                                                  • 298 MB
                                                                  18. Going through the answers
                                                                  • 9 mins
                                                                  • 147 MB
                                                                  19. Who marks the quiz?
                                                                  • 5 mins
                                                                  • 80.7 MB
                                                                  Book: What does this look like in the classroom?
                                                                    20. Start with your highest confidence errors
                                                                    • 5 mins
                                                                    • 74.8 MB
                                                                    21. Two issues with corrections
                                                                    • 5 mins
                                                                    • 106 MB
                                                                    22. Review cards
                                                                    • 8 mins
                                                                    • 145 MB
                                                                    Thread: Review cards
                                                                      Podcast: Oliver Lovell: Planning, running a maths department and Cognitive Load Theory
                                                                        23. Review cards - what other schools do
                                                                        • 8 mins
                                                                        • 184 MB
                                                                        24. Paired discussion
                                                                        • 6 mins
                                                                        • 168 MB
                                                                        Resource: Paired discussion prompts
                                                                        • 31.7 KB
                                                                        25. AfL check
                                                                        • 5 mins
                                                                        • 75.6 MB
                                                                        26. What to do with the marks?
                                                                        • 3 mins
                                                                        • 53.4 MB
                                                                        27. Content - same or different?
                                                                        • 5 mins
                                                                        • 130 MB
                                                                        28. Content - how difficult?
                                                                        • 6 mins
                                                                        • 118 MB
                                                                        29. Sources of questions for Low-Stakes Quizzes
                                                                        • 8 mins
                                                                        • 221 MB
                                                                        Twitter: Using Dr Frost for Low-Stakes Quizzes
                                                                          Link: Corbett Maths
                                                                            Link: Brockington College Homework booklets
                                                                              Link: Miss B's resources
                                                                                Link: Maths Box
                                                                                  Link: Diagnostic Questions
                                                                                    Link: Maths4Everyone
                                                                                      Link: CIMT MEP materials
                                                                                        30. Who writes the quizzes?
                                                                                        • 7 mins
                                                                                        • 167 MB
                                                                                        31. Messaging to students
                                                                                        • 5 mins
                                                                                        • 72.7 MB
                                                                                        32. What do students say?
                                                                                        • 3 mins
                                                                                        • 66.8 MB
                                                                                        33. LSQ-DQ Combo
                                                                                        • 6 mins
                                                                                        • 83.3 MB
                                                                                        34. Quiz-Homework-Quiz combo
                                                                                        • 10 mins
                                                                                        • 234 MB
                                                                                        35. Making Low-Stakes Quizzes work
                                                                                        • 3 mins
                                                                                        • 49.2 MB

                                                                                        Ingredient 4 - Future Learning Episodes

                                                                                        How can we make use of Future Learning Episodes to help students remember things from the past?
                                                                                        1. A question...
                                                                                        • 1 min
                                                                                        • 15.8 MB
                                                                                        2. What is interleaving really about?
                                                                                        • 4 mins
                                                                                        • 77.6 MB
                                                                                        Blog post: Authentic Interleaving In Mathematics Lessons
                                                                                          Link: Interweaving by Will Emeny
                                                                                            3. High-value topics
                                                                                            • 4 mins
                                                                                            • 58.2 MB
                                                                                            4. Interweaving during Atomisation
                                                                                            • 4 mins
                                                                                            • 93.6 MB
                                                                                            Resource: Midpoint of two numbers
                                                                                              5. Interweaving during Fluency Practice
                                                                                              • 11 mins
                                                                                              • 248 MB
                                                                                              Link: Increasingly difficult questions
                                                                                                Resource: Brackets questions
                                                                                                  Resource: Sequences questions
                                                                                                    Resource: Graphs and geometry
                                                                                                      Twitter: Miss Konstantine
                                                                                                        6. Interweaving during Intelligent Practice
                                                                                                        • 4 mins
                                                                                                        • 73.4 MB
                                                                                                        Resource: Positive integer powers
                                                                                                          7. Interweaving during Method Selection
                                                                                                          • 4 mins
                                                                                                          • 114 MB
                                                                                                          Resource: Percentage operations
                                                                                                            Resource: Factorising quadratics
                                                                                                              8. Interweaving during SSDD Problems
                                                                                                              • 3 mins
                                                                                                              • 48.8 MB
                                                                                                              Resource: SSDD Problem with two points
                                                                                                                9. Interweaving during Goal-Free Problems
                                                                                                                • 3 mins
                                                                                                                • 46.1 MB
                                                                                                                10. Interweaving using UKMT questions
                                                                                                                • 4 mins
                                                                                                                • 118 MB
                                                                                                                Link: UKMT questions on Diagnostic Questions
                                                                                                                  11. Golden Interleaving Rules
                                                                                                                  • 6 mins
                                                                                                                  • 130 MB

                                                                                                                  Other things to include in retrieval opportunities

                                                                                                                  What are some of the other things we might want our students to remember that we could include in our retrieval opportunities?
                                                                                                                  Other things to include in retrieval opportunities?
                                                                                                                  • 7 mins
                                                                                                                  • 109 MB

                                                                                                                  Software to improve retrieval

                                                                                                                  A look at some of the incredible software out there to help us all remember stuff better
                                                                                                                  Software to aid retrieval
                                                                                                                  • 6 mins
                                                                                                                  • 118 MB
                                                                                                                  Podcast: Daisy Christodoulou - Teachers versus Tech
                                                                                                                    Podcast: Ollie Lovell interview
                                                                                                                      Link: Anki
                                                                                                                        Link: Guide to Anki
                                                                                                                          Link: Anki essentials
                                                                                                                            Link: Quizlet
                                                                                                                              Link: Tips for using Quizlet
                                                                                                                                Link: Dendro
                                                                                                                                  Link: Ollie Lovell blog post on Dendro

                                                                                                                                    Useful links - from others

                                                                                                                                    A selection of links from a variety of sources relevant to this course about retrieval 
                                                                                                                                    researchEDHome 2020 Daisy Christodoulou: How to remember anything, forever
                                                                                                                                      Damian Benney: Using Desirable Difficulties to make learning easier (rEDLoom)
                                                                                                                                        10 Techniques for Retrieval Practice by Tom Sherrington
                                                                                                                                          Bjork Learning and Forgetting Lab - videos and research summaries
                                                                                                                                            How to not screw up retrieval practice by Adam Boxer
                                                                                                                                              Why do we forget stuff? Familiarity vs recall by David Didau
                                                                                                                                                Memories are made of this by Dylan Wiliam
                                                                                                                                                  Interleaving: are we getting it all wrong? by Mark Enser

                                                                                                                                                    Conclusion

                                                                                                                                                    Just before we say goodbye, it is time to bring everything together and reflect on what we have learned
                                                                                                                                                    1. Where to next?
                                                                                                                                                    • 4 mins
                                                                                                                                                    • 103 MB
                                                                                                                                                    2. Wrap-up
                                                                                                                                                    • 3 mins
                                                                                                                                                    • 93.3 MB
                                                                                                                                                    Preview
                                                                                                                                                    Course feedback
                                                                                                                                                      Course certificate
                                                                                                                                                      • 1.41 MB
                                                                                                                                                      My online courses
                                                                                                                                                        Preview

                                                                                                                                                        Useful links - from me

                                                                                                                                                        A selection of links to some of my other work
                                                                                                                                                        My research paper collection
                                                                                                                                                          Book: How I wish I'd taught maths
                                                                                                                                                            Book: Reflect, Expect, Check, Explain
                                                                                                                                                              Mr Barton Maths website
                                                                                                                                                                Mr Barton Maths Podcast
                                                                                                                                                                  Diagnostic Questions
                                                                                                                                                                    Variation Theory
                                                                                                                                                                      SSDD Problems
                                                                                                                                                                        Maths Venns

                                                                                                                                                                          FAQs

                                                                                                                                                                          Is this course suitable for primary school teachers?

                                                                                                                                                                          I am a secondary school maths teacher by training, and I make no claim whatsoever to have any expertise in the domain on primary teaching. However, I have been lucky enough to run this Retrieval course many times with primary colleagues, and it seems to go down well. I believe that the key principles are transferable, and I try my best to use a wide variety of examples that are suitable for all age groups. The challenge - as it is with everyone who takes the course - will be to think hard about what they would need to do to make the ideas work for them and their students.

                                                                                                                                                                          Is this course suitable for non-maths teachers?

                                                                                                                                                                          The key principles I cover in this course - spacing, interleaving, the testing effect - are generic and transferable. However, the vast majority of the examples I use are from the world of mathematics. So, if you choose to take the course, the onus will be on you to think about how the examples and ideas could transfer to your domain.

                                                                                                                                                                          Is this course suitable for non-UK teachers?

                                                                                                                                                                          Yes! I have been lucky enough to work with teachers all around the world, and I ensure wherever possible that my courses are not tied to any specific curriculum or specification. I am confident that aside form my weird accent, teachers from other countries will find most of the ideas relevant and transferable. 

                                                                                                                                                                          How long can I access the course content for?

                                                                                                                                                                          As long as this platform exists! That is one of the key advantages of an online course - you can go back over the content again and again.

                                                                                                                                                                          If, for whatever reason, the platform shuts down or I need to remove content, I will give you as much notice as possible (I will aim for at least 6 months) so you can complete the courses. 

                                                                                                                                                                          In addition, from time to time I will update the course content with new videos, resources and ideas. I will email you when this happens and you will have access to this as well for no extra cost.

                                                                                                                                                                          Can I pay with an invoice instead of online?

                                                                                                                                                                          The easiest way to pay is online. The service accepts all major cards as well as PayPal. Paying this way gives you immediate access to the course.

                                                                                                                                                                          But if you need to pay via invoice, then no problem!  Just send an email to mrbartonmaths@gmail.com with details of:
                                                                                                                                                                          1. The email addresses of the delegates taking the course
                                                                                                                                                                          2. Your school name and address
                                                                                                                                                                          3. Who to email to invoice to
                                                                                                                                                                          Then I will send you an invoice and register your colleagues on the course 

                                                                                                                                                                          Can I get a VAT receipt?

                                                                                                                                                                          Of course!

                                                                                                                                                                          If you have paid online, just login, click on the drop-down menu next to your picture on the top-right of the screen, select Billing and you can print off your VAT receipt(s) there.

                                                                                                                                                                          image.png 26.79 KB


                                                                                                                                                                          If you pay-offline (by emailing me as described above) then I will email you an invoice which will serve as your VAT receipt.

                                                                                                                                                                          Can I buy one pass and then share it with my colleagues?

                                                                                                                                                                          I am afraid not. The price of each course is per person.

                                                                                                                                                                          Each person who pays for the course has their own log-in details, so the platform can keep track of their individual progress. This allows you to log back on using any device and pick up where you left off. 

                                                                                                                                                                          Are there discounts available?

                                                                                                                                                                          If you want to purchase a bundle of passes for the courses - perhaps you have a large department or you are part of an Academy chain - send me an email telling me what you have in mind, and hopefully we can reach a deal!

                                                                                                                                                                          My email is mrbartonmaths@gmail.com 

                                                                                                                                                                          Can I show the videos as part of a meeting or training event?

                                                                                                                                                                          I am afraid not. The prices of the course are per person.

                                                                                                                                                                          If you wish to discuss using the materials as part of a meeting or training event, please email me at mrbartonmaths@gmail.com.

                                                                                                                                                                          About Craig Barton

                                                                                                                                                                          ​Craig Barton has been involved in teaching maths for 15 years. He was the the TES Maths Adviser for 10 years and is now the Head of Education at Eedi.  Craig is the author of the best-selling books “How I wish I’d taught maths” and "Reflect, Expect, Check, Explain", the host of the Mr Barton Maths Podcast, the creator of mrbartonmaths.com, diagnosticquestions.com, variationtheory.com, ssddproblems.com and mathsvenns.com, and Visiting Fellow at the Mathematics Education Centre at the University of Loughborough.