# data[].attributes.body
(Good place to start...)

# data[].attributes.body
Correlates lobes to learning

# data[].attributes.headline
More stress management activities (more individual than group activities for students)

# data[].attributes.subject
More stress management activities (more individual than group activities for students)

# data[].attributes.headline
Apply research to daily clinical feedback 

# data[].attributes.subject
Apply research to daily clinical feedback 

# data[].attributes.headline
Science of Learning Videos: to review...

# data[].attributes.subject
Science of Learning Videos: to review...

# data[].attributes.body
https://issuu.com/idea-usfq/docs/how_the_brain_processes_information

# data[].attributes.attachment_link.readable_text
Low-stakes assignments are forms of evaluation that do not heavily impact students' final grades or other educational outcomes. The purpose of low-stakes assignments is to provide students with an indication of their performance while taking a course and give students an opportunity to improve their performance prior to receiving a final grade, either on an assignment or in a course.

As Vincent Tinto writes in Completing College: Rethinking Institutional Action (2012), "To be effective, assessments must be frequent, early, and formative." At colleges and universities recognized by the National Survey on Student Engagement for their success in promoting student's active engagement in their learning: "Feedback from faculty to students is timely and frequent, as documented both by NSSE data and by interviews with students and faculty members" (Kuh, et al. 2010).

Low-stakes assignments tend to work best when they generate formative feedback regarding where students are in the course, what they are doing well, and where they may need development to ultimately succeed in the class. At DePaul, there is a general expectation that students will be given feedback early in the quarter or term, and low-stakes assignments are a powerful method of doing so.

For students in their first year, whether as freshmen or transfers, such feedback is especially important in order to help them understand the expectations at DePaul. Early feedback also enables faculty to use DePaul's BlueStar system to identify students who may need additional assistance and share that information with the students and their academic advisors.

Benefits of Low-Stakes Assignments

Low-stakes assignments

Give students a realistic idea of their performance early in the term, enabling them to seek appropriate resources as needed

Open up lines of communication between students and their instructors, and may increase students' willingness to ask for help

Provide feedback for instructors on how well students are absorbing information and progressing in their skill development

Allow instructors to direct students to resources if they need further assistance or support

Give students an opportunity to be active participants in the evaluation of their own learning

Increase the likelihood that students will attend class and be active and engaged

Low Stakes-Assignments in Online and Flex Modality Courses

While all classes can benefit from frequent low-stakes assignments, it's especially important in online and Flex modalities. In a face-to-face classroom, instructors may assess student learning in informal ways using nonverbal cues-a puzzled look or an affirming nod, for example. In a online and Flex courses, instructors may have more difficulty picking up these cues from students, especially if they don't always have their cameras on or you're not meeting synchronously. In Flex classes, it can also be more challenging to pick up on nonverbal cues among in-person students if also trying to monitor engagement and participation among remote students at the same time. ​​

D2L Tools for Low-Stakes Assignments

​D2L tools will help you to implement low-stakes assignments in all types of courses and course modalities.

Quizzes are often used for multiple-choice or other objective question types because they can be graded automatically, allowing students to get feedback immediately. For low-stakes assignments, you may want to allow students to review the questions and their answers after they take the quiz. You can set up Submission Views to allow for this. Instructors can also view quiz statistics to see if the class is struggling with a particular concept and review that topic with them.

Discussions

Discussions allow students to share short pieces of writing or other media with you and their classmates. They work well for sharing rough drafts or other early-stage components of larger projects for peer review or for certain journaling assignments.

Submissions

Submission folders allow students to submit work privately to you. You may be used to using Submissions for major assignments like research papers. For shorter, less formal pieces of writing, you can change the Submission Type to "Text" to allow students to type their response directly into D2L rather than uploading a file from their computer.

Examples of Low-Stakes Assignments

Though given less weight, low-stakes assignments may be similar in type and kind to high-stakes assignments: they tend to reflect the kind of work students are going to be expected to do for a final exam, paper, or other summative project.

Components of a Larger Project

When assigning students a writing or research project, break down the elements of the project and use one or more as a low-stakes assignment. Require students to submit their works-in-progress so that they can receive early written feedback and a small grade, which could consist simply of a check or check-minus. Any one (or more) of the following elements could be collected and used as a low-stakes assignment:

Prospectus or proposal

Abstract

Thesis statement

Outline

Annotated bibliography

Specific sections of the final project (e.g., introduction, methods, lit. review)

Early-stage drafts of a paper

Early Drafts and Peer Review

Midway through a writing project, have students bring a full or partial draft of their paper to class and then exchange feedback with a peer. Students will receive valuable feedback that they can use to revise their work.

Try providing students with a rubric to help them give their peers targeted, assignment-specific feedback. Also, consider inviting Writing Center tutors to your class to model how peer review can be conducted effectively.

Mid-Project/Quarter Conferences

Around midterm or during the planning stages of a major course project, ask students to meet with you for conferences. If the class is too large for you to meet with each student individually, assign students to meet with you in groups, or one-on-one with their TA. The conference time might be dedicated to discussing the students' progress towards course goals or providing feedback on a particular project.

To get the most out of your conference time, ask students to complete and bring with them a self-assessment form or project proposal. Alternatively, ask students to write down one question they have about the course, content covered in class, or an assignment they are currently working on. Having a document to reference will keep the conversation on track and help put both you and your students at ease.

Group Work Planning and Reflection

When students are working in groups, require them to submit a statement outlining each group members' responsibilities and/or a timeline that measures their progress. Periodically throughout the group project, ask students to submit short reflections detailing their progress and any areas where they need support.

Weekly Quizzes

For a course where exams are the primary means of summative assessment, give students a quiz at the end of each week with questions based on content covered up to that point. Although the quiz might not count for credit (or might only count for a very small portion of the final grade), it will give students an idea of what they already learned and which concepts they need to spend more time with. Quizzes can be paper-based, conducted during class using Polling or posted online in D2L Quizzes.

Class Problem Solving

In a course where students learn new computational or mathematical concepts, have a problem posted on the board or screen at the start of each class, or in a collaborative document. Students can work individually, in pairs, or in small groups to find the solution. Spend part of class going over the problem as a big group, or review the problem in a short video.

Course Concept Journals

Consider having students keep a regular journal where they can engage with and apply course concepts. For example, in an Introduction to Political Science course, ask students to read the politics section of the New York Times and keep a weekly concept-application journal. For each entry, students should select one article that they read, summarize it, and show how the article demonstrates a theoretical concept discussed that week in class. Review students' journals every other week or so and give each entry brief feedback.

Reading Journals

In a course where students are required to do weekly readings, assign a reading journal. Entries might require students to summarize and respond to the source, or to answer a set of questions provided by the instructor. Students can submit their journal entries through D2L, by handing in hard copies every other week, or by posting them on a course blog.

Short Writing Assignments

Give students a prompt that corresponds to a class reading assignment, concept, or activity and have them turn in a short written response. Return the students' responses with your brief feedback, indicating whether the students are on track or not (a simple "check plus" or "check minus" could be used). In large classes where you might not have time to give individualized written feedback to each student, share and discuss one or two anonymous students responses at the next class meeting or in a D2L News item or weekly introduction.

Discussion Questions

Post open-ended questions designed to promote engagement with the current course content or an upcoming project or assignment. Invite students to ask questions and identify areas of confusion, and answer the questions posted by their peers. See Facilitating Discussions for additional suggestions.

Support for Low-Stakes Assignments at DePaul

University Center for Writing-based Learning (UCWbL)
Discuss how you can incorporate writing in a low-stakes assignment by contacting Matthew Pearson, Director of the UCWbL. You can also invite peer tutors to your classroom to demonstrate effective peer review before having your own students give feedback to one another.

University Libraries
If you're interested in using an element of a research project as a means of giving early feedback to students, connect with a university librarian. University librarians can offer feedback and resources for designing research projects for students.

Center for Teaching and Learning (CTL)
Have a question about integrating discussion forums in your classes? Not sure which platform might be best for setting up a course blog? Contact the CTL for help identifying and implementing a technology tool to help meet your goals.

Further Reading

Angelo, T., & Cross, K.P. (1993). Classroom assessment techniques. San Francisco: Jossey-Bass, Inc.

Bean, J. C. (1996). Engaging ideas: the professors guide to integrating writing,critical thinking and active learning in the classroom. San Francisco: Jossey-Bass Publishers.

Kuh, G. D., Kinzie, J., Schuh, J.S., and Whitt, E.J. (2010). Student success in college: Creating conditions that matter. San Francisco, CA: Jossey-Bass.

Lang, J. M. (2013). Cheating Lessons: Learning from Academic Dishonesty. Cambridge, MA: Harvard University Press.

Nilson, L. B. (2010). Teaching at its best: A research-based resource for college instructors. San Francisco: Jossey-Bass.

Tinto, Vincent. (2012). Completing college: Rethinking institutional action. Chicago, IL: University of Chicago Press.

Warnock, Scott. (2013). Frequent, low-stakes grading: Assessment for communication, confidence. Faculty Focus. Madison, WI: Magna Publications.

​

# data[].attributes.attachment_link.description
Low-stakes assignments are forms of evaluation that do not heavily impact students' final grades or other educational outcomes. The purpose of low-stakes assignments is to provide students with an indication of their performance while taking a course and give students an opportunity to improve their performance prior to receiving a final grade, either on an assignment or in a course.

# data[].attributes.headline
Will be especially useful when assessing students in SIM lab and clinical

# data[].attributes.subject
Will be especially useful when assessing students in SIM lab and clinical

# data[].attributes.headline
How can I teach them to "think like a nurse?"

# data[].attributes.subject
How can I teach them to "think like a nurse?"

# data[].attributes.headline
Find ways to test their recall now and later...

# data[].attributes.subject
Find ways to test their recall now and later...

# data[].attributes.attachment_link.readable_text
Jeffrey Karpicke, PhD, is the James V. Bradley associate professor of psychological sciences at Purdue University. He received a BA in psychology from Indiana University and a PhD in psychology from Washington University in St. Louis. Karpicke's research sits at the interface between cognitive science and education, with the goal of identifying effective strategies that promote long-term learning and comprehension. Karpicke's research has been funded by the National Science Foundation and the Institute of Education Sciences at the U.S. Department of Education. Karpicke was the recipient of the Janet Taylor Spence Award for Transformative Early Career Contributions from Association for Psychological Science, a National Science Foundation CAREER award, and the Presidential Early Career Award for Scientists and Engineers. Author website.

The movie "Inside Out" (2015) takes us inside the mind of its young protagonist, an 11-year-old girl named Riley, and depicts memory in a way that is sure to resonate with many people. In Riley's mind, her memories are objects - globes colored with emotions - that are stored in a mental space, just as physical objects are stored in a physical space. When Riley experiences an event and creates a new memory, a new globe is produced in her mind, rolling down a ramp like a ball returning in a bowling alley. When Riley re-experiences a past event, a globe is placed in a projector and events are replayed, projected on a screen in her mind. Cognitive psychologists refer to the mental processes involved in the creation of new memories and the recovery of past memories as encoding and retrieval, respectively.

The depiction of the mind in "Inside Out" follows centuries of thought on how mind and memory work. Throughout history, scholars have used a common metaphor to talk about memory: The mind is a vast storehouse or space; memories are objects stored in that space; and retrieving a memory is akin to searching for and finding an object in a physical space (Roediger, 1980). To learn something new, according to this view, the challenge lies in getting knowledge "in" one's mental space. Getting it back "out" when needed is important, too, but learning is usually identified with the encoding of new knowledge in memory. Retrieval is assumed to be neutral for learning; retrieval is needed to assess what a person has learned, but retrieval processes themselves are not thought to produce learning.

Recent advances in the science of learning and memory have challenged common assumptions about how learning happens. Specifically, recent work has shown that retrieval is critical for robust, durable, long-term learning. Every time a memory is retrieved, that memory becomes more accessible in the future. Retrieval also helps people create coherent and integrated mental representations of complex concepts, the kind of deep learning necessary to solve new problems and draw new inferences. Perhaps most surprisingly, practicing retrieval has been shown to produce more learning than engaging in other effective encoding techniques (Karpicke & Blunt, 2011). This approach, which recognizes the central role of retrieval processes in learning and aims to develop new learning strategies based on retrieval practice, is referred to as retrieval-based learning.

Retrieval Creates Learning

Research dating back a century has shown that retrieval contributes to learning (for a historical review, see Roediger & Karpicke, 2006a), but the past decade has seen a renewed, intense focus on exploring the benefits of retrieval for learning. This recent research has established that repeated retrieval enhances learning with a wide range of materials, in a variety of settings and contexts, and with learners ranging from preschool ages into later adulthood (Balota, Duchek, Sergent-Marshall & Roediger, 2006; Fritz, Morris, Nolan & Singleton, 2007).

A word-learning experiment illustrates some key points about retrieval-based learning. In the experiment (Karpicke & Bauernschmidt, 2011), students learned a list of foreign language words (e.g., Swahili vocabulary words like "mashua - boat") across cycles of study and recall trials. In study trials, the students saw a vocabulary word and its translation on the computer screen, and in recall trials, they saw a vocabulary word and had to recall and type its translation. The students studied a list of vocabulary words, then attempted to retrieve the whole list, studied it again, retrieved it again, and so on across alternating study and retrieval practice blocks.

There were several different conditions in the experiment. In one condition, students simply studied the words once, without trying to recall them at all. In a second condition, students continued studying and recalling the words until they had recalled all of them once. After a word was successfully retrieved once, it was "dropped" from further practice - the students did not see it again in the learning session.

Other conditions in the experiment examined the effects of repeated retrieval practice. Once a word was recalled, the computer program required the students to practice retrieving the items three more times. One repeated retrieval condition had the three recall trials happen immediately, three times in a row. This condition, referred to as massed retrieval practice, is akin to repeating a new piece of information over and over in your head right after you experience it. Finally, in the last condition highlighted here, the students also practiced retrieving the words three times, but the repeated retrievals were spaced throughout the learning session. For instance, once a student correctly recalled the translation for mashua, the program moved on to other vocabulary words, but prompts to practice retrieval of the translation for mashua would pop up later on in the program. In this way, the retrieval opportunities were spaced throughout the learning session.

The key question in this research was, how well would students remember the vocabulary word translations in the long term? Figure 1 shows the proportion of translations that students remembered one week after the initial learning session. Merely studying the words once without ever recalling them produced extremely poor performance (average recall was 1 percent, barely visible on the figure). Practicing until each translation was recalled once was much better. But what about the effects of repeated retrieval practice? Massed retrieval - repeating the translations three times immediately - produced no additional gain in learning. Repeated retrieval enhanced learning only when the repetitions were spaced, and indeed, the effects of repeated spaced retrieval were very large. In a single experiment, simple changes that incorporated spaced retrieval practice took performance from nearly total forgetting to extremely good retention (about 80 percent correct) one week after an initial learning experience (see also Karpicke & Roediger, 2008; Pyc & Rawson, 2010).

Figure 1. Data from Karpicke & Bauernschmidt (2011).

Retrieval Practice is Underappreciated as a Learning Strategy

If retrieval practice is such a potent learning strategy, one would hope that many learners would practice retrieval to learn many different things in many situations. However, as noted earlier, retrieval is not typically considered an important part of the learning process, and unfortunately, many learners do not practice retrieval as often or as effectively as they could.

An emphasis on getting knowledge in memory shows up on surveys of students' learning strategies. In one survey (Karpicke, Butler & Roediger, 2009), college students were asked to list the strategies they use while studying and to rank-order the strategies. The results, shown in Figure 2, indicate that students' most frequent study strategy, by far, is repetitive reading of notes or textbooks. Active retrieval practice lagged far behind repetitive reading and other strategies (for a review of several learning strategies, see Dunlosky, Rawson, Marsh, Nathan & Willingham, 2013). A wealth of research has shown that passive repetitive reading produces little or no benefit for learning (Callender & McDaniel, 2009). Yet not only was repetitive reading the most frequently listed strategy, it was also the strategy most often listed as students' number one choice, by a large margin.

Why don't learners use repeated retrieval practice more frequently? Many students view retrieval as a "knowledge check"; they test themselves to see if they know something, rather than out of the belief that practicing retrieval itself will help them learn. This means that many students will use a "one-and-done" strategy: If they can recall something once, they believe they have learned it, so they remove it from further practice. Many students study this way when they regulate their own learning (Karpicke, 2009), even though their long-term learning will not benefit from repeated retrieval practice. Instead, a one-and-done strategy will produce long-term performance similar to the recall-once condition in Figure 1. There is some evidence that instructing learners about the benefits of retrieval leads students to report using retrieval practice more frequently when they study on their own (Einstein, Mullet & Harrison, 2012), but the best ways to influence students to practice retrieval remain to be discovered.

Practicing Retrieval Promotes Meaningful Learning

Perhaps another reason retrieval practice is not used more widely is because repeated retrieval may seem like "rote learning." Rote learning - simple memorization based on repetition - is short-lived, poorly organized and does not support the ability to transfer knowledge, make inferences or solve new problems. The outcome of rote learning is obviously not what students and educators aim for. Meaningful learning is essentially the opposite of rote learning: It is long-lasting and durable, coherent and well organized, and supports transfer, inferencing and problem solving. In fact, the past decade of research on retrieval-based learning has firmly established that retrieval practice promotes meaningful learning.

Retrieval-based learning may be a more effective means of achieving meaningful learning than other popular active learning strategies. In one example of this (Karpicke & Blunt, 2011), students studied educational texts about science topics using one of two strategies. In a retrieval practice condition, students read a text, then set it aside and spent time recalling and writing down as much as they could remember from it (Roediger & Karpicke, 2006b). They then reread the text and recalled it a second time. In a second condition, students created concept maps while they read the texts. Concept maps are node-and-link diagrams that require learners to think about the relational and organizational structure of materials (Novak, 2013). The students spent the same amount of time studying in the two conditions; the difference was whether they created concept maps or practiced actively retrieving while learning.

Figure 3 shows the results of two different final assessments given one week after the learning session. On one assessment, students answered two types of short-answer questions aimed at measuring meaningful learning: verbatim questions, which assessed concepts stated directly in the texts, and inference questions, which required students to make new connections across concepts. On another assessment, the final assessment involved creating a concept map, because concept mapping is often used as an assessment of the coherence and integration of students' knowledge. On the final verbatim and inference questions and on the final concept map assessment, practicing retrieval during learning produced the best performance, even better than studying the material by making concept maps.

Several additional studies have established that retrieval practice promotes meaningful learning. Retrieval practice enhances the learning of educationally relevant materials, including educational texts, multimedia presentations, material explained in classroom lectures and a variety of other complex concepts (Jensen, McDaniel, Woodard & Kummer, 2014; Johnson & Mayer, 2009; Larsen, Butler, Lawson & Roediger, 2013; Lyle & Crawford, 2011; Roediger, Agarwal, McDaniel & McDermott, 2011). Retrieval practice also supports students in making inferences, solving new problems and transferring knowledge (Butler, 2010; Chan, 2009; Hinze & Wiley, 2011; McDaniel, Howard & Einstein, 2009; Smith & Karpicke, 2014). Retrieval-based learning is an effective method for improving meaningful learning.

Creating Retrieval-based Learning Activities

Perhaps the best aspect of retrieval-based learning is that it is free. Although there are sophisticated tools that can be used to implement retrieval practice, like classroom clicker systems (Roediger et al., 2011) and other computer-based learning systems (Grimaldi & Karpicke, 2014; Lindsey, Shroyer, Pashler, & Mozer, 2014), retrieval practice does not require special equipment or technology. The essence of retrieval-based learning is taking material you are trying to learn, setting it aside, and spending time actively retrieving the information.

Existing educational activities can be converted into retrieval-based learning activities. For instance, answering questions and taking quizzes are effective ways to practice retrieval. In some circumstances, students might answer questions on quizzes or practice worksheets by looking up answers in their notes or books, rather than by attempting to retrieve the answers. One study directly compared this type of open-book questioning to closed-book conditions in which students were required to retrieve the answers to questions rather than looking them up (Agarwal, Karpicke, Kang, Roediger & McDermott, 2008). Answering questions in open-book conditions led to more forgetting over one week than did attempting to retrieve the answers, closed-book and then studying the answers. In other words, closed-book quizzes, which required retrieval practice, were more effective than open-book quizzes, which did not require learners to engage in retrieval.

Another study (Blunt & Karpicke, 2014) examined the effectiveness of using concept mapping as a retrieval practice activity. In the experiment, students read texts about science topics and then created concept maps either with or without viewing the texts. In other words, some students created maps while studying the texts whereas other students had to engage in retrieval to create their maps. On a short-answer assessment one week after the learning session, students did better when they had learned by creating concept maps without viewing the texts, as a retrieval practice activity, than by creating maps while studying the texts. Thus, educational activities can be enhanced when they involve retrieval-based learning.

Take Home Points About Retrieval-based Learning

This article has made the case for four take-home points about retrieval-based learning:

Retrieval is a learning event. Practicing retrieval is a simple and effective way to enhance long-term, meaningful learning.

Some effective learning strategies, like retrieval practice, are underutilized. Conversely, the most popular learning strategy among college students - repetitive reading - leads to very limited levels of learning.

When practicing retrieval, retrieve more than once and space your retrievals, rather than massing them all together. Self-testing as a knowledge check is a good idea, but don't stop at just one successful retrieval (one-and-done). Two or three additional spaced retrievals will bolster long-term learning.

Retrieval can happen in a variety of ways, and many existing activities may be converted into retrieval-based learning activities. The key ingredient is to spend time actively retrieving when trying to learn something new.

References

Agarwal, P.K., Karpicke, J. D., Kang, S.H.K., Roediger, H.L., & McDermott, K.B. (2008). Examining the testing effect with open- and closed-book tests. Applied Cognitive Psychology, 22(7), 861-876. doi:10.1002/acp.1391.

Balota, D.A., Duchek, J.M., Sergent-Marshall, S.D., & Roediger, H.L. (2006). Does expanded retrieval produce benefits over equal-interval spacing? Explorations of spacing effects in healthy aging and early stage Alzheimer's disease. Psychology and Aging, 21(1), 19-31. doi:10.1037/0882-7974.21.1.19.

Blunt, J.R., & Karpicke, J.D. (2014). Learning with retrieval-based concept mapping. Journal of Educational Psychology, 106(3), 849-858. doi:10.1037/a0035934.

Butler, A.C. (2010). Repeated testing produces superior transfer of learning relative to repeated studying. Journal of Experimental Psychology: Learning, Memory, and Cognition, 36(5), 1118-1133. doi:10.1037/a0019902, 10.1037/a0019902.supp.

Callender, A.A., & McDaniel, M.A. (2009). The limited benefits of rereading educational texts. Contemporary Educational Psychology, 34(1), 30-41. doi:10.1016/j.cedpsych.2008.07.001.

Chan, J.C.K. (2009). When does retrieval induce forgetting and when does it induce facilitation? Implications for retrieval inhibition, testing effect, and text processing. Journal of Memory and Language, 61(2), 153-170. doi:10.1016/j.jml.2009.04.004.

Dunlosky, J., Rawson, K.A., Marsh, E.J., Nathan, M.J., & Willingham, D.T. (2013). Improving students' learning with effective learning techniques: Promising directions from cognitive and educational psychology. Psychological Science in the Public Interest, 14(1), 4-58. doi:10.1177/1529100612453266.

Einstein, G.O., Mullet, H.G., & Harrison, T.L. (2012). The testing effect: Illustrating a fundamental concept and changing study strategies. Teaching of Psychology, 39(3), 190-193. doi:10.1177/0098628312450432.

Fritz, C.O., Morris, P.E., Nolan, D., & Singleton, J. (2007). Expanding retrieval practice: An effective aid to preschool children's learning. The Quarterly Journal of Experimental Psychology, 60(7), 991-1004. doi:10.1080/17470210600823595

Grimaldi, P.J., & Karpicke, J.D. (2014). Guided retrieval practice of educational materials using automated scoring. Journal of Educational Psychology, 106(1), 58-68. doi:10.1037/a0033208.

Hinze, S.R., & Wiley, J. (2011). Testing the limits of testing effects using completion tests. Memory, 19(3), 290-304. doi:10.1080/09658211.2011.560121.

Jensen, J. L., McDaniel, M.A., Woodard, S.M., & Kummer, T.A. (2014). Teaching to the test ... or testing to teach: Exams requiring higher order thinking skills encourage greater conceptual understanding. Educational Psychology Review, 26(2), 307-329. doi:10.1007/s10648-013-9248-9.

Johnson, C.I., & Mayer, R.E. (2009). A testing effect with multimedia learning. Journal of Educational Psychology, 101(3), 621-629. doi:10.1037/a0015183.

Karpicke, J.D. (2009). Metacognitive control and strategy selection: Deciding to practice retrieval during learning. Journal of Experimental Psychology: General, 138(4), 469-486. doi:10.1037/a0017341.

Karpicke, J.D., & Bauernschmidt, A. (2011). Spaced retrieval: Absolute spacing enhances learning regardless of relative spacing. Journal of Experimental Psychology: Learning, Memory, and Cognition, 37(5), 1250-1257. doi:10.1037/a0023436.

Karpicke, J.D., & Blunt, J.R. (2011). Retrieval practice produces more learning than elaborative studying with concept mapping. Science, 331(6018), 772-775. doi:10.1126/science.1199327.

Karpicke, J.D., Butler, A.C., & Roediger, H.L. (2009). Metacognitive strategies in student learning: Do students practise retrieval when they study on their own? Memory, 17(4), 471-479. doi:10.1080/09658210802647009.

Karpicke, J.D., & Roediger, H.L. (2008). The critical importance of retrieval for learning. Science, 319(5865), 966-968. doi:10.1126/science.1152408.

Larsen, D.P., Butler, A.C., Lawson, A.L., & Roediger, H.L., III. (2013). The importance of seeing the patient: Test-enhanced learning with standardized patients and written tests improves clinical application of knowledge. Advances in Health Sciences Education, 18(3), 409-425. doi:10.1007/s10459-012-9379-7.

Lindsey, R.V., Shroyer, J.D., Pashler, H., & Mozer, M.C. (2014). Improving students' long-term knowledge retention through personalized review. Psychological Science, 25(3), 639-647. doi:10.1177/0956797613504302.

Lyle, K.B., & Crawford, N.A. (2011). Retrieving essential material at the end of lectures improves performance on statistics exams. Teaching of Psychology, 38(2), 94-97. doi:10.1177/0098628311401587.

McDaniel, M.A., Howard, D.C., & Einstein, G.O. (2009). The read-recite-review study strategy: Effective and portable. Psychological Science, 20(4), 516-522. doi:10.1111/j.1467-9280.2009.02325.x.

Novak, J.D. (2013). Concept mapping. In J. Hattie & E.M. Anderman (Eds.), International Guide to Student Achievement (pp. 362-365). New York, NY: Routledge/Taylor & Francis Group.

Pyc, M.A., & Rawson, K.A. (2010). Why testing improves memory: Mediator effectiveness hypothesis. Science, 330(6002), 335. doi:10.1126/science.1191465.

Roediger, H.L. (1980). Memory metaphors in cognitive psychology. Memory & Cognition, 8(3), 231-246. doi:10.3758/bf03197611.

Roediger, H.L., Agarwal, P.K., McDaniel, M.A., & McDermott, K.B. (2011). Test-enhanced learning in the classroom: Long-term improvements from quizzing. Journal of Experimental Psychology: Applied, 17(4), 382-395. doi:10.1037/a0026252.

Roediger, H.L., & Karpicke, J.D. (2006a). The power of testing memory: Basic research and implications for educational practice. Perspectives on Psychological Science, 1(3), 181-210. doi:10.1111/j.1745-6916.2006.00012.x.

Roediger, H.L., & Karpicke, J.D. (2006b). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249-255. doi:10.1111/j.1467-9280.2006.01693.x.

Smith, M.A., & Karpicke, J.D. (2014). Retrieval practice with short-answer, multiple-choice, and hybrid tests. Memory, 22(7), 784-802. doi:10.1080/09658211.2013.831454.

The views expressed in this article are those of the author and do not reflect the opinions or policies of APA.

# data[].attributes.attachment_link.title
A powerful way to improve learning and memory

# data[].attributes.attachment_link.description
Jeffrey Karpicke, PhD, is the James V. Bradley associate professor of psychological sciences at Purdue University. He received a BA in psychology from Indiana University and a PhD in psychology from Washington University in St. Louis. Karpicke's research sits at the interface between cognitive science and education, with the goal of identifying effective strategies that promote long-term learning and comprehension.

# data[].attributes.headline
Great guidance for applying theory to practice knowledge (especially dos and don'ts)

# data[].attributes.subject
Great guidance for applying theory to practice knowledge (especially dos and don'ts)

# data[].attributes.attachment_link.readable_text
It doesnt matter what subject you teach, differences in students performance are affected by how much they engage in deliberate practice. Researchers who have investigated expert and novice performance have uncovered important distinctions between deliberate practice and other activities, such as play or repetition.

Deliberate practice is not the same as rote repetition. Rote repetition - simply repeating a task - will not by itself improve performance. Deliberate practice involves attention, rehearsal and repetition and leads to new knowledge or skills that can later be developed into more complex knowledge and skills. Although other factors such as intelligence and motivation affect performance, practice is necessary if not sufficient for acquiring expertise (Campitelli & Gobet, 2011).

Define practice:

"Deliberate practice (DP) occurs when an individual intentionally repeats an activity in order to improve performance. The claim of the DP framework is that such behavior is necessary to achieve high levels of expert performance." (Campitelli & Gobet, 2011, p. 280).

"Deliberate practice consists of activities purposely designed to improve performance." (Gobet & Campitelli, 2007, p. 160).

Benefits of deliberate practice

Practice is important for teaching and learning in at least five ways:

1. Practice greatly increases the likelihood that students will permanently remember new information (Anderson, 2008).

2. Practice increases student facility or automaticity (learning to apply elements of knowledge automatically, without reflection). Automaticity is usually only achieved through extensive rehearsal and repetition. Automaticity frees up students cognitive resources to handle more challenging tasks (Brown & Bennett, 2002; Moors & De Houwer, 2006).

3. When students practice solving problems, they increase their ability to transfer practiced skills to new and more complex problems. This is true in childhood (Glover, Ronning, & Bruning, 1990) and adult years (Li, Schmiedek, Huxhold, Röcke, Smith, & Lindenberger, 2008).

4. Practice helps students acquire expertise in subject matter and, therefore, it helps to distinguish novices from experts in given subjects (Ericsson, Krampe, & Clemens, 1993)

5. Cognitive gains from practice often bring about motivation for more learning (Kalchman, Moss, & Case, 2001).

Teachers should think of practice not as rote repetition, but as deliberate, goal-directed rehearsal paired with reflection on problem-solving processes. For example, when teachers have students practice identifying phonemes, the ultimate goal is for students to read with fluency and comprehension. Although fluent reading may be too complex a task for beginning readers to tackle, the more manageable task of identifying phonemes may scaffold students learning to achieve the ultimate goal of reading. That is, teachers should always design practice activities with the goal of transferring knowledge to new and more complex problems in mind.

General recommendations for practice and instruction

Research (Anderson, 2008; Campitelli & Gobet, 2011; Ericsson, Krampe, & Clemens, 1993) suggests several conditions that must be in place in order for practice activities to be most effective in moving students closer to skillful performance. Each of these conditions can be met with carefully designed instruction:

Because practice requires intense, focused effort, students may not find it inherently enjoyable. Therefore, teachers can encourage students to practice more by pointing out every time that practice has actually improved their performance. Motivate your students to practice by:

Expressing confidence in students' ability to succeed in solving practice problems.

Designing activities that maximize opportunities for students to succeed.

Teachers should design practice tasks with students existing knowledge in mind. When students succeed at practice problems, the benefits of practice are maximized. But when students become frustrated with unrealistic or poorly designed practice problems, they often lose motivation, will not receive the full benefits of the practice they have done, and will be less motivated to attempt future practice problems.

Students receive the greatest benefits from practice when teachers provide them with timely and descriptive feedback.

Students should have repeated opportunities to practice a task through practicing other tasks like it.

What type of feedback is most effective?

Feedback is most effective when it contains descriptions of how students work meets performance criteria and what students can do to improve. This kind of descriptive feedback is more effective than feedback consisting of vague, general comments (e.g., "nice work or "needs improvement).

Feedback should also be focused on the learning process. That is, teachers should focus their feedback on helping students reflect on their problem solving skills, as well as on progress they have made.

Do's:

1. Vary practice activities.

2. Distribute practice over extended periods of time.

3. Provide clear instructions on performance expectations and criteria.

4. Before asking students to practice independently, model the problem-solving process that you expect students to use.

5. Break complex problems into their constituent elements, and have students practice on these smaller elements before asking them to solve complex problems independently.

6. Guide students through sample practice problems by using prompts that help them reflect on problem-solving strategies.

7. Provide students with fully completed sample problems as well as partially completed sample problems before asking them to apply new problem-solving strategies on their own.

8. Wait until students actually need more information to solve a complex problem before you give them more information. This strategy - known as "just-in-time instruction" - helps keep the amount of information that students must hold in their short-term memories to a manageable level as they practice (Linneman & Plake, 2006; Simkins & Maier, 2008).

9. Provide plenty of opportunities for students to practice applying problem-solving skills before you test them on their ability to use those skills.

Don'ts:

1. Don't ask students to practice complex problem solving without providing them with plenty of guidance and feedback.

2. Don't overload students by presenting information in redundant formats.

3. Don't give your students complex practice problems before they have the skills they need to succeed.

Research suggests that when teachers construct problems for students to practice, they should keep in mind the limitations of human memory.

Moving information to permanent storage is often explained as a multistore model of memory (Atkinson & Shiffrin, 1968; 1971; Baddeley, 1996; 2002). According to this model, our brains have three memory storage systems: sensory memory, short-term memory and long-term memory (Baddeley, 1996; 2002; Carlson, Sullivan, & Schneider, 1989). Learning occurs when we move information from working memory to long-term memory, and practice helps with this process.

Deliberate practice (sometimes called 'rehearsal') keeps the information in our short-term memory long enough for it to move to long-term memory. Once it is in long-term memory, it can be built upon to create more and more complex associations (Baddeley, 2002).

Most researchers agree that there are forms of Short-Term Memory (STM) for different modalities, such as visual STM, auditory STM and motor STM. For example, Baddeley (1992; 1996; 2002) suggests that short-term memory is a dynamic place where sounds and images are turned into verbal and pictorial models. STM is also thought to have a "central executive" that manages the information it is holding. This central executive also controls our awareness of that information (Baddeley, 2002).

The implication for teachers is that they should present material in multiple modalities. If a child who is learning to read hears a word, sees the word and a picture of the word, there will be more learning. The child can get the visual information from the visual STM and additional auditory information in the auditory STM. These two sensory sources of information supplement and complement one another (Liao, 2014). However, teachers must be careful not to have too much extraneous information in the classroom. Over stimulation can put too much demand on working memory (Pass & Kester, 2006).

Short-term or working memory

Working memory or short-term memory, is stored for very short periods of time - minutes at most. Information in our short-term memory is generally housed in the temporal lobe of the brain (the hippocampal region). It allows you to remember phone numbers and also information that comes from long-term memory right before you need to use it. Short-term memory is also the memory system that is used when we cram for a test at the last minute. Attention difficulties, distractions and overload of too much information all negatively impact our short-term memory and cause it to fail. We all have a limited ability to focus on too much stimuli at the same time, and if we don't process the information, we lose it. Practice helps us increase our ability to access information rapidly and automatically.

Practice also frees our brains to process more challenging information and problems. For example, if a child has memorized the multiplication table and can retrieve it automatically, working memory is freed to do more complicated computations.

Practice can improve children's working memory and enhance learning of academic skills, such as reading comprehension and mathematical reasoning (e.g., Dahlin, 2011; Gersten, Fuchs, Williams, & Baker, 2001; Holmes, Gathercole, & Dunning, 2009), verbal learning (Liao, Kronemer, Yau, Desmond, & Marvel, 2014) and motor skills (Gomes, Ugrinowitsch, Marinho, Shea, Raisbeck, & Benda, R., 2014).

And practice using visual spatial tasks can improve visual-spatial working memory (Melby-Lervag & Hulme, 2012; Shipstead, Redick, & Engle, 2012). Likewise, children can be taught a rehearsal or practice strategy to help them improve their reading comprehension (e.g., Gersten, Fuchs, Williams, & Baker, 2001; Rose, Cundick, & Higbee, 1983). Moreover, rehearsal is easier to learn and less demanding than other strategies (Turley-Ames & Whitfield, 2003).

Long-term memory

When working-memory is stored, it becomes long-term memory. Long-term memory is the depository of memories throughout the brain that results from the ongoing chemical processes that changes neuronal connections. The formation of long-term memories takes place over the span of days, weeks and in some cases years. As the memories are consolidated, neuron connections become more and more efficient, and in the process, connections that are no longer useful are discarded from lack of use.

Although the capacity of our long-term memory is apparently limitless (as far as we know, no one has ever stored all that the brain is capable of storing), working memory can typically hold only seven items (plus or minus 2) at any given time, and these items "decay" rapidly (Miller, 1956; Baddeley, 2002).

Research on the brains of rats has shown that relatively short periods of practice can enhance the plasticity of the brain and actually change its structure (Rioult-Pedotti, Friedman, Hess, & Donoghue, 1998). Brain imaging has shown that even a brief lesson on new words changes brain circuits (Allami, Brovelli, Hamzaoui, Regragui, Paulignan, & Boussaoud, 2014; Abdullaev & Posner, 1998; Raichle et al., 1994) and retrieval (Habib, Nyberg, & Tulving, 2003).

Experts and novices differ in the amount and structure of information stored in their long-term memories. These cognitive differences occur in large part because of differences in the amount of deliberate practice in which each has engaged (Cantor & Engle, 1993).

Extensive and deliberate practice makes it possible for students to access and apply increasingly complex information without explicitly thinking about it. In other words, it increases automaticity (see earlier discussion of automaticity) (Anderson, 2008; Case, 1985, 1991). Automaticity leaves students' working memories free to process new information (Kotovsky, Hayes, & Simon, 1985). Since working memory can be overloaded at any time, 'savings' from automaticity become very important. When there is too much information in our working memory it will fail, and the chemical processes that transfer information to our long-term memories also fail. Long-term learning is enhanced by a distribution process in which information is repeated, allowing time with time in between practice sessions, rather than crammed practice.

Reviews and tests are forms of practice that can improve learning. Tests (or quizzes) that are given immediately after a learning exercise give children opportunities to practice. Because learning is recent, students tend to do well on these tests. However, their success does not ensure long-term retention. Teachers can provide time during class to give students additional practice in taking tests. Some tests, such as tests with open-ended answers have been shown to enhance learning because they involve students in the "retrieval" of information from long-term memory. Tests are more effective when they are given at spaced intervals and when they are given frequently (Cull, 2000; Dempster; 1991; Rodriguez, Michael, 2004;Roediger & Karpicke, 2006).

Chunking information, or combining small bits together in short-term memory, is another strategy that students can use to increase their STM holding capacity. Although chunking gives a student more capacity in their STM, its usefulness depends on how much knowledge a person already has. The more knowledge one has on a topic, the more likely that one can "chunk" incoming information into larger and more meaningful chunks. This is why knowledge itself adds to one's ability to solve complex problems. Children who use chunking are more likely to be strategic about their learning. Teachers can help children become more strategic by explicitly teaching them strategies like chunking.

Example of chunking information

The following digits can be seen as a random list of numbers: 14921776. Random or meaningless information taxes the limited capacity of short-term memory (STM). However, if a student "chunks" the information into two dates (1492: Columbus discovered America; and 1776: the year the Declaration of Independence was signed) it is learned as 1492 1776. This leaves room in the short-term memory for more information.

Chunking allows several units of information to be compressed into a single meaningful unit or chunk (e.g., whereas a random number string above represents 8 discrete units to be stored in short-term memory (near its maximum capacity), the two meaningful dates represent only two chunks of information to be stored. This leaves space in the STM for more information to be held. And when more information is held in STM, there is more information available for transfer to long-term memory where it can be permanently stored (Gobet et al., 2001).

Chunking can develop experts' schema. Information stored in the brain in larger chunks of integrated concepts are known as "schemas." For example, a novice chess player who does not yet have complex schemas for chess playing has to devote his or her limited working memory to processing large amounts of information while playing (Anderson, 1996).

An expert, on the other hand, can easily access schemas from long-term memory (deGroot, 1966; Cantor & Engle, 1993). With practice, a novice player can construct chess-playing schemas and therefore increase the amount of information stored in long-term memory. In this way, practice accessing and applying knowledge helps one to transfer that knowledge into a "permastore" of long-term memory so that he or she can more efficiently utilize space available in the working memory (Elo, 1978; Kotovsky & Fallside, 1989).

Theories explaining expert performance

1. Many researchers (e.g., Ericsson et al., 1993; Baddeley, 2002) argue that differences in the amount of practice account for the majority of performance differences between individuals, resulting from differences in the amount and structure of knowledge stored in long-term memory.

2. Other researchers emphasize innate, genetic differences or talent as the main factor accounting for differences between expert and novice performance (Mosing, et.al., 2014; Plomin, DeFries, McClearn, & Rutter, 1997).

3. More recently, researchers have emphasized an interaction between innate and behavioral factors in accounting for differences in performance levels (Gobet & Campitelli, 2007).

Overall, the research supports the view that deliberate practice plays a role in performance differences and can reduce performance differences between individuals who are thought to possess talent and those who do not (Chase & Ericsson, 1981). See Gobet and Campitelli (2007), Mosing, et.al., (2014) and Macnamara, et.al., (2014) for a comprehensive review of this debate.

What can a teacher do to maximize the positive effect of practice?

When teachers assign students to complete practice problems that are structurally similar but different in surface features, it helps them discriminate between relevant and irrelevant information in a given problem. This outcome makes it more likely that students will be able to transfer knowledge gained from practice to new and more complex problems (Paas, 1992). As with all scaffolds, they should be diminished gradually as learners become increasingly more independent.

Students' problem-solving skills also increase when teachers distribute practice over time rather than "cramming" practice into short periods (Bahrick & Hall, 2005). Assignments involving practice are more effective when they are shorter, more frequent and distributed over longer periods of time (Cooper, 2007; Cooper, Robinson, & Patall, 2006; Epstein & Van Voorhis, 2010). This distributive effect is particularly important because it also makes it more likely that students will recall information over longer periods of time. Therefore, distributed practice helps students transfer information into their long-term memory.

Teachers should also have students begin homework during class. By doing so, teachers can monitor students to ensure they understand and can solve practice problems correctly before they practice independently. If teachers are unable to monitor this initial practice, they should explain to their students where they can obtain the information (textbooks, web sites, handouts, etc.) they need to complete the assigned practice problems correctly.

Reviews and tests are a form of practice that can improve learning. Tests provide opportunities for practice that enhance learning. Open-ended test questions also provide practice in retrieving information. Both reviews and tests are most effective when they are well spaced and frequent (Dempster, 1991).

Teachers can train students to reflect on their thinking when solving problems by providing them with lists of questions. This kind of "strategy instruction" helps students to construct schemas more efficiently by facilitating a metacognitive awareness of the problem-solving process. That is, students learn more about how they learn and this helps them with new learning.

Teachers can increase students' abilities to transfer existing problem-solving knowledge to new problems when they prompt students to deliberately reflect on problem-solving strategies they have used before. (Renkl, Stark, Gruber, & Mandl, 1998; Rosenshine & Meister, 1992; Stark, Mandl, Gruber, & Renkl., 2002).

Is homework always effective practice?

There is no question that homework can provide students with opportunities for practice but there are more and less effective homework assignments. Research on homework (Cooper, 2001, 2006; Epstein & Van Voorhis, 2010) suggests that the relationship between time spent on homework and students' academic achievement varies with grade level. When parental involvement is well structured it can also enhance the effectiveness of homework on learning (Epstein & Van Voorhis, 2010; Marzano & Pickering, 2007).

How much time should be spent on homework?

Although high school students appear to benefit from at least two hours of homework per night, there is little or no relationship between time spent on homework and academic achievement for young (grades 1-3) students (Marzano, & Pickering, 2007). Younger students may benefit more from supervised in-school practice than from homework. Middle school students may benefit from one to two hours of homework per night (Cooper, 2007).

Will practice activities negatively affect students' motivation? Aren't practice activities the same as "drill and kill" instruction?

Although deliberate practice is often confused with rote learning, researchers emphasize that there is a difference between mere repetition and deliberate practice. For practice to be effective, appropriate instruction, guided practice, as well as descriptive and timely feedback must all be present.

Does practice with "authentic" problems increase learning?

Due to their relevance, "authentic" problems or "real-life" problems may motivate students. However, the positive effect of practice is only realized when teachers provide instructional supports that address the limitations of students' working memories (Anderson, Reder, & Simon, 1996, 2000; Sweller, van Merrienboer, & Paas, 1998; van Merrienboer, Kirschner, & Kester, 2003). If there is cognitive overload and the working memory is taxed beyond its capacity, students will lose motivation even if a problem is highly relevant to them.

Although "authentic" practice problems sound like they would motivate students with their real-world context; they may also include too many variables at the same time. Students' working memories are thus required to manage too many bits of information, and many of these bits may not be directly involved with the construction of the desired schema (Sweller & Chandler, 1994).

Is there such a thing as too much practice?

Merely repeating a task will not automatically improve performance. Deliberate practice is most effective when it involves intense concentration, rehearsal and reflection. For that reason, students are more likely to benefit from frequent, short practice sessions than from long "cramming" sessions. Teachers can foster this meta-cognitive learning process by providing students with frequent opportunities to discuss their problem-solving strategies (National Research Council, 2005).

Even in early grades when students are acquiring foundational knowledge, practice should not be confused with rote learning. For example, phonics instruction is most effective when it is practiced alongside more complex skills like identifying main ideas in stories (National Institute of Child Health and Human Development, 2000).

Does practice work for all academic subjects?

Practice is correlated with student achievement across all developmental levels and across all subjects. NICHD's (2000) analysis of strategies for reading instruction suggests that several kinds of practice activities are beneficial to students. Phonemic awareness practice, phonics practice and read-aloud practice all showed significant positive effects on student achievement in the early grades. Teachers should always keep long-term goals in mind when they are designing practice activities. The ultimate purpose of phonics instruction is not for students to identify phonemes, but rather, to improve their reading comprehension. The goal of practice is to transfer acquired skills to new and more complex problems. Therefore, practice activities should always be designed with that transfer process in mind.

Studies in mathematics education show that practice is effective when teachers design appropriate practice problems, distribute them over time, and provide students with sufficient feedback. Practice is ineffective when it is not appropriately designed, not well distributed, and when adequate feedback is not provided.

Deliberate practice is also effective in learning complex skills from musical fluency to athletic expertise.

When does the strategy work?

All students benefit from well-designed, developmentally-appropriate deliberate practice activities. A meta-analysis (Macnamara, Hambrick, & Oswald, 2014) showed that the effects of deliberate practice are robust for games, music and sports, and modestly effective in education.

Deliberate practice can also provide a bridge over the gaps that exist between different achievement levels. Achievement gaps often exist because of unequal opportunities for students to engage in appropriate deliberate practice rather than unequal learning abilities. As children grow older, they become better able to benefit from instruction on appropriate strategies like rehearsal, reflection and "chunking" information.

Special populations benefit from practice activities that are designed to meet their needs (Chapman, & Mudar, 2014; Nunes, Barros, Evans, & Burman, 2014; Rose, Cundick, & Higbee, 1983). For example, research on children with language processing problems suggests that their difficulties are due to sensory perception rather than an inability to learn. One reason that language-learning impaired students have difficulty learning to read is that their phonemic recognition and spatial discrimination perceptions are impaired. Appropriate practice activities have been shown to help these students compensate for their difficulties (Merzenich et al., 1996). Cooper's (2001) examination of homework practice suggests that students with learning disabilities benefit most from short, skill-reinforcing activities that are carefully monitored (see also Marzano & Pickering, 2007).

Description of research on the use of practice activities with children with learning disabilities

An extensive meta-analysis of interventions for students with learning disabilities found that practice-drill-review instructional strategies were generally effective across academic subjects (Swanson, Hoskyn, & Lee, 1999). Another meta-analysis of inclusion settings found that time-on-task correlated with student achievement across subject areas (Brophy & Good, 1986). Therefore, practice activities appear to be a key factor in student achievement across grade levels, skill levels and academic domains.

In summary, well-designed practice activities result from careful planning where teachers:

Model problem-solving processes.

Design partially-completed examples on which students can practice.

Sequence activities logically.

Space practice activities appropriately.

Monitor student practice providing guidance and feedback.

Is practice effective across the age span?

Children grow more strategic as they get older. Younger children are less strategic - are less likely to rehearse, practice, or chunk spontaneously or to know how to do these things well. They are also less likely to monitor their own knowledge or to use metacognitive strategies. Younger children are less likely than older children to know what they need to rehearse or practice more. Therefore, teachers of younger children should introduce them to strategies such as rehearsal and practice, and in this way can help students improve their learning.

Deliberate practice is effective across all school age levels. Fundamental practice skills are more appropriate for earlier grades than it is for later grades. Teachers can focus younger students on the skills they will need later when they tackle more complex tasks. For example, phonemic awareness instruction is more effective for preschool students than for older elementary school students (NICHD, 2000), but it remains a skill that is very useful in later grades.

Teachers should design developmentally appropriate practice problems for students. Students' memories and attention spans develop with age (Gomez-Perez & Ostrosky-Solis, 2006; Lechuga, Moreno, Pelegrina, Gomez-Ariza, & Bajo, 2006). In general, older students have greater attention spans and greater memory capacity than younger students. This may account for developmental differences seen in the benefits of homework (Cooper, 2001; Muhlenbrook, Cooper, Nye, & Lindsay, 1999) and age differences in the amount of practice that learners engage in outside the classroom (Ericsson et al., 1993). Teachers should plan the type and amount of practice students are expected to do with these developmental differences in mind.

Research on expert performance shows that experts increase the amount of deliberate practice they engage in over time. For example, research by Ericsson and colleagues (1993) on expert violinists revealed that in early childhood they practiced no more than five hours per week. However, by their early twenties, they practiced around thirty hours per week. Because deliberate practice is so taxing, it should be balanced with sufficient periods of rest. Younger learners tire more quickly and lose their motivation to persist if they are not allowed sufficient rest (Ericsson et al., 1993; NICHD, 2000).

Elementary

Early elementary students benefit little or not at all from homework (Campitelli & Gobet, 2011; Cooper, 2001; Halford, Maybery, & Bain, 1986).

Expert violinists practiced fewer than 5 hours per week at the early childhood stage (Ericsson et al., 1993; Macnamara et al., 2014).

Research supports the idea that practice can help elementary students overcome processing deficits (Merzenich et al., 1996).

Practice with phonemic awareness has been shown to have a positive effect on reading outcomes in elementary readers through 6th grade. Effects were not as strong for disabled readers as they were for at-risk and normally progressing readers. The effects of phonemic-awareness instruction were strongest when it was provided in earlier grades (especially pre-K and kindergarten), in small group settings, in shorter training programs and to English-speaking students (NICHD, 2000).

Research suggests that systematic phonics instruction helps students learning to read. The effects of systematic phonics instruction were greater when it was provided in earlier grades (especially kindergarten and 1st grade) (Dahlin, 2011; Gersten, Fuchs, Williams, & Baker, 2001; NICHD, 2000).

A meta-analysis of intervention strategies for students with learning disabilities found that phonics instruction positively affects development of vocabulary, although the results on comprehension were unclear (Swanson et al., 1999). (The mean age for the study participants was 11; 78% of the studies targeted 9-14 year age range.).

Research suggests that repeated and guided-repeated oral reading strategies have a positive effect on reading performance through grade four, especially for non-impaired readers (Dahlin, 2011; Gersten, et al., 2001; Rose et al., 1983).

Swanson et al.'s (1999) meta-analysis suggests that "the teaching of whole language without due attention to decoding places LD children at greater risk than the use of more traditional programs" (p. 254).

Vocabulary instruction (both explicit and implicit) has a positive effect on vocabulary acquisition. Research indicates that students should be exposed to vocabulary repeatedly and in multiple contexts (NICHD, 2000).

Research suggests that reading comprehension strategy instruction (e.g., cognitive and meta-cognitive strategies) has a positive effect on reading comprehension and memory in grades 3-6. The effects were greater when strategy instruction was more intensive and when students were instructed in multiple strategies (NICHD, 2000).

Research suggests that "drill-repetition-practice" instructional strategies are beneficial to students with learning disabilities across all age groups and across all subjects (Swanson et al., 1999).

Middle School

Middle school students may benefit from one to two hours of homework per night (Cooper, 2001; Campitelli & Gobet, 2011).

Research suggests that partial-task practice problems are more effective than whole-task practice problems for some 13 year-old math students. Partial-task practice lowered the processing demands on working memory for all students, but it only increased learning for students with low prior knowledge. Students with high prior knowledge benefited more from whole-task practice (Ayres, 2006).

Research suggests that when modeling problem-solving strategies, the use of worked examples is beneficial for middle school students' writing performance. As with Ayres' (2006) study, however, the positive effects were limited to low-performing students. The results suggested that "low-level" writers benefited from worked-example practice problems, while "high-level" writers benefited from "goal-free" practice problems.

Research suggests that the use of repeated and guided-repeated oral reading strategies positively affect students' reading performance. This is especially true for students with reading problems (NICHD, 2000).

Programs aimed at encouraging students to read more (e.g., self-selected, silent reading) yielded no significant positive effects on reading achievement (NICHD, 2000).

Swanson et al.'s (1999) meta-analysis suggests that "the teaching of whole language without due attention to decoding places LD children at greater risk than the use of more traditional programs" (p. 254).

Results that support the positive effects of vocabulary instruction (both explicit and implicit) on vocabulary acquisition indicate that students should be exposed to vocabulary repeatedly and in multiple contexts (NICHD, 2000).

Research suggests that reading-comprehension-strategy instruction (e.g., cognitive and meta-cognitive strategies) has a positive effect on reading comprehension and memory in grades 3-6. The effects were greater when strategy instruction was more intensive and when students were instructed on multiple strategies (NICHD, 2000).

Research suggests that "drill-repetition-practice" instructional strategies are beneficial to students with learning disabilities across all age groups and across all subjects (Swanson et al., 1999).

High School

High school students appear to benefit from at least two hours of homework per night, (Campitelli & Gobet, 2011; Cooper, 2001).

Students may benefit from more practice with the transfer of component skills than from practicing whole-task transfer (Pollock, Chandler, & Sweller, 2002). Examples worked out in advance for students were more effective for algebra problem solving transfer than were conventional problems for 9th and 11th grade students (Sweller & Cooper, 1985).

Repeated and guided-repeated oral reading strategies positively affect reading performance. This is especially true for high school students with reading problems (NICHD, 2000).

Programs aimed at encouraging students to read more (e.g., self-selected, silent reading) yielded no significant positive effects on reading achievement (NICHD, 2000).

Although research supports a positive effect of vocabulary instruction (both explicit and implicit) on vocabulary acquisition in grades 9-11, few studies have been conducted at that level. Results that do exist suggest that students should be exposed to vocabulary repeatedly and in multiple contexts (NICHD, 2000).

Research suggests that "drill-repetition-practice" instructional strategies are beneficial to students with learning disabilities across all age groups and across all subjects (Swanson et al., 1999).

Where can teachers get more information?

Anderson, J. R. (1996). ACT: A simple theory of complex cognition. American Psychologist, 51(4), 355-368. http://dx.doi.org/10.1037/0003-066X.51.4.355

Bransford, J. D., Brown, A. L., & Cocking, R. R. (Eds.). (2000). How people learn: Brain, mind, experience, and school. Washington, D.C.: National Academy Press. ISBN 0-309-07036-8

Carver, S. M. & Klahr, D. (Eds.). (2001). Cognition and instruction: Twenty-five years of progress. Mahwah, NJ: Erlbaum.

# data[].attributes.attachment_link.title
Practice for knowledge acquisition (not drill and kill)

# data[].attributes.attachment_link.description
It doesnt matter what subject you teach, differences in students performance are affected by how much they engage in deliberate practice. Researchers who have investigated expert and novice performance have uncovered important distinctions between deliberate practice and other activities, such as play or repetition. Deliberate practice is not the same as rote repetition.

# data[].attributes.headline
42 pages to read before the fall semester...

# data[].attributes.subject
42 pages to read before the fall semester...

# data[].attributes.headline
Turn PowerPoint lectures into active learning sessions...

# data[].attributes.subject
Turn PowerPoint lectures into active learning sessions...

# data[].attributes.attachment_link.readable_text
How well do students learn when a lesson is mainly in PowerPoint? Henrik Berger Jørgensen, CC BY-NC-ND

For a brief period in the history of teaching, using PowerPoint automatically qualified you as a tech-savvy professor - an innovator who wouldn't settle for the usual combination of staticky black-and-white overhead films and hand-scrawled chalkboard notes.

Now, it's hard to believe that PowerPoint was once considered innovative by anyone. Popular criticism includes everything from tongue-in-cheek comments about death by PowerPoint to serious claims that it fundamentally degrades how we think and communicate.

But much of today's college instruction isn't in face-to-face classrooms, a setting in which PowerPoint was traditionally used. It's in the burgeoning field of online learning.

So if more learning is moving online, does that mean that teaching with PowerPoint is becoming a thing of the past?

Surprisingly, the answer is no.

Passive learning through PowerPoint?

Even though there's little research that directly addresses whether PowerPoint affects learning in college students, critics have questioned its value in educational settings.

Some ask whether PowerPoint might indirectly undermine the quality of teaching by reinforcing a passive learning approach.

We know that lecturing is less effective than alternative methods. It therefore makes sense for teachers in face-to-face classrooms to question how much of their class time ought to be spent on slideshows.

But the fact is "slideshows" remain a popular method for presenting content in today's online courses.

Technically, these are often not PowerPoints, but decks generated using other types of specialized programs.

And they may differ from standard in-class PowerPoint presentations in important ways.

For example, taking advantage of the increased flexibility of the online environment, they give students more control over how quickly to go through the material and when to backtrack. They can also have more interactive features, such as quizzes, that ask students to apply material while they are learning it.

Even so, the basic - and flawed - idea is the same: put the material in front of students, and learning will happen.

What's wrong with slideshows in online courses

As a psychologist specializing in teaching techniques and course design, when I talk to faculty about teaching effectively with technology, I sometimes tell them to follow the ABS principle: anything but slideshows.

I'm only half-kidding with that blanket statement.

After all, we learn with the same brains in online environments as we do face-to-face; the principles of learning don't change just because the medium changes. And today's learning theorists agree: active involvement trumps passive viewing.

Students need to grapple with challenging problems, practice skills, discuss and defend viewpoints. But for this kind of active learning to happen, instructors need to ensure they do not rely too heavily on slides.

There are alternatives: simulations, problem-based learning, even educational games are all proven methods for drawing students in. They also transplant well into online learning.

Using slideshows the right way

So do slideshows have any place in a well-designed online course? Possibly.

They can be used strategically for things they are best at: giving students an overview of new material, or providing a refresher on concepts students will need for an upcoming activity.

Slides are also great for for integrating visual illustrations. This is important because visuals - diagrams, figures, photos and the like - have a powerful impact on learning.

Visual information is almost always more memorable than sound, text or other modalities.

This isn't because of the now-debunked idea that some people are "visual learners," but more likely stems from how the brain codes images. There are separate systems for representing verbal and visual information in the brain. When we save information in both places, it is easier to recall.

Teachers don't have to stick with static images, either. Even basic animations can illuminate conceptual relationships - such as cause and effect, or the unfolding of a process over time - in ways that text can't.

Furthermore, as University of California, Santa Barbara researcher Richard Mayer has discovered, visuals and the spoken word pair up in powerful ways, so that audio plus visuals produce better learning than either alone.

Research also tells teachers some things not to do with visuals. Instructors should avoid purely decorative graphics, as these can actually hamper learning.

They should also eschew reading text verbatim, instead using a conversational, natural speaking style for voiceovers and verbal explanations.

What this means in the larger context of online learning

In sum, slideshows can be a useful part of online instruction, when used for the right things and designed in the right way. But they shouldn't be the main, or the only, method of instruction - any more than lectures should dominate face-to-face classes.

But it's not just instructors who need to hear this message.

Publishing and educational technology companies, who provide many of the tools that educators rely on, can do more to develop products that push beyond familiar formulas and draw on the latest learning science.

We need tools that make it easy to create assignments that ask students to apply what they have learned, in scenarios that are as realistic and challenging as possible.

These learning tools also need to be adaptive, adjusting the material and pace to the individual learner. This kind of educational technology does exist, but far more can be done to expand the available options.

Teaching in the age of technology comes with its own set of opportunities as well as challenges. And online education presents educators and tech developers with a rare opportunity to fundamentally rethink what we do.

Will we use it to explore new avenues for learning, or will we fall back on the the same old techniques that don't work well in face-to-face classrooms?

# data[].attributes.attachment_link.title
Learning from PowerPoint: is it time for teachers to move on?

# data[].attributes.attachment_link.description
Slideshows, when designed right, can be a useful part of online instruction. But they shouldn't be the main, or the only, method of instruction.

# data[].attributes.headline
Osmosis Videos on You Tube: Concise Modules for Learning Diseases 

# data[].attributes.subject
Osmosis Videos on You Tube: Concise Modules for Learning Diseases 

# data[].attributes.attachment_link.readable_text
There is no shortage of formative assessment strategies, techniques, and tools available to teachers who use formative instructional practice in their classrooms. Here is an extensive list of 75 digital tools, apps, and platforms that can help you and your students use formative assessment to elicit evidence of learning. We didn't just add any old tool to this list. Here are the criteria we used for those that made the cut:

Supports formative instructional strategies and ways to activate learners to be resources for themselves and peers

Is free or awful close to it (under $10 per year, where possible)

Allows both students and teachers to take the activator role when possible (sometimes teachers need to get things started)

Before you dig into the tools, I encourage you to spend some time thinking about exactly what you want to accomplish with your students. "How to pick the right digital tool: Start with your learning goal" by Erin Beard can help you wrap your head around goals and guide you in choosing the best tool for the task. "27 easy formative assessment strategies for gathering evidence of student learning" can help you decide what strategies work best for you and your students.

Record audio and video

Create quizzes, polls, and surveys

1. Crowdsignal Lets you create online polls, quizzes, and questions. Students can use smartphones, tablets, and computers to provide their answers, and information can be culled for reports.

2. Edulastic Allows you to make standards-aligned assessments and get instant feedback.

3. FreeOnlineSurveys Helps you create surveys, quizzes, forms, and polls.

4. Gimkit Lets you write real-time quizzes. And it was designed by a high school student!

5. Kahoot! A game-based classroom response system that lets you create quizzes using internet content.

6. MicroPoll Helps you create polls, embed them into websites, and analyze responses.

7. Naiku Lets you write quizzes students can answer using their mobile devices.

8. Obsurvey Designed to make surveys, polls, and questionnaires.

9. Poll Everywhere Lets you create a feedback poll or ask questions and see results in real time. Allows students to respond in various ways. With open-ended questions, you can capture data and spin up tag clouds to aggregate responses.

10. Poll Maker Offers unique features, like allowing multiple answers to one question.

11. ProProfs Helps you make quizzes, polls, and surveys.

12. Quia Lets you create games, quizzes, surveys, and more. Access a database of existing quizzes from other educators.

13. Quizalize Helps you create quizzes and homework.

14. Quizizz Guides you through designing quizzes and lets you include students in the quiz-writing process.

15. Quizlet Lets you make flashcards, tests, quizzes, and study games that are mobile friendly.

16. Survey Hero Designed to build questionnaires and surveys.

17. SurveyMonkey Helpful for online polls and surveys.

18. SurveyPlanet Also helpful for online polls and surveys.

19. Triventy Lets you create quizzes students take in real time using individual devices.

20. Yacapaca Helps you write and assign quizzes.

21. Zoho Survey Allows you to make mobile-friendly surveys and see results in real time.

Brainstorm, mind map, and collaborate

Present, engage, and inspire

Generate word or tag clouds

1. EdWordle Generates word clouds from any entered text to help aggregate responses and facilitate discussion. Word clouds are pictures composed of a cloud of smaller words that form a clue to the topic.

2. Tagxedo Allows you to examine student consensus and facilitate dialogues.

3. Wordables Helps you elicit evidence of learning or determine background knowledge about a topic.

4. WordArt Includes a feature that allows the user to make each word an active link to connect to websites, including YouTube.

Get real-time feedback

Foster family communication

1. Remind Lets you text students and stay in touch with families.

2. Seesaw Helps you improve family communication and makes formative assessment easy, while students can use the platform to document their learning.

3. Voxer Lets you send recordings so families can hear how their students are doing, students can chat about their work, and you can provide feedback.

Strengthen teacher-to-student or student-to-student communication

Keep the conversation going with live chats

1. Yo Teach A backchannel site great for keeping the conversation going with students.

2. Chatzy Supports live, online chats in a private setting.

Create and store documents or assignments

1. Google Forms A Google Drive app that allows you to create documents students can collaborate on in real time using smartphones, tablets, and laptops.

2. Piazza Lets you upload lectures, assignments, and homework; pose and respond to student questions; and poll students about class content. This tool is better suited for older students as it mimics post-secondary class instructional formats.

Learn more

There are several resources for learning more about formative assessment and responsive instruction strategies. Consider our formative practices workshops, where school and district teams can gain a better understanding of the role formative practice plays in instruction and the four foundational practices to use in the classroom. Or for a quick start, download our eBook "Making it work: How formative assessment can supercharge your practice."

Jump in, try new tools and methods, and have fun!

# data[].attributes.attachment_link.title
75 digital tools and apps teachers can use to support formative assessment in the classroom

# data[].attributes.attachment_link.description
We've compiled an extensive list of 75 digital tools that can help teachers use formative assessment to elicit evidence of student learning.

# data[].attributes.attachment_link.title
Kahoot! | Learning games | Make learning awesome!

# data[].attributes.attachment_link.description
Kahoot! is a game-based learning platform that brings engagement and fun to 1+ billion players every year at school, at work, and at home.

# data[].attributes.attachment_link.description
This content has been developed to support nursing students preparing for the National Council Licensing Examination for Registered Nurses (NCLEX-RN). All of this content has been created under the direction of Khan Academy and has been reviewed under the direction of the the American Association of Colleges of Nursing (AACN).