Designing online learning for adults: authentic assessment, authentic learning

For adults learning online the goal of assessment should be to support and extend authentic learning.

By Deborah Ottman

In previous posts on creating online learning experiences for adults, Associate Director of Professional Development Deborah Ottman emphasized the importance of keeping your particular audience in mind as you determine the goals and learning objectives of your training or course. She also talked about structuring the learning experience—what she calls “finding a flow.” In her most recent post, she discussed fostering learner engagement and a sense of community online. In this final post in the series, which is intended for subject matter experts, Deb shows how assessment can both gauge students’ learning and build on it.

For subject matter experts and students alike, assessment can seem like something of a chore. I often think this harks back to the test anxiety that many of us have felt at one time or another when faced with a final exam or a standardized test. Yet assessment is integral to learning, and I’d argue that an assessment itself presents a great opportunity for learning to take place. The goal of an assessment should be to support and extend authentic learning. This is true whether you are designing a professional development training or an online course for degree-seeking students.

There are two general categories of assessment: formative and summative. Formative assessment happens on a regular, ongoing basis. Summative assessment takes place at the close of a section of the course or at the close of the course itself. In both instances, assessment allows the instructor to evaluate, measure, and document the strides students have made, as well as to uncover where additional learning needs may be. Moreover, formative assessment yields important information that the instructor can use to adjust instruction as the course progresses. It also provides ongoing feedback to learners, be it a percentage of correct answers on a quiz, a letter grade on a paper, or a reflective written response to a discussion post.

It’s helpful to start thinking about how assessment will be accomplished while you are gathering and organizing content. To kick start that process, I’d suggest circling back to the course goal(s) and learning objectives that you formulated at the outset. One of our guiding questions was:

What do the students need to learn?

The course goal(s), along with the learning objectives connected to achieving each goal, represented your answer to this question, and your answers shaped your content selections. They can serve the same purpose here. Let’s add another guiding question that is specific to assessment:

How can learners provide evidence that they’ve achieved the goal(s) and objectives?

I’m not talking about choosing between a multiple-choice and a true-or-false quiz, or an essay question versus a discussion board prompt. Let’s think more broadly. When considering professional development, we know that adult learners need to feel new content will be useful to their work role, so assessments should reinforce the practical application of the content. Subject matter experts will want to incorporate activities that permit learners to flex their new skills and apply their new knowledge. This can happen either out in the “real world” or through relatable tasks, scenarios, or case studies that are included in the course materials. This is known as authentic assessment.

Consider this helpful definition from education consultant Grant Wiggins, author of “Healthier testing made easy: the idea of authentic assessment”:

What do I mean by “authentic assessment”? It’s simply performances and product requirements that are faithful to real-world demands, opportunities, and constraints. The students are tested on their ability to “do” the subject in context, to transfer their learning effectively.

The best assessment is thus “educative,” not onerous. The tasks educate learners about the kinds of challenges adults actually face, and the use of feedback is built into the process. In the real world, that’s how we learn and are assessed: on our ability to learn from results.

Authentic assessment boosts knowledge acquisition by asking learners to apply their new knowledge to activities that mimic professional situations and settings. Recall that this also is a factor in strengthening learner engagement; this kind of assessment is a true win-win.

As you think about the “what” and “how” of measuring students’ learning, it’s helpful to work with an instructional designer if possible to learn about the wide variety of tools and technologies that are available. Alignment comes into play once more. When evaluating an assessment tool, you’ll want to consider its validity—that is, whether it actually measures the learning it is supposed to measure. It’s worth taking time to thoughtfully pair the mode of assessment with the knowledge or skills being assessed. That way, not only can the assessment itself be called authentic, so can the learning!

Meet CEED’s newest team member: Q & A with Anne Larson

CEED is delighted to welcome Anne Larson, PhD, to our team as a research associate.

CEED is delighted to welcome Anne Larson, PhD, to our team as a research associate. Dr. Larson studies the development and implementation of practitioner-supported and caregiver-implemented language assessments and interventions for young children. She and her family have just relocated to the Twin Cities from Utah, where Dr. Larson was on the faculty at Utah State University. However, she is no stranger to Minnesota, having completed her doctorate at the University of Minnesota after establishing a career as a speech-language pathologist in Twin Cities public schools.

Q: Your research centers on language assessments and interventions for young children. Talk a little bit about some of the specific topics that interest you.

photo of Anne Larson

AL: In terms of language assessments, I’m interested in identifying screening and progress monitoring tools that can be used for children under age three. There are very few measures available and even fewer that have included children and families from historically marginalized racial, ethnic, and linguistic groups in their development. In a recent project, we looked at the initial validation of the Early Communication Indicator (ECI) for Spanish- and Spanish-English dual language learners. Long-term, I’d like to explore modifications of the ECI and other measures, such as vocabulary checklists, for children from a variety of cultural and linguistic backgrounds.

My research on language interventions typically involves children who are around 18-30 months old. However, the projects I work on actually focus on the adult caregiver or caregivers who interact with the child. For one recent study, we trained early intervention providers to use a coaching approach in their work with caregivers of young children with disabilities. Although the focus of the study was changing provider behavior, the ultimate goal was to promote the use of naturalistic language intervention strategies by caregivers. Using these strategies, the caregivers can then affect child language outcomes.

Naturalistic language interventions are ways to support responsive and engaging interactions between children and their caregivers. Caregivers can include parents, other family members, childcare providers, and so on. An example of a naturalistic intervention strategy might be: “Comment on what the child is doing.” This strategy encourages caregivers to provide more language input around their children. These strategies are designed to be embedded within everyday activities and routines, rather than adding something extra for caregivers to make time for with their children.

Q: Your work is described as community-based research. Could you talk a bit about what that term means, as well as the rewards and challenges of this type of research? Why is this approach so important?

AL: I think of community-based research as having a genuine interest in community needs and making a concerted effort to work with community members and stakeholders as part of the research team. This approach is very rewarding to me, because I know that my research is immediately relevant to the target group. It is sometimes challenging, however, to describe this more collaborative approach, because some communities have had the experience of researchers coming in and telling them what to do without first engaging them and listening to their needs. I’m looking forward to building on relationships I have in Minnesota, understanding community needs, and continuing with this work to make critical strides for young children and families in Minnesota.

Q: Tell us about the work you will be doing with your Institute of Educational Sciences Career Award.

AL: The Early Career Award is focused on designing a language intervention that I refer to as VALI (Video- and App-based Language Instruction). This will be a four-year project. We’ll develop three iterations of an intervention for Spanish-speaking families who identify as Latinx and also have young children with language delays. Caregivers will access an app with information about naturalistic language intervention strategies that they can use with their children. Caregivers will also participate in back-and-forth asynchronous coaching with a trained bilingual early interventionist who can support their individual family needs.

Q: Your role at CEED will also include work with the Reflective Practice Center; how does reflective practice come into play in your area of study?

AL: Reflective practice has a lot of similarities with the coaching-based models I use in my research. The more I learn about reflective practice, though, the more ideas I encounter that can be incorporated into my work. I’m looking forward to expanding reflective knowledge and practice within the field of early intervention. I think there are many practitioners who, like me, may not previously have been aware of reflective practice or its benefits for providers, families, and children alike.

Q: What are some of your interests and hobbies outside of work? (That’s assuming that family life with young children allows for hobbies!)

AL: You’re right that “me” time is fairly limited with two young children! I enjoy family bike rides, hiking, and camping.