Assessment is the evaluation or estimation of the nature, quality, or ability of someone or something, while feedback integrate the output of the assessment in the learning process.

Assessment and feedback phase falls in the overall Nicholls process (Via et al. 2020, Nicholls 2002):

Open image in new tab

Teaching goal for this session is to develop an understanding of different types of feedback and assessments, when to give and receive feedback, and for which purpose.

Assessments

There are different types of assessments:

They can be categorised in different ways:

Hands-on: Diagnostic Assessment - time 15 min - Groups of 4

Discuss how you could collect information from learners at the beginning of a course or lesson and how you can use it

Formative vs summative assessment

Formative assessment takes place during teaching and learning. Its purpose is to help both instructors and learners to become aware of what the focus should be. Its purpose is to improve the quality of students’ learning, not to provide evidence for evaluating or grading students.

Summative assessment takes place at the end of teaching and learning. Its purpose is to evaluate learners’ learning by comparing it against a standard or benchmark, and provide evidence for evaluating or grading students.

Comment: At the end of teaching

For summative assessment, ‘the end’ does not necessarily mean the end of an entire course or module of study. Summative assessments may be distributed throughout a course, after a particular unit (or collection of topics) has been taught, but graded any how.

What are the methods for summative assessment? You do remember some of the methods used in summative assessment when you are a student or from being a teacher:

• Questionnaires
• Interviews
• Observations
• Testing: specific test created by the teacher or establishment made to include all points of a unit or specific information taught in a given time frame
• Projects: a culminating project that synthesizes knowledge

Summative assessment should be

• Aligned to LOs (levels of complexity, what you taught, the level you taught it)
• Objective
• Feasible

Open image in new tab

In training, the scope here, the focus is on formative assessment (collect information / feedback on how learning is progressing). We will from now on only talk about formative assessment.

Formative assessment takes place during teaching and learning. Its purpose is to help both instructors and learners to become aware of what the focus should be. Its purpose is to improve the quality of student learning, not to provide evidence for evaluating or grading students.

Formative assessment collect feedback (information) from learners’ on their learning progress :

• Goals and objectives: if learners goals and objectives are aligned to the course’s goals and outcomes
• Prior knowledge: which knowledge gaps need to be filled before moving on
• Mental models: whether their mental models are correct
• Frequent mistakes: which types of mistakes need special attention
• Ability to perform a task

Hands-on: Collecting formative assessment - time 10 min - Groups of 4

1. Find an example on how to collect information on learners’ mental models
2. Find an example on how to collect information on learners’ goals and objectives
3. Find an example on how to collect information on learners’ frequent mistakes

It should be highlighted that the best practice for teaching is to:

• Constantly monitor what is happening to students’ learning
• Investigate when things do not proceed as planned or expected
• Act upon to improve learning
• Provide feedback to learners on how to progress

Collecting data from learners through formative assessment

Formative assessment & feedback can be done in many different ways:

• Providing diagnostic questionnaires
• Asking questions to learners and getting responses orally
• Asking them to describe the strategy they would adopt to solve a problem
• Asking them to solve a problem in groups, or individually but in front of the class
• Using brainstorming and discussions

Diagnostic questionnaires

Questionnaires

Anonymous questionnaires allow to have an idea of the level of knowledge of the whole group of learners.

Non-anonymous and personal questionnaires allow to find out if the learner has a necessary pre-required knowledge, in the negative case indicate an appropriate teaching choice to palliate this lack.

Instant feedbacks or minute cards

Before each long break, for example lunch or between days, we can have learners to complete minute cards to share anonymous feedback. At an in-person workshop, paper sticky notes double as minute cards, with the two different colors used for positive and constructive feedback. At an online workshop, this may be done by making a copy of the Virtual Minute Card Template from the Carpentries on Google Forms. Other tools can work as well, but we do recommend making sure that feedback is private and anonymous. A public-facing sticky note board will receive different (and less useful) feedback.

During long breaks, instructors read through the minute cards and look for patterns. At the start of each half day, the Instructors take a few minutes to address commonly raised issues with the whole class. The non-teaching Instructor can also type answers to the questions in the Etherpad.

Another way to get instant feedback is the Fist of five. It is a simple format for asking for agreement or disagreement, or understanding on a topic by a show of hands. Each hand signal has a different meaning:

• Fist: “I do not understand”
• 1 finger – index finger: “I have (major) concerns that need to be heard and resolved immediately.”
• 2 Fingers – index finger and middle finger or thumb and index finger: “I have (minor) concerns that we need to resolve now.”
• 3 fingers – thumb, index finger and middle finger or index finger, middle finger and ring finger: “I have (minor) concerns but can live with the continuying. My concerns should be resolved soon.”
• 4 Fingers – Index finger, middle finger, ring finger and little finger or thumb, index finger, middle finger and ring finger: “I got it.”
• 5 fingers (Five) – Showing open hand: “I am enthusiastic and we can continue”

Multiple Choice Question (MCQ) to evaluate mental models

Look at this example of a MCQ

• Question: “What is 27+15 ?”
• Possible answers
  • 42
  • 32
  • 312
  • 33
• Correct answer: 42, but each of the other answers provides valuable insights

Question: Multiple Choice Questions and mental models

In the previous MCQ, which misconception is associated with

1. 32
2. 312
3. 33

Solution

1. If they answer 32, they are throwing away the carry completely.
2. If they answer 312, they know that they can’t just discard the carried ‘1’, but doesn’t understand that it’s actually a ten and needs to be added into the next column. In other words, they are treating each column of numbers as unconnected to its neighbors.
3. If they answer 33 then they know they have to carry the 1, but are carrying it back into the same column it came from.

Group activities

Many group activities are possible

• Solve problems in groups
• Do exercises in front of the class
• Asking to describe the strategy they would adopt to solve a problem

• Using brainstorming

  Brainstorming should address a specific question; sessions addressing multiple questions are inefficient. The brainstorming technique can be used to build a concept map as a group.

• Shared notes for
  • Collaborative note taking
  • Output of group activities
  • Exercises
  • Opinions, ideas, comments, thoughts
  • Questions, answers

  Tools like Google docs, Etherpad or HackMD could be used

Hands-on: How to integrate the result of formative assessment / feedback in your course? - time 5 min - Silent reflection

1. In this session, how did we assess your learning?
2. Choose one of the techniques to collect feedback, and describe in the how you can integrate the result in your lesson, on the fly

How frequent should be formative feedback

Hands-on: How frequent should formative feedback be? - time 5 min - Self-reflection

• In this session, how many feedback opportunities have you had so far?

  Solution: Get feedback often

  In this tutorial so far, there were at least 3 feedback opportunities

• How frequent do you think formative feedback should be?

Open image in new tab

Formative assessment should be frequent: ideally every 5 min, at least every 10-15 min. Indeed, the attention span is 10-15 min and attention should be refocused after that.

Dealing with feedback

Feedback is hard.

Hands-on: How to deal with feedback - discuss experiences - time 15 min - Groups of 4

• Share one or two experiences that you have had in either offering or receiving feedback.
• Share your strategy in dealing with this feedback. What were the challenges, and what worked?
• Write it in the shared notes and discuss with the rest of the group.

Open image in new tab

Humans focus more on negative feedback than on positive (you are not alone). How to deal with (bad) feedback received from trainees:

• Breath deeply
• Try to see the point in the criticism, learn from it
• Don’t take it personally

Trainees feedback should be considered along other forms of quality evidence:

• Review what they have effectively learned (in exams)
• Consider your own experience of teaching
• Discuss with colleagues and friends
• Look at the feedback from past sessions of the same course
• Look at the response rates
• Look at the counter examples (contradictions)
• Look at the repetitive patterns (not at only one single answer)

Open image in new tab

Conclusions

Key points

• Formative assessment should be frequent

• Feedback is hard

Frequently Asked Questions

Quizzes

Check your understanding with these quizzes

Diagnostic Assessment

Bérénice Batut

• Self Study Mode - do the quiz at your own pace, to check your understanding.
• Classroom Mode - do the quiz synchronously with a classroom of students.

Collecting formative assessment

Bérénice Batut

• Self Study Mode - do the quiz at your own pace, to check your understanding.
• Classroom Mode - do the quiz synchronously with a classroom of students.

How frequent should formative feedback be?

Bérénice Batut

• Self Study Mode - do the quiz at your own pace, to check your understanding.
• Classroom Mode - do the quiz synchronously with a classroom of students.

How to integrate the result of formative assessment / feedback in your course?

Bérénice Batut

• Self Study Mode - do the quiz at your own pace, to check your understanding.
• Classroom Mode - do the quiz synchronously with a classroom of students.

References

1. Nicholls, G., 2002 Developing teaching and learning in higher education. Routledge.
2. Via, A., P. M. Palagi, J. M. Lindvall, R. E. Tractenberg, T. K. Attwood et al., 2020 Course design: Considerations for trainers–a Professional Guide. F1000Research 9:

Feedback

Did you use this material as an instructor? Feel free to give us feedback on how it went.
Did you use this material as a learner or student? Click the form below to leave feedback.

Citing this Tutorial

1. Bérénice Batut, Fotis E. Psomopoulos, Allegra Via, Patricia Palagi, elixir-goblet-ttt, Assessment and feedback in training and teachings (Galaxy Training Materials). https://training.galaxyproject.org/training-material/topics/teaching/tutorials/assessment/tutorial.html Online; accessed TODAY
2. Hiltemann, Saskia, Rasche, Helena et al., 2023 Galaxy Training: A Powerful Framework for Teaching! PLOS Computational Biology 10.1371/journal.pcbi.1010752
3. Batut et al., 2018 Community-Driven Data Analysis Training for Biology Cell Systems 10.1016/j.cels.2018.05.012

BibTeX

@misc{teaching-assessment,
author = "Bérénice Batut and Fotis E. Psomopoulos and Allegra Via and Patricia Palagi and elixir-goblet-ttt",
	title = "Assessment and feedback in training and teachings (Galaxy Training Materials)",
	year = "",
	month = "",
	day = ""
	url = "\url{https://training.galaxyproject.org/training-material/topics/teaching/tutorials/assessment/tutorial.html}",
	note = "[Online; accessed TODAY]"
}
@article{Hiltemann_2023,
	doi = {10.1371/journal.pcbi.1010752},
	url = {https://doi.org/10.1371%2Fjournal.pcbi.1010752},
	year = 2023,
	month = {jan},
	publisher = {Public Library of Science ({PLoS})},
	volume = {19},
	number = {1},
	pages = {e1010752},
	author = {Saskia Hiltemann and Helena Rasche and Simon Gladman and Hans-Rudolf Hotz and Delphine Larivi{\`{e}}re and Daniel Blankenberg and Pratik D. Jagtap and Thomas Wollmann and Anthony Bretaudeau and Nadia Gou{\'{e}} and Timothy J. Griffin and Coline Royaux and Yvan Le Bras and Subina Mehta and Anna Syme and Frederik Coppens and Bert Droesbeke and Nicola Soranzo and Wendi Bacon and Fotis Psomopoulos and Crist{\'{o}}bal Gallardo-Alba and John Davis and Melanie Christine Föll and Matthias Fahrner and Maria A. Doyle and Beatriz Serrano-Solano and Anne Claire Fouilloux and Peter van Heusden and Wolfgang Maier and Dave Clements and Florian Heyl and Björn Grüning and B{\'{e}}r{\'{e}}nice Batut and},
	editor = {Francis Ouellette},
	title = {Galaxy Training: A powerful framework for teaching!},
	journal = {PLoS Comput Biol} Computational Biology}
}

                   

Funding

These individuals or organisations provided funding support for the development of this resource

See Funder Profile

Galaxy Administrators: Install the missing tools

You can use Ephemeris's shed-tools install command to install the tools used in this tutorial.

shed-tools install [-g GALAXY] [-a API_KEY] -t <(curl https://training.galaxyproject.org/training-material/api/topics/teaching/tutorials/assessment/tutorial.json | jq .admin_install_yaml -r)

Alternatively you can copy and paste the following YAML

---
install_tool_dependencies: true
install_repository_dependencies: true
install_resolver_dependencies: true
tools: []

Feedback

5 stars	1

June 2023

• 5 stars: Liked: Well organised and clear! Disliked: It would help to have a table of contents or all of the links to the other parts in the overview or somewhere obvious. It wasn't intuitive to move between the sections.