Modality Effect

What is the Modality Effect?

The modality effect has two common meanings. In list-memory research, it is an advantage for recently heard over recently seen items. In multimedia learning, it commonly refers to better learning from graphics with spoken explanations than from graphics with printed explanations.

Two research traditions

• Working Memory

  Multimedia accounts propose that distributing information across channels can reduce demands on working memory. This is a theoretical account, not a general rule that adding sound improves learning.

• Recall Patterns

  In immediate recall, presentation modality mainly affects the last items in a list. Kahana’s 2020 review describes this recency pattern. Researchers differ on how to explain that advantage.

• Educational Implications

  Ginns’s 2005 meta-analysis examined 43 independent effects. Benefits varied with presentation pacing and the complexity of relationships among elements.

Choosing a presentation

Instructional design must specify what is being compared: adding narration to graphics differs from presenting identical text twice. The list-memory effect does not establish benefits for advertising, interfaces, or professional communication.

Two different examples

Multimedia learning comparison

For a hypothetical multimedia comparison, one group studies a diagram of a pump while hearing an explanation of how it moves water. Another sees the same diagram with the explanation printed beside it. A later test asks how the pump works. The comparison changes how the explanatory words are presented; it does not simply add unrelated sounds.

List-memory comparison

A list-memory comparison might instead have people hear a sequence of words or read the same words one at a time, then immediately recall them. Researchers compare recall by list position, including the last few items. That asks about the recency pattern for heard versus seen words, not comprehension of a diagram. These are illustrative designs, not reports of new experiments.

More channels are not always better

Neither use of the term means that more sensory channels always improve memory. Task demands and presentation design matter; the two research traditions should not be treated as one mechanism.