Audio-tactile short-term memory

Project: Research funding

Project Details

Abstract

Wider research context / theoretical framework.
The project aims to complement existing models of tactile Short-Term Memory (STM) and explain effects of tactile on auditory perception. To this end, we draw on the Retrieved Context Theory for a novel cross-modal STM model and assume information of successive items (e.g., tactile vs. auditory perceived frequencies) to blend into one evolving context signal: The bindings formed between items and their contexts are used for later retrieval of item information, e.g., to compare
frequencies from memory. Core characteristics of the novel STM model are (1) an integration of different sources of memory interference; and (2) a mechanistic explanation of statistically optimal decisions based on different modality-specific item layers and one shared context layer.
Objectives / hypotheses.
Part I of the present project focuses on tactile STM. The main hypothesis is that (i) interference in tactile frequency memory arises from an increased blending of context states and, thus, context-item binding errors. In Part II, we extend the novel tactile STM model to a cross-modal version of the
model by a separate modality’s (auditory) item layer. The main hypotheses are that (ii) perceptual integration across modalities takes place in the shared context layer, (iii) an optimal weighting of tactile and auditory input emerges from modality-specific tunings of the item layers’ receptive fields, and (iv) a dual
coding of context-item bindings reduces memory interference.
Approach / methods.
The hypotheses are examined in a series of four experiments (two in each Part) applying variants of a Delayed Match-to-Sample (DMS) task. Model-based simulations and analyses of DMS data are used for detailing and stringently testing theoretical assumptions about the processing of
tactile, auditory, and tactile-auditory STM representations.
Level of originality / innovation.
A novel, more realistic STM model is developed to better explain (1) tactile memory performance and (2) tactile-auditory interactions. The model and its tests address important open research questions about tactile STM, a still under-researched domain in cognitive psychology. The extended and tested cross-modal version of the model sheds fresh light on psychophysical approaches towards cross-modal integration. The project is timely under an applied perspective: Performing valid modelbased simulations of tactile-auditory integration should facilitate innovation in research on hearing aids by complementing resource-intensive planning and pilot studies.
Primary researchers involved. Prof. Dr. Ulrich Ansorge, Dr. Paul Seitlinger, Doz. Dr. Bernhard Laback
StatusFinished
Effective start/end date1/10/2130/06/24