Isolating and Mitigating Sequentially Dependent Perceptual Errors in Clinical Visual Search

Study Summary

Remote-store-and-forward teledermatology has recently grown exponentially in popularity and use as an efficient, accurate, and cost-effective way to improve the health and well-being of countless patients. Despite advances in machine learning and computer vision, the screening and reading of dermatological images still depends on the visual system of human observers (e.g., clinicians), who receive extensive training to best recognize lesions and anomalies. In remote store-and-forward teledermatology settings, clinicians may examine hundreds of images on a daily basis, seeing several images one after the other. A main underlying assumption of their work is that clinician percepts and decisions about a current image are completely independent from prior viewings. However, we and other groups demonstrated that the visual system has visual serial dependencies (VSDs) at many levels, from perception to decision making, including in clinical tasks. These sequential dependencies, replicated hundreds of times in the literature, mean that what was seen in the past influences (and captures) what is seen and reported at this moment. Theoretically, VSDs are helpful in an autocorrelated natural world, but they are suboptimal in visual tasks conducted in artificial situations where images are not always related. Importantly, serial dependencies in perceptual processing could thus produce significant errors during diagnostic judgments of dermatological images. Our central hypothesis is that VSD can have a disruptive effect in asynchronous remote-store-and-forward teledermatology judgments that impairs accurate detection and recognition of lesions. This hypothesis is supported by our robust pilot data, which show that VSD strongly biases lesion classification in both untrained observers and expert clinicians. The rationale for the proposed research projects is that once it is known how serial dependence arises and how it impacts judgments, we can understand how to control for it. He

Primary Outcome

This is a medical image perception experiment using psychophysical methods, including continuous report match-to-sample and method-of-constant stimuli designs. Human observers, including clinicians and untrained observers, are recruited to classify or discriminate medical images. Each observer participates in approximately 300 trials in a session. On each trial, observers view a medical image on a computer monitor and are asked to make either a match-to-sample or a two-alternative forced choice

Conditions Studied

Interventions

• BEHAVIORAL psychophysics of sequential biases (no drug or patient work)

Study Locations (1)