Contributions of Robert F. Wagner, Medical Imaging: Image Perception Conf., SPIE Medical Imaging Symposium, Orlando, Feb. 11, 2009

Performance-based assessment of reconstructed images

Kenneth M. Hanson
Los Alamos National Laboratory


During the early 90s, I engaged in a productive and enjoyable collaboration with RobertWagner and his colleague, Kyle Myers. We explored the ramifications of the principle that the quality of an image should be assessed on the basis of how well it facilitates the performance of appropriate visual tasks. We applied this principle to algorithms used to reconstruct scenes from incomplete and/or noisy projection data. For binary visual tasks, we used both the conventional disk detection and a new challenging task, inspired by the Rayleigh resolution criterion, of deciding whether an object was a blurred version of two dots or a bar. The results of human and machine observer tests were summarized with the detectability index based on the area under the ROC curve. We investigated a variety of reconstruction algorithms, including ART, with and without a nonnegativity constraint, and the MEMSYS3 algorithm. We concluded that the performance of the Raleigh task was optimized when the strength of the prior was near MEMSYS's default "classic" value for both human and machine observers. A notable result was that the most-often-used metric of rms error in the reconstruction was not necessarily indicative of the value of a reconstructed image for the purpose of performing visual tasks.

Keywords: tomographic reconstruction, assessment of image quality, Rayleigh discrimination task, ROC analysis, human observer, machine observer, entropic prior, ART reconstruction algorithm, MEMSYS, Robert Wagner Get full paper (pdf, 2747 KB)
Return to publication list
Send e-mail to author at