TU Delft Perceived Ringing Dataset

Author: TU Delft

Partner: Yes




Subjective scores: true

Total: 55

Ratings: 20


The subjective data on perceived ringing were collected with the aim to better understand where human beings perceive ringing artifacts in compressed images, and to develop a no-reference (NR) metric to predict perceived ringing annoyance in these compressed images. The data result from two perception experiments: 1. the so-called ringing region experiment, and 2. the so-called ringing annoyance experiment. For the ringing region experiment, eight source images were JPEG compressed at two levels, yielding a database of 16 stimuli. Twelve participants were requested to mark any region in each stimulus where ringing was perceived, independent of its annoyance. The results were transformed into a subjective ringing region (SRR) map, indicating where in an image on average people see ringing. For the ringing annoyance experiment, eleven source images were JPEG compressed at four levels, yielding a test database of 55 stimuli (including the originals). Twenty participants scored the annoyance of the ringing artifacts with a single-stimulus scoring method. A mean opinion score (MOS) was obtained for each stimulus.


ZIP archive, password protected, password upon request Hantao Liu (Hantao.Liu@tudelft.nl) Link, Ringing region experiment: http://mmi.tudelft.nl/iqlab/databases/TUD_LIVE_EyeTracking.zip Link, Ringing annoyance experiment: http://mmi.tudelft.nl/iqlab/databases/RingingAnnoyanceExperiment.zip

References and Citation

The database containing subjective data of perceived ringing is publicly available to the research community. Please cite the following references if you use this database in your research [LKH10]. [LKH10b], [LKH10c].


  • LKH10: H. Liu, N. Klomp and I. Heynderickx, "A No-Reference Metric for Perceived Ringing Artifacts in Images", IEEE Transactions on Circuits and Systems for Video Technology, vol. 20, pp 529-539, April, 2010.
  • LKH10b: H. Liu, N. Klomp and I. Heynderickx, "A Perceptually Relevant Approach to Ringing Region Detection", IEEE Transactions on Image Processing, vol. 19, pp. 1414-1426, June, 2010.
  • LKH10c: H. Liu, N. Klomp and I. Heynderickx, "TUD Image Quality Database: Perceived Ringing", http://mmi.tudelft.nl/iqlab/ringing.html.