Detail publikačního výsledku

Impact of Test Condition Selection in Adaptive Crowdsourcing Studies on Subjective Quality

SEUFERT, M.; ZACH, O.; HOSSFELD, T.; SLANINA, M.; TRAN-GIA, P.

Originální název

Impact of Test Condition Selection in Adaptive Crowdsourcing Studies on Subjective Quality

Anglický název

Impact of Test Condition Selection in Adaptive Crowdsourcing Studies on Subjective Quality

Druh

Stať ve sborníku v databázi WoS či Scopus

Originální abstrakt

Adaptive crowdsourcing is a new approach to crowdsourced Quality of Experience (QoE) studies, which aims to improve the certainty of resulting QoE models by adaptively distributing a fixed budget of user ratings to the test conditions. The main idea of the adaptation is to dynamically allocate the next rating to a condition, for which the submitted ratings so far show a low certainty. This paper investigates the effects of statistical adaptation on the distribution of ratings and the goodness of the resulting QoE models. Thereby, it gives methodological advice how to select test conditions for future crowdsourced QoE studies.

Anglický abstrakt

Adaptive crowdsourcing is a new approach to crowdsourced Quality of Experience (QoE) studies, which aims to improve the certainty of resulting QoE models by adaptively distributing a fixed budget of user ratings to the test conditions. The main idea of the adaptation is to dynamically allocate the next rating to a condition, for which the submitted ratings so far show a low certainty. This paper investigates the effects of statistical adaptation on the distribution of ratings and the goodness of the resulting QoE models. Thereby, it gives methodological advice how to select test conditions for future crowdsourced QoE studies.

Klíčová slova

QoE, test condiition, crowdsourcing, adaptive test design

Klíčová slova v angličtině

QoE, test condiition, crowdsourcing, adaptive test design

Autoři

SEUFERT, M.; ZACH, O.; HOSSFELD, T.; SLANINA, M.; TRAN-GIA, P.

Rok RIV

2017

Vydáno

06.06.2016

ISBN

978-1-5090-0354-9

Kniha

Proceedings of 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)

Strany od

1

Strany do

6

Strany počet

1

BibTex

@inproceedings{BUT126583,
  author="Michael {Seufert} and Ondřej {Zach} and Tobias {Hossfeld} and Martin {Slanina} and Phuoc {Tran-Gia}",
  title="Impact of Test Condition Selection in Adaptive Crowdsourcing Studies on Subjective Quality",
  booktitle="Proceedings of 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX)",
  year="2016",
  pages="1--6",
  doi="10.1109/QoMEX.2016.7498939",
  isbn="978-1-5090-0354-9"
}