Menu Close

Interaction-Driven Metrics and Bias-Mitigating Suggestions

Contributors:

Mahmood Jasim, Ali Sarvghad, Christopher Collins, Narges Mahyar

Abstract

In this study, we investigate how supporting serendipitous discovery and analysis of online product reviews can encourage readers to explore reviews more comprehensively prior to making purchase decisions. We propose two interventions — Exploration Metrics that can help readers understand and track their exploration patterns through visual indicators and a Bias Mitigation Model that intends to maximize knowledge discovery by suggesting sentiment and semantically diverse reviews. We designed, developed, and evaluated a text analytics system called Serendyze, where we integrated these interventions. We asked 100 crowd workers to use Serendyze to make purchase decisions based on product reviews. Our evaluation suggests that exploration metrics enabled readers to efficiently cover more reviews in a balanced way, and suggestions from the bias mitigation model influenced readers to make confident data-driven decisions. We discuss the role of user agency and trust in text-level analysis systems and their applicability in domains beyond review exploration

Website

serendyze.cs.umass.edu

 

Video

Publications

  • Jasim, M., Collins, C., Sarvghad, A., & Mahyar, N. (2022). Supporting serendipitous discovery and balanced analysis of online product reviews with interaction-driven metrics and bias-mitigating suggestions. CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3491102.3517649

    PDF

    @InProceedings{jas2022a,

    title={Supporting Serendipitous Discovery and Balanced Analysis of Online Product Reviews with Interaction-Driven Metrics and Bias-Mitigating Suggestions},

    author={Jasim, Mahmood and Collins, Christopher and Sarvghad, Ali and Mahyar, Narges}, booktitle = {CHI Conference on Human Factors in Computing Systems},

    month = mar,

    year = 2022,

    doi = {10.1145/3491102.3517649}

    }