Banca de DEFESA: Ricardo Cordeiro Galvão Sant'Ana Van Erven

Uma banca de DEFESA de MESTRADO foi cadastrada pelo programa.
STUDENT : Ricardo Cordeiro Galvão Sant'Ana Van Erven
DATE: 28/02/2024
TIME: 14:00
LOCAL: Teams
TITLE:

UXAPP: Evaluation of the User Experience of Digital Products through Emotion Recognition

KEY WORDS:

Emotion Recognition, User Satisfaction Measurement, Artificial Intelligence

PAGES: 67
BIG AREA: Ciências Exatas e da Terra
AREA: Ciência da Computação
SUBÁREA: Metodologia e Técnicas da Computação
SPECIALTY: Engenharia de Software
SUMMARY:

Context: measuring user experience (UX) is essential to create value in digital transformation. Measurement allows you to identify future purchase intentions, user loyalty, and retention. The traditional way of measuring user experience using self-assessment has problems. Therefore, we need a more straightforward approach to allow us to measure user experience automatically.
Objective: implement and validate the UX evaluation model through a tool that automatically calculates the user experience rating of a digital product and presents positive, neutral, and negative points in using this product. The model included a work process, an exploratory experiment, and an application, which we call UXAPP.
Methods: we identified and selected the state-of-art related to emotion recognition with Artificial Intelligence in the context of user satisfaction. After that, we proposed and implemented the UX evaluation model. We developed the UXAPP application and conducted the exploratory experiment following the work process. We invite nine participants to perform four tasks each. We collect manual input data and capture emotions from the user's video and speech. Then, we analyze both data and generate a UX report. Finally, we compare the results obtained from UXAPP and the user input data.
Results: the UXAPP UX evaluation directly matches the user evaluation in 50\% of the tasks and gives a close answer in others 47.22\% of the results. Each UX element, like usability, affect, and user value, was evaluated and analyzed independently. The UXAPP usability analysis matches the user evaluation in 30.56\% of the tasks and gives a close answer in others 33.33\% of the results. The UXAPP affect analysis matches the user evaluation in 52.78\% of the tasks and gives a close answer in others 41.67\% of the results. UXAPP also identified 616 points of positive or negative sentiments in video and speech for all tasks. The UXAPP user value analysis matches the user evaluation in 36.11\% of the tasks and gives a close answer in 50.00\% of the results. We registered 5h 35m 31s of tasks’ duration. Based on our experience, we estimate that a person needed at least four times this task duration to process all the information presented in the UX report, including finding all sentiment points and distinguishing positive and negative sentiment peaks.
Conclusions: the possibilities of applying emotion recognition are countless in terms of contexts, techniques, forms, and components. Despite this, it was possible to develop UXAPP and validate the UX evaluation model to measure the user experience of a digital product through emotion recognition and Artificial Intelligence. We found that UXAPP analysis and user evaluation analysis are important and complementary. The main contribution of this work is the delivery of a validated model to automatically measure user experience and identify positive, neutral, and negative points in the use of a digital product. UXAPP can be used directly by the final user, making it possible to automate all the efforts to obtain a UX evaluation score and identify user interaction's positive and negative points. It can drastically reduce the costs involved in developing a user experience competence in an organization. This research also defines a measurement experimentation process that any organization or researcher can reproduce.

 

COMMITTEE MEMBERS:
Presidente - 1780217 - EDNA DIAS CANEDO
Interna - 1650604 - REJANE MARIA DA COSTA FIGUEIREDO
Interno - 1821656 - THIAGO DE PAULO FALEIROS
Externa à Instituição - ANA PAULA BERNARDI DA SILVA - UCB