A Method to Evaluate User-Centered Self-Adaptive Systems for Smart Environments

Abstract

With the advent of Industry 4.0, Ambient Intelligence, and other related technologies, self-Adaptation has been seen in modern systems. In this sense, Human-Computer Interaction (HCI) requires an approach focused on the user and the environment, which facilitates and enhances the use of the systems. In this context, the quality of Self-Adaptive Systems (SAS) is essential for their adoption, dissemination, and service. Thus, this study introduces a detailed evaluation method to analyze the quality of HCI in SAS, providing a solution applicable to various contexts aligned with the standard ISO/IEC 25040. This study also presents a quality model aligned with the ISO/IEC 25010 standard. The quality evaluation method allows the objective definition for the measurement application through specific metrics that determine the degree of functional adequacy and interaction capability. Finally, this study demonstrates how to perform a detailed evaluation of the quality of HCI in SAS, using as an example the evaluation of the Spotify system as a case study, applying metrics to evaluate functional adequacy and interaction capacity aligned with ISO/IEC 25040 and 25010 standards.