Collaborators: Rui Prada , Carlos Martinho, Manuel Lopes, Marta Couto, Pedro Fernandes, Ana Salta
Keywords: Software Testing, User Experience, Quality Assurance, Extended Reality
Description
“Extended Reality” (XR) systems are advanced interactive systems such as Virtual Reality (VR) and Augmented Reality (AR) systems. They have emerged in various domains, ranging from entertainment, cultural heritage, to combat training and mission critical applications. The development and authoring of such systems is an iterative process that also includes quality assurance to make sure that the resulting systems are correct and delivering a high quality user experience. As the complexity of these systems keeps increasing, the XR industry now finds itself confronting a soaring engineering challenge: paradoxically, XR’s fine grained and high level of interactivity and realism make such systems very hard and expensive to test. The current XR authoring and development toolset poses no XR testing technology beyond rudimentary record and replay tools that only work for simple test scenarios. This project aims to build a novel verification and validation technology for XR systems based on techniques from AI to provide learning and reasoning over a virtual world. With this technology XR developers can deploy powerful test agents to automatically explore and test the correct parameters of their virtual worlds as they iteratively develop and refine them. In addition, user experience is an equally important aspect for all XR systems. We will therefore also develop socio-emotional AI to enable test agents to conduct automated assessment of the quality of user experience and parameterization by different demographic and socio economic types, such as male, female, young, and elderly.
Publications
Agents for Automated User Experience Testing![]() ![]() Pedro M Fernandes and Manuel Lopes and Rui Prada, 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pg. 247--253, 2021 |
An Agent-based Architecture for AI-Enhanced Automated Testing for XR Systems, a Short Paper![]() ISWB Prasetya and Samira Shirzadehhajimahmood and Saba Gholizadeh Ansari and Pedro M. Fernandes and Rui Prada, 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pg. 213--217, 2021 |
Adoption Dynamics and Societal Impact of AI Systems in Complex Networks![]() Pedro Fernandes and Francisco C. Santos and Manuel Lopes, in Proc of the 3rd AAAI/ACM Conference on AI, Ethics, and Society (AIES 2020), New York, Feb. 2020., 2020 |
Agent-based Testing of Extended Reality Systems![]() Rui Prada and ISWB Prasetya and Fitsum Kifetew and Frank Dignum and Tanja EJ Vos and Jason Lander and Jean-yves Donnart and Alexandre Kazmierowski and Joseph Davidson and Pedro M Fernandes, 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), pg. 414--417, 2020 |