gaips_bea image1 image2 image3 image4 image5 gaips_ecute_beach_bar_banner gaips_ecute_train_incorrect_ticket_banner
Iv4xr Webpage icon

Collaborators: Rui Prada , Carlos Martinho, Manuel Lopes, Marta Couto, Pedro Fernandes, Ana Salta
Keywords: Software Testing, User Experience, Quality Assurance, Extended Reality


“Extended Reality” (XR) systems are advanced interactive systems such as Virtual Reality (VR) and Augmented Reality (AR) systems. They have emerged in various domains, ranging from entertainment, cultural heritage, to combat training and mission critical applications. The development and authoring of such systems is an iterative process that also includes quality assurance to make sure that the resulting systems are correct and delivering a high quality user experience. As the complexity of these systems keeps increasing, the XR industry now finds itself confronting a soaring engineering challenge: paradoxically, XR’s fine grained and high level of interactivity and realism make such systems very hard and expensive to test. The current XR authoring and development toolset poses no XR testing technology beyond rudimentary record and replay tools that only work for simple test scenarios. This project aims to build a novel verification and validation technology for XR systems based on techniques from AI to provide learning and reasoning over a virtual world. With this technology XR developers can deploy powerful test agents to automatically explore and test the correct parameters of their virtual worlds as they iteratively develop and refine them. In addition, user experience is an equally important aspect for all XR systems. We will therefore also develop socio-emotional AI to enable test agents to conduct automated assessment of the quality of user experience and parameterization by different demographic and socio economic types, such as male, female, young, and elderly.


Agents for Automated User Experience Testing
pdf iconbib icon
Pedro M Fernandes and Manuel Lopes and Rui Prada, 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pg. 247--253, 2021
An Agent-based Architecture for AI-Enhanced Automated Testing for XR Systems, a Short Paper
bib icon
ISWB Prasetya and Samira Shirzadehhajimahmood and Saba Gholizadeh Ansari and Pedro M. Fernandes and Rui Prada, 2021 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pg. 213--217, 2021
Adoption Dynamics and Societal Impact of AI Systems in Complex Networks
bib icon
Pedro Fernandes and Francisco C. Santos and Manuel Lopes, in Proc of the 3rd AAAI/ACM Conference on AI, Ethics, and Society (AIES 2020), New York, Feb. 2020., 2020
Agent-based Testing of Extended Reality Systems
bib icon
Rui Prada and ISWB Prasetya and Fitsum Kifetew and Frank Dignum and Tanja EJ Vos and Jason Lander and Jean-yves Donnart and Alexandre Kazmierowski and Joseph Davidson and Pedro M Fernandes, 2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST), pg. 414--417, 2020