Usability Testing Hybrid Method for Indonesian Automatic Question Generator

Abstract

As educational technology becomes increasingly essential, usability testing is crucial to ensure IT
products meet user needs, particularly in the context of teaching and learning. The Indonesian
Automatic Question Generator (IAQG) was developed to assist educators in creating question
banks tailored to their curricula. This study evaluates the IAQG usability and user acceptance from
the perspective of Indonesian vocational high school teachers, using a hybrid methodology that
combines the Technology Acceptance Model (TAM) and ISO 25023 standards. The results indicate
that while the IAQG is generally well-received, with high marks for user interface design and
operational consistency, improvements are needed in areas such as print functionality and
language support. The ANOVA analysis of TAM indicates that perceived behaviour control and
subjective norm influence teachers’ attitude toward use and influence their behavioural intention to use the IAQG. The study concludes that the IAQG has significant potential to alleviate teachers'
workloads and improve the quality of learning outcome assessments. However, the respondents
raised several suggestions toward development to meet their needs and expectations during the
IAQG usage. This research contributes to develop more effective, user-centered educational tools
that align with the specific needs of Indonesian educators.