Validity and Reliability of the E-Aishi Interactive Professional Quality Module: A Scoping Review Using Cohen’s Kappa with Expert Evaluation

Abstract

This scoping review examines the validity and reliability of the e-AISHI Interactive Professional Quality Module, a digital intervention designed to enhance the character and professional competencies of preschool teachers. Guided by the PRISMA-ScR framework and Arksey & O’Malley’s six-stage methodology. This study maps existing literature on module validation specifically focusing on expert evaluation using the Cohen’s Kappa statistical technique. Content validity was established by three subject matter experts in module development, counseling and ICT. The findings indicate that the e-AISHI module achieved a perfect inter-rater agreement (Kappa=1) demonstrating excellent initial validity and reliability compared to international studies that reported moderate to substantial agreement. While this perfect consensus underscores the clarity of the module's constructs, the study acknowledges that the score may reflect the homogeneity of a limited expert panel. Consequently, this validation serves as a foundational step within a broader Design and Development Research (DDR) framework with future phases intended to assess internal consistency and construct validity through empirical field testing. This review synthesizes methodological trends and gaps providing a rigorous framework for future validation studies in educational module development. Ultimately, the e-AISHI module serves as a scientifically grounded tool to support teacher professionalism and the achievement of Sustainable Development Goal (SDG) 4.