PERTANIKA JOURNAL OF SOCIAL SCIENCES AND HUMANITIES

The impact of the Industry Revolution 4.0 (IR4.0) in the workplace requires organisations to ensure clerical employees can effectively transfer their newly acquired knowledge and skills learned in training back into the workplace. Hence, an instrument is required to identify factors influencing the intention to transfer training conduct amongst clerical employees. Thus, this paper presents the evaluation of construct validity and reliability of the new instrument to confirm its objectivity and clarity in measuring the constructs under study as intended. This four-point Likert-type scale instrument consists of 72 self-assessment items that represent 12 constructs. The Rasch Model was then employed to analyse the construct validity and reliability by evaluating the suitability of items in the respective constructs on the instrument. The item and person reliability and strata indices, point-measure correlation, and outfit mean square values were examined. The analysis found that three constructs in the item and person reliability index and eight constructs in the item and person reliability strata index were low but adequate and met the Rasch Model measurement acceptable level. Meanwhile, point-measure correlation values for all constructs fulfilled the criteria. Finally, the outfit mean square values established that 65 items in the constructs were found to be fit, whereas seven items were misfits which require improvement. Subsequently, the seven misfit items were improved as the item and person reliability values could be increased, thus the items were retained. Thereafter, the instrument was ready to be used for data collection in the actual study.

• Ab Rahman, F., Mohamed, A. H., Saidin, K., & Nasir, N. S. A. (2019). Exploring perceptions of employers on communication skills among fresh graduates. Practitioner Research, 1, 69-85.

• Abdullah, A. R., Muhammad, M. Z., & Md Nasir, N. A. (2019). The role of soft skills on business graduates employability. Journal of Entrepreneurship and Business, 7(2), 83-94. https://doi.org/10.17687/JEB.0702.07

• Ajzen, I. (2019). Behavioral interventions based on the theory of planned behavior. https://people.umass.edu/aizen/pdf/tpb.intervention.pdf

• Al Rakhyoot, A. A. M. (2017). Conceptualising the antecedents of employee intentions to transfer training to the job: An application of the Theory of Planned Behaviour in health education institutions [Doctoral dissertation, University of Strathclyde]. https://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.725157

• Anjum, R., Khan, H. H., Bano, S., Nazir, S., Gulraiz, H., & Ahmed, W. (2021). A latent factor (PLS-SEM) approach: Assessing the determinants of effective knowledge transfer. Journal of Asian Finance, Economics and Business, 8(2), 851-860. https://doi.org/10.13106/jafeb.2021.vol8.no2.0851

• Azwani, M., Nor’ain, M. T., & Shah, S. N. (2016). Evaluating the face and content validity of a Teaching and Learning Guiding Principles Instrument (TLGPI): A perspective study of Malaysia teacher educators. Malaysian Journal of Society and Space, 12(3), 11-21.

• Baghaei, P. (2008). The Rasch Model as a construct validity tool. Rasch Measurement Transactions American Educational Research Association, 22(1), 1145-1146.

• Baldwin, T., Ford, J. K., & Blume, B. D. (2017). The state of transfer of training research: Moving toward more consumer-centric inquiry. Human Resource Development Quarterly, 28(1), 17-28. https://doi.org/10.1002/hrdq.21278.

• Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental measurement in the human sciences (3rd ed.). Routledge Taylor & Francis Group.

• Boone, W. J. (2016). Rasch analysis for instrument development: Why, when, and how? CBE Life Sciences Education, 15(4), 1-7.

• Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch analysis in the human sciences (e-book). Springer.

• Boone, W. J. & Noltemeyer, A. (2017). Rasch analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4(1), 1-13.

• Bradley, K. D., Peabody, M. R., Akers, K. S., & Knutson, N. M. (2015). Rating scales in survey research: Using the Rasch Model to illustrate the neutral middle category measurement flaw. Survey Practice, 8(1), 1-12.

• Brinkman, W.-P. (2009). Design of a questionnaire instrument. In L. Steve (Ed.), Handbook of mobile technology research methods (pp. 31-57). Nova Publisher.

• Brion, C. (2020). The role of culture in the transfer of training. International Journal of Training and Development, 24(4), 384-393.

• Burke, L. A., Hutchins, H. M., & Saks, A. M. (2013). Best practices in training transfer. In M. A. Paulidi (Ed.), Psychology for business success (Vol. 3, pp. 115-132). Praeger.

• Coates, H. (2018). Instrumentation. In B. B. Frey (Ed.), The SAGE encyclopedia of educational research, measurement, and evaluation (p. 839). SAGE Publications, Inc. http://dx.doi.org/10.4135/9781506326139.n335

• Code, J. (2020). Agency for learning: Intention, motivation, self-efficacy and self-regulation. Frontiers in Education, 5(19), 1-15. https://doi.org/10.3389/feduc.2020.00019

• Falotico, R., & Quatto, P. (2015). Fleiss’ Kappa statistic without paradoxes. Quality Quantitative, 49, 463-470. 

• Fitkov-Norris, E. D., & Yeghiazarian, A. (2015). Validation of VARK learning modalities questionnaire using Rasch analysis. Open Access. Journal of Physics: Conference Series, 588, 012048. https://doi.org/10.1088/1742-6596/588/1/012048

• Hamed, T. (2016). Validity and reliability of the research instrument; How to test the validation of a questionnaire/survey in a research. International Journal of Academic Research in Management, 5(3), 28-36.

• Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative research. Evidence-Based Nursing, 18(3), 66-67.

• Hsu, C., & Sandford, B. A. (2012). Instrumentation. In N. J. Salkind (Ed.), Encyclopedia of research design (pp. 608-610). SAGE Publications, Inc. http://dx.doi.org/10.4135/9781412961288.n189

• Iqbal, M. Z., & AlSheikh, M. H. (2018). Factors affecting the transfer of training to the workplace after a faculty development programme: What do trainers think? Journal of Taibah University Medical Sciences, 13(6), 552-556.

• Iramaneerat, C. Smith Jr., E. V., & Smith, R. M. (2011). An introduction to Rasch measurement. In J. Osborne (Ed.), Best practices in quantitative methods (pp. 50-70). SAGE Publications, Inc. http://dx.doi.org/10.4135/9781412995627.d6

• Joye, D., Wolf, C., Smith, T. W., & Fu, Y.-C. (2017). Handbook of survey methodology. SAGE Publications Ltd. http://dx.doi.org/10.4135/9781473957893

• Kenayathulla, H. B., Ahmad, N. A., & Idris, A. R. (2019). Gaps between competence and importance of employability skills: Evidence from Malaysia. Higher Education Evaluation and Development, 13(2), 97-112. https://doi.org/10.1108/HEED-08-2019-0039

• Kim, E.-J., & Park, S. (2019). Support, training readiness and learning motivation in determining intention to transfer. European Journal of Training and Development, 43(3/4), 306-321. https://doi.org/10.1108/EJTD-08-2018-0075

• Kodwani, A. D., & Kodwani, M. (2021). Exploring determinants of pre-training motivation and training effectiveness: A temporal investigation.  Evidence-based HRM, ahead-of-print.  https://doi.org/10.1108/EBHRM-05-2020-0070

• Kumar, S. (2018). Understanding different issues of unit of analysis in a business research. Journal of General Management Research, 5(2), 70-82.

• Lal, R. S., & Singh, A. P. (2015). Role of personality factors in clerical employees’ satisfaction with special reference to Banaras Hindu University. South Asian Journal of Marketing & Management Research, 5(10), 10-19.

• Linacre, J. M. (2011). Winsteps (Version 3.72.3). http://www.winsteps.com.

• Linacre, J. M. (2012). A user’s guide to Winsteps-Ministep: Rasch Model computer programs. Program manual 3.68.0. http://www.winsteps.com/manuals.htm

• Linacre, J. M., & Fisher, W. P., Jr. (2012). Harvey Goldstein’s objections to Rasch measurement: A response from Linacre and Fisher. Rasch Measurement Transactions, 26(3), 1383-1389.

• Md Yunus, J., Alias, M., Mukhtar, M. I., Lee, M. F., Tee, T. K., Rubani, S. N. K., Nur Yunus, F. A., Hamid, H., Sulaiman, J., & Sumarwati, S. (2017). Validity of vocational pedagogy constructs using the Rasch measurement model. Journal of Technical Education and Training, 9(2), 35-45.

• Mohajan, H. K. (2017). Two criteria for good measurements in research: Validity and reliability. Annals of Spiru Haret University, 17(3), 56-82.

• Mohanty, P. C., Dash, M., & Dash, M. (2017). Impact of trainee characteristics and organizational climate on training effectiveness with special reference to financial organization in India. International Journal of Applied Business and Economic Research, 15(18), 233-241.

• Muschara, T. (2018). Risked-based thinking: Managing the uncertainty of human error in operations. Routledge, Taylor & Francis Group.

• Nicola, M., Alsafi, Z., Sohrabi, C., Kerwan, A., Al-Jabir, A., Iosifidis, C., Agha, M., & Agha, R. (2020). The socio-economic implications of the coronavirus pandemic (COVID-19): A review. International Journal of Surgery, 78, 185-193.

• Noe, R. A., & Kodwani, A. D. (2018). Employee training and development (7th ed.). McGraw-Hill Education India Private Limited.

• Norasmah, O., Suria, M. S., Haliza, H., & Haryaty, A. W. (2014). Assessing construct validity and reliability of competitiveness scale using Rasch Model approach. The 2014 WEI International Academic Conference Proceedings, Bali, Indonesia. https://www.westeastinstitute.com/wp-content/uploads/2014/06/Suria-Mohd-Salleh.pdf

• Nusrat, M., & Sultana, N. (2019). Soft skills for sustainable employment of business graduates of Bangladesh. Journal Higher Education, Skills and Work-Based Learning, 9(3), 264-278.

• Pallant, K. (2011). Transfer of training: A review and direction for future research. Personnel Psychology, 41(1), 63-105.

• Prohorovs, A. (2020, May 7). Getting ready for recession: How SMEs prepared for Covid-19 pandemic and economic recession. Forbes (Latvian edition), (11), 46-49. http://dx.doi.org/10.2139/ssrn.3596611

• Rahman, A. A. (2020). Tracing the evolution of transfer of training: A review article. Annals of Social Sciences & Management Studies, 5(4), 71-79.

• Robert, C. E. (2017). Clerical turnover in the K-12 campus office [Doctoral dissertation, The University of Texas at San Antonio]. ProQuest Dissertations Publishing.

• Runnels, J. (2012). Using the Rasch Model to validate a multiple choice English achievement test. International Journal of Language Studies, 6(4), 141-153.

• Saha, M. (2021). “I will be aware of the appraisal, which will automatically change my work behaviour”: Evaluating training transfer. Journal of Teaching and Teacher Education, 9(1), 31-39. https://dx.doi.org/10.12785/jtte/090104

• Sangoseni, O., Hellman, M., & Hill, C. (2013). Development and validation of a questionnaire to assess the effect of online learning on behaviors, attitudes, and clinical practices of physical therapists in the United States regarding evidence-based clinical practice. The Internet Journal of Allied Health Sciences and Practice, 11(2), 1-13.

• Sick, J. (2011, March). Rasch measurement in language education Part 6: Rasch measurement and factor analysis. SHIKEN: JALT Testing & Evaluation SIG Newsletter, 15(1), 15-17.

• Suter, W. N. (2014). Introduction to educational research: A critical thinking approach; sampling in research. SAGE Publications, Inc. https://dx.doi.org/10.4135/9781483384443

• Toepoel, V. (2017). Doing surveys online. SAGE Publications Ltd. https://dx.doi.org/10.4135/9781473967243

• Tsang, S., Royse, C. F., & Terkawi, A. S. (2017). Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi Journal of Anaesthesia, 11(1), 80-89.

• Whitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016). Estimating the sample size for a pilot randomised trial to minimise the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Statistical Methods in Medical Research, 25(3), 1057-1073.

• World Economic Forum. (2018). The future of jobs. http://www.weforum.org/report/the-future-of-jobs-report-2018

• World Economic Forum. (2020). The future of jobs. http://www.weforum.org/report/the-future-of-jobs-report-2020

• Yaqub, Y., Singh, A. K., & Dutta, T. (2021). An empirical study of factors influencing training transfer in the management training intervention. Journal of Workplace Learning, Ahead-of-print.  https://doi.org/10.1108/JWL-02-2020-0034

• Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., AlaviMajd, H., Nikanfar, A-R. (2015). Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. Journal of Caring Sciences, 4(2), 165-178.

• Zarreen, Z. (2018). Impact of psychological capital on organizational citizenship behaviour: A study of clerical employees. Asian Journal of Multidimensional Research, 7(11), 142-146.