Test-retest Reliability and Internal Consistency of the Survey Questionnaire on Digital Trust in the Workplace

Abstract

A global study on digital trust in the workplace, dubbed as “e-Trust Project,” was launched in 2018. The study aims to determine the digital trust and integration in the workplace among employees in any company or organization in Europe, the USA, Latin America, and Asian countries. One of the methods to assess the trust level is using a survey questionnaire. This paper presents the calculation of test-retest reliability coefficients and the internal consistency of the proposed survey questionnaire. The measurement of the test-retest reliability was done in a one-week interval in Germany and the Philippines. A sample of 82 respondents completed Survey eTrust in German and English language. On the other hand, the questionnaire’s internal consistency was measured through the pretesting of Survey e-Trust. In this case, Survey eTrust was translated into Chinese, Japanese, South Korean, Russian, Portuguese, Spanish, and Thai. A sample of 376 respondents from Germany, Philippines, China, Japan, South Korea, Paraguay, Russia, Brazil, Thailand, USA, and the United Kingdom completed Survey eTrust. Quota and convenience sampling was employed in both testing activities. Similarly, the administration of both testing activities was delivered online. Results show that the r values are 0.7 (technologies, privacy and protection, netizenship) and 0.8 (features, people operation), indicating acceptable evidence of test-retest reliability. The test-retest also shows a total of 35 items with a weak strength of association. For the paired t-test, all subscales had a p-value higher than .05, confirming the test-retest’s stability. On the other hand, all subscales showed satisfactory internal consistency estimates (higher than .9). The Survey eTrust has acceptable reliability and validity properties. 

Keywords-digital trust; reliability; validity; questionnaire