Validation of an instrument to assess web-based employee compliance training materials in academic medical centers as reviewed by institutional experts in compliance content, information technology, and instructional design /
The current regulatory environment related to employee compliance training (ECT) in an Academic Medical Center (AMC) requires accountability and practicability. The need for efficient, quality ECT is critical, but standards are either not empirically based or applicable. Therefore, the purpose of th...
| Main Author: | |
|---|---|
| Format: | Thesis Book |
| Language: | English |
| Published: |
[Place of publication not identified] :
[publisher not identified] ;
2004.
|
| Subjects: | |
| Online Access: | http://proxy.library.tamu.edu/login?url=http://proquest.umi.com/pqdweb?did=765939011&sid=1&Fmt=2&clientId=2945&RQT=309&VName=PQD |
| Summary: | The current regulatory environment related to employee compliance training (ECT) in an Academic Medical Center (AMC) requires accountability and practicability. The need for efficient, quality ECT is critical, but standards are either not empirically based or applicable. Therefore, the purpose of this study was to measure the validity, reliability, and overall effectiveness of an instrument for the assessment of Web-based ECT materials in an AMC. A panel of nine expert raters in compliance content, information technology, and instructional design was asked to assess three Web-based ECT modules on blood borne pathogens with an evaluation instrument developed by the Multimedia Educational Resource for Learning and Teaching On-line (MERLOT) organization. The instrument focused on three dimensions: quality of content (QoC), potential effectiveness as a teaching/learning tool (Effect), and ease of use (EoU). The instrument was then converted to a Web-based questionnaire via Survey Tracker®. Subsequently, 130 members of the Group on Information Resources of the American Association of Medical Colleges with access to Email and the Internet, who were not in senior administration positions, were electronically requested to access and review an on-line BBP training module, use the on-line instrument to assess QoC, Effect, and EoU, evaluate level of satisfaction with the instrument (OEI), and identify their area of expertise as content (C), instructional design (ID), or information technology (IT). The raters were in agreement (within 1) within their areas of expertise. All correlation values among raters were =/>7.00, achieving statistically or practical significance, except ID raters #1 and #2 had a low (.500) correlation within EoU. Seventy-six specialists (C=54, ID=16. and C=6) participated in the broad-based study, with a response rate of 58.5%. A single sample t-test showed a statistically significant difference in EoU scores between IT raters (M=3.33) and IT specialists (M=3.94, SD=.0940), with both scores above satisfactory. Overall mean OSI score was 3.84 (SD=.817) with no significant differences across areas of expertise, gender, geographic region, position, or educational level. There was no significant difference in QoC, Effect, or EoU scores among any participant category. Hence, the instrument is valid, reliable, and effective for the assessment of Web-based ECT materials. |
|---|---|
| Item Description: | Vita. "Major Subject: Educational Human Resource Development". |
| Physical Description: | xiv, 210 leaves : illustrations ; 28 cm. Issued also on microfiche from University Microfilm Inc. |
| Bibliography: | Includes bibliographical references (leaves 158-182). |