Testing. Both Pre and Post

In working with my mentor there has been many discussions that are clarifying the process of completing the proposal. One of the discussions was around the testing instrument. I am choosing to do a pre and post test for my instrument founded in Kirkpatrick’s Level 2 evaluation of training programs. A related issue is the creation of the testing device.

The nature of the training intervention suggests that a custom test is deployed to target the instructed skills both in the test and control groups. Kirkpatrick, in a speech delivered to my local ASTD chapter, talked about designing such tests to be directly linked to the instructed concepts. In fact, he suggested that instructors use the test as the syllabus and give it out ahead of time to allow students to use it for the learning.

My concern would be the reliability and validity of a pretest and posttest designed by the researcher. Is there an issue with that? I suppose that as long as the test mapped to the learning objective and both groups used the same objectives and test it would be fine but I am still a little unsure.

Using an established instrument would alleviate the bias concerns. How would that established pretest posttest instrument be applicable to the training being delivered?

Lots of questions.

If you enjoyed this post, make sure you subscribe to my RSS feed!