Program for Open-Ended Scoring (POES; Leaf and Barchard, 2013) can be used to score open-ended tests by giving different scores to the words and phrases that occur in the responses. The simplest scores would be 0 and 1: a word or phrase receives a score of 1 if it is one of the words or phrases you are looking for, and 0 otherwise. However, different words and phrases can be given whatever scores you want.
POES is most commonly used to score the Levels of Emotional Awareness Scale (LEAS; Lane, Quinlan, Schwartz, Walker, & Zeitlan, 1990). The LEAS asks respondents how they would feel in each of 20 different situations. There is another person mentioned in each situation, and they are also asked to describe how that person would feel.
POES includes several scoring methods. Many of the scoring methods were designed to mimic hand-scoring on the LEAS. However, some of the scoring methods are very general, and may be useful when scoring a wide variety of tests. In particular, the All-Sum, AllSum-AllinOne, Highest-4, and HighestN-AllinOne could be used with any open-ended test.
The following papers provides more information about POES describe four studies that show that POES scoring can be used instead of hand scoring in some circumstances:
- Barchard, K.A., Bajgar, J., Leaf, D.E., & Lane, R. (2010). Computer scoring of the Levels of Emotional Awareness Scale. Behavior Research Methods, 42(2), 586-595. doi:10.3758/BRM.42.2.586
- Barchard, K. A., & Picker, C. J. (2017). Computer scoring of emotional awareness in a non-clinical population of adults. Journal of Personality Assessment, 100(1), 107-115. doi:10.1080/00223891.2017.1282866
To obtain a copy of POES, contact Kim Barchard at email@example.com