Preferred Name

Tom

Creative Commons License

Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.

ORCID

https://orcid.org/0000-0002-0509-9965

Date of Graduation

5-7-2020

Document Type

Dissertation

Degree Name

Doctor of Philosophy (PhD)

Department

Department of Graduate Psychology

Advisor(s)

Christine DeMars

Abstract

The Rasch model implies that the relation between examinee ability and the probability of correctly answering an item can be defined solely by a small set of parameters. In the case of Rasch modeling, there are only two parameters: the ability of an examinee and the difficulty of an item. When the data meet the requirements of the Rasch model, it possesses several appealing properties that distinguish it from Classical Test Theory and more complex Item Response Theory models.

However, the desirable properties of the Rasch model only exist when the data meet its strict requirements. Therefore, it is vital to check the fit of the data to the model, both the fit of the items and the examinees. The two primary fit statistics for Rasch models are Infit and Outfit. While useful statistics, they possess some inherent deficiencies. Therefore, it may be useful to supplement them with another fit statistic. One such fit statistic, which is computed and interpreted differently than Infit and Outfit, is the root integrated squared error (RISE). The purpose of this dissertation was to compare the performance of RISE, in terms of type 1 error rates and power, to Infit and Outfit. Additionally, RISE requires statistical smoothing in its computation. Therefore, an additional purpose of this dissertation was to examine the impact of smoothing amount and smoothing type on the performance of RISE.

A simulation study was conducted to examine, RISE, Infit, and Outfit. Responses to a 50 item test were generated, with 43 items that fit the Rasch model and 7 items that did not. Sample size was manipulated and had three levels: 200, 500, or 1,000 examinees. Two smoothing techniques were used: Hanning or Kernel smoothing with a Gaussian function. Within each smoothing technique, nine smoothing amounts were used.

The results showed that RISE performed similarly across smoothing techniques. Within each smoothing technique, smoothing amount often had a drastic impact on RISE, with the best results generally associated with a low to medium amount of smoothing. Across most of the misfitting items, Outfit and/or Infit outperformed RISE.

Share

COinS
 
 

To view the content in your browser, please download Adobe Reader or, alternately,
you may Download the file to your hard drive.

NOTE: The latest versions of Adobe Reader do not support viewing PDF files within Firefox on Mac OS and if you are using a modern (Intel) Mac, there is no official plugin for viewing PDF files within the browser window.