Christensen, KB, Makransky, G and Horton, MC orcid.org/0000-0002-6675-7335 (2017) Critical Values for Yen’s Q3: Identification of Local Dependence in the Rasch model using Residual Correlations. Applied Psychological Measurement, 41 (3). pp. 178-194. ISSN 0146-6216
Abstract
The assumption of local independence is central to all IRT models. Violations can lead to inflated estimates of reliability and problems with construct validity. For the most widely used fit statistic Q3 there are currently no well-documented suggestions of the critical values which should be used to indicate local dependence, and for this reason a variety of arbitrary rules of thumb are used. In this study, we used an empirical data example and Monte Carlo simulation to investigate the different factors that can influence the null distribution of residual correlations, with the objective of proposing guidelines that researchers and practitioners can follow when making decisions about local dependence during scale development and validation. We propose that a parametric bootstrapping procedure should be implemented in each separate situation in order to obtain the critical value of local dependence applicable to the data set, and provide example critical values for a number of data structure situations. The results show that for the Q3 fit statistic no single critical value is appropriate for all situations, as the percentiles in the empirical null distribution are influenced by the number of items, the sample size, and the number of response categories. Furthermore, our results show that local dependence should be considered relative to the average observed residual correlation, rather than to a uniform value, as this results in more stable percentiles for the null distribution of an adjusted fit statistic.
Metadata
Item Type: | Article |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | (c) The Author(s) 2016. This is an author produced version of a paper accepted for publication in Applied Psychological Measurement. Uploaded in accordance with the publisher's self-archiving policy. |
Keywords: | Local dependence; Rasch model; Yen’s Q3; Residual correlations; Monte Carlo simulation |
Dates: |
|
Institution: | The University of Leeds |
Academic Units: | The University of Leeds > Faculty of Medicine and Health (Leeds) > School of Medicine (Leeds) > Institute of Rheumatology & Musculoskeletal Medicine (LIRMM) (Leeds) > Rehabilitation Medicine (Leeds) |
Depositing User: | Symplectic Publications |
Date Deposited: | 17 Oct 2016 11:07 |
Last Modified: | 02 Jul 2017 01:38 |
Published Version: | https://doi.org/10.1177/0146621616677520 |
Status: | Published |
Publisher: | SAGE Publications |
Identification Number: | 10.1177/0146621616677520 |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:106017 |