Quantifying the influence of partial scalar invariance on mean comparisons: two proposed effect sizes Online publication date: Wed, 22-Feb-2017
by W. Holmes Finch; Brian F. French
International Journal of Quantitative Research in Education (IJQRE), Vol. 3, No. 4, 2016
Abstract: Simulation studies have evaluated methodologies for detecting factor invariance, with the majority of work focused on best practices for identifying non-invariance. Fewer studies have examined the impact of partial factorial invariance on statistical analyses involving scores derived from observed indicator variables, particularly in the context of mean comparisons. In particular, partial scalar invariance can influence group comparisons using observed indicators. Currently, no statistical tools quantify effects of such partial invariance on observed data analyses, leading researchers to make not fully informed decisions regarding the accuracy of obtained results under non-invariant conditions. This study introduces two effect sizes designed to quantify the influence of partial invariance (especially but not exclusively scalar invariance) on group mean comparisons. The effect sizes are based on the DFIT methodology for differential item functioning. Results demonstrate that each effect size is sensitive to a lack of invariance, and can correctly differentiate low from high levels of partial invariance. Interpretation of the results and implications are discussed.
Online publication date: Wed, 22-Feb-2017
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Quantitative Research in Education (IJQRE):
Login with your Inderscience username and password:
Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.
If you still need assistance, please email firstname.lastname@example.org