Review of Sample Size for Structural Equation Models in Second Language Testing and Learning Research: A Monte Carlo Approach

Yo In'nami, Rie Koizumi

Research output: Contribution to journalArticle

9 Citations (Scopus)

Abstract

The importance of sample size, although widely discussed in the literature on structural equation modeling (SEM), has not been widely recognized among applied SEM researchers. To narrow this gap, we focus on second language testing and learning studies and examine the following: (a) Is the sample size sufficient in terms of precision and power of parameters in a model using Monte Carlo analysis? (b) How are the results from Monte Carlo sample size analysis comparable with those from the N ≥ 100 rule and from the N: q ≥ 10 (sample size-free parameter ratio) rule? Regarding (a), parameter bias, standard error bias, coverage, and power were overall satisfactory, suggesting that sample size for SEM models in second language testing and learning studies is generally appropriate. Regarding (b), both rules were often inconsistent with the Monte Carlo analysis, suggesting that they do not serve as guidelines for sample size. We encourage applied SEM researchers to perform Monte Carlo analyses to estimate the requisite sample size of a model.

Original languageEnglish
Pages (from-to)329-353
Number of pages25
JournalInternational Journal of Testing
Volume13
Issue number4
DOIs
Publication statusPublished - 2013 Oct 1

Keywords

  • Monte Carlo
  • power
  • precision
  • sample size
  • second language studies
  • structural equation modeling

ASJC Scopus subject areas

  • Social Psychology
  • Education
  • Modelling and Simulation

Fingerprint Dive into the research topics of 'Review of Sample Size for Structural Equation Models in Second Language Testing and Learning Research: A Monte Carlo Approach'. Together they form a unique fingerprint.

  • Cite this