Structural equation modeling in language testing and learning research

A review

Yo In'nami, Rie Koizumi

Research output: Contribution to journalArticle

24 Citations (Scopus)

Abstract

Despite the recent increase of structural equation modeling (SEM) in language testing and learning research and Kunnan's (1998) call for the proper use of SEM to produce useful findings, there seem to be no reviews about how SEM is applied in these areas or about the extent to which the current application accords with appropriate practices. To narrow these gaps, we investigated the characteristics of the use of SEM in language testing and learning research. Electronic and manual searches of 20 journals revealed 50 articles containing a total of 360 models analyzed using SEM. We discovered that SEM was most often used to investigate learners' strategy use and trait/test structure. Maximum likelihood methods were most often used to estimate parameters of a model; model fit indices of chi-squares, comparative fit index, root mean square error of approximation, and Tucker-Lewis index were often reported, but standardized root mean square residual rarely was. Univariate and multivariate normality checks were infrequently reported, as was missing data treatment. Sample sizes, when judged according to Kline's (2005) and Raykov and Marcoulides's (2006) guidelines, were in most cases adequate, and LISREL was the most widely used program. Two recommendations are provided for the better practice of using and reporting SEM for language testing and learning research.

Original languageEnglish
Pages (from-to)250-276
Number of pages27
JournalLanguage Assessment Quarterly
Volume8
Issue number3
DOIs
Publication statusPublished - 2011 Jul

Fingerprint

language
learning
normality
electronics
Language Acquisition
Language Testing
Structural Equation Modeling

ASJC Scopus subject areas

  • Language and Linguistics
  • Linguistics and Language

Cite this

Structural equation modeling in language testing and learning research : A review. / In'nami, Yo; Koizumi, Rie.

In: Language Assessment Quarterly, Vol. 8, No. 3, 07.2011, p. 250-276.

Research output: Contribution to journalArticle

@article{abecb1aff3dc4cecb2795c10d8c050e3,
title = "Structural equation modeling in language testing and learning research: A review",
abstract = "Despite the recent increase of structural equation modeling (SEM) in language testing and learning research and Kunnan's (1998) call for the proper use of SEM to produce useful findings, there seem to be no reviews about how SEM is applied in these areas or about the extent to which the current application accords with appropriate practices. To narrow these gaps, we investigated the characteristics of the use of SEM in language testing and learning research. Electronic and manual searches of 20 journals revealed 50 articles containing a total of 360 models analyzed using SEM. We discovered that SEM was most often used to investigate learners' strategy use and trait/test structure. Maximum likelihood methods were most often used to estimate parameters of a model; model fit indices of chi-squares, comparative fit index, root mean square error of approximation, and Tucker-Lewis index were often reported, but standardized root mean square residual rarely was. Univariate and multivariate normality checks were infrequently reported, as was missing data treatment. Sample sizes, when judged according to Kline's (2005) and Raykov and Marcoulides's (2006) guidelines, were in most cases adequate, and LISREL was the most widely used program. Two recommendations are provided for the better practice of using and reporting SEM for language testing and learning research.",
author = "Yo In'nami and Rie Koizumi",
year = "2011",
month = "7",
doi = "10.1080/15434303.2011.582203",
language = "English",
volume = "8",
pages = "250--276",
journal = "Language Assessment Quarterly",
issn = "1543-4303",
publisher = "Routledge",
number = "3",

}

TY - JOUR

T1 - Structural equation modeling in language testing and learning research

T2 - A review

AU - In'nami, Yo

AU - Koizumi, Rie

PY - 2011/7

Y1 - 2011/7

N2 - Despite the recent increase of structural equation modeling (SEM) in language testing and learning research and Kunnan's (1998) call for the proper use of SEM to produce useful findings, there seem to be no reviews about how SEM is applied in these areas or about the extent to which the current application accords with appropriate practices. To narrow these gaps, we investigated the characteristics of the use of SEM in language testing and learning research. Electronic and manual searches of 20 journals revealed 50 articles containing a total of 360 models analyzed using SEM. We discovered that SEM was most often used to investigate learners' strategy use and trait/test structure. Maximum likelihood methods were most often used to estimate parameters of a model; model fit indices of chi-squares, comparative fit index, root mean square error of approximation, and Tucker-Lewis index were often reported, but standardized root mean square residual rarely was. Univariate and multivariate normality checks were infrequently reported, as was missing data treatment. Sample sizes, when judged according to Kline's (2005) and Raykov and Marcoulides's (2006) guidelines, were in most cases adequate, and LISREL was the most widely used program. Two recommendations are provided for the better practice of using and reporting SEM for language testing and learning research.

AB - Despite the recent increase of structural equation modeling (SEM) in language testing and learning research and Kunnan's (1998) call for the proper use of SEM to produce useful findings, there seem to be no reviews about how SEM is applied in these areas or about the extent to which the current application accords with appropriate practices. To narrow these gaps, we investigated the characteristics of the use of SEM in language testing and learning research. Electronic and manual searches of 20 journals revealed 50 articles containing a total of 360 models analyzed using SEM. We discovered that SEM was most often used to investigate learners' strategy use and trait/test structure. Maximum likelihood methods were most often used to estimate parameters of a model; model fit indices of chi-squares, comparative fit index, root mean square error of approximation, and Tucker-Lewis index were often reported, but standardized root mean square residual rarely was. Univariate and multivariate normality checks were infrequently reported, as was missing data treatment. Sample sizes, when judged according to Kline's (2005) and Raykov and Marcoulides's (2006) guidelines, were in most cases adequate, and LISREL was the most widely used program. Two recommendations are provided for the better practice of using and reporting SEM for language testing and learning research.

UR - http://www.scopus.com/inward/record.url?scp=80051985920&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80051985920&partnerID=8YFLogxK

U2 - 10.1080/15434303.2011.582203

DO - 10.1080/15434303.2011.582203

M3 - Article

VL - 8

SP - 250

EP - 276

JO - Language Assessment Quarterly

JF - Language Assessment Quarterly

SN - 1543-4303

IS - 3

ER -