Nominal Factor Analysis of Situational Judgment Tests: Evaluation of Latent Dimensionality and Factorial Invariance.

Monte Carlo simulation gender stereotypes multidimensional nominal categories model multigroup factor analysis nominal factor analysis situational judgment test

Journal

Educational and psychological measurement
ISSN: 1552-3888
Titre abrégé: Educ Psychol Meas
Pays: United States
ID NLM: 0372767

Informations de publication

Date de publication:
Dec 2021
Historique:
entrez: 27 9 2021
pubmed: 28 9 2021
medline: 28 9 2021
Statut: ppublish

Résumé

Situational judgment tests have gained popularity in educational and psychological measurement and are widely used in personnel assessment. A situational judgment item presents a hypothetical scenario and a list of actions, and the individuals are asked to select their most likely action for that scenario. Because actions have no explicit order, the item generates nominal responses consisting of the actions selected by the individuals. This article shows how to factor-analyze the nominal responses originated from such a test, including the estimation of the number of latent factors and a factor invariance analysis in a multiple group design. The method consists of applying the MNCM, a multidimensional extension of the nominal categories model by Bock. The article includes the results of two studies: (1) a simulation study about Type-I error rate, statistical power, and recovery of the parameters in a multigroup factorial invariance design and (2) a real data example using responses to a situational judgment test measuring gender stereotypes to illustrate the approach. Results suggest the use of the Akaike information criterion, Bayesian information criterion, and corrected Bayesian information criterion indices to guide the selection of the number of factors with nominal responses. All the analyses are conducted using the computer program

Identifiants

pubmed: 34565816
doi: 10.1177/0013164421994321
pii: 10.1177_0013164421994321
pmc: PMC8451019
doi:

Types de publication

Journal Article

Langues

eng

Pagination

1054-1088

Informations de copyright

© The Author(s) 2021.

Déclaration de conflit d'intérêts

Declaration of Conflicting Interests: The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Références

Front Psychol. 2020 Feb 06;11:72
pubmed: 32116902
Psychol Methods. 2016 Sep;21(3):328-47
pubmed: 26641273
Brief Bioinform. 2020 Mar 23;21(2):553-565
pubmed: 30895308
Span J Psychol. 2008 Nov;11(2):609-17
pubmed: 18988446
J Appl Psychol. 2002 Jun;87(3):517-29
pubmed: 12090609
Struct Equ Modeling. 2013 Oct 1;20(4):640-657
pubmed: 24489457
Psychol Bull. 1990 Mar;107(2):238-46
pubmed: 2320703
Psychometrika. 2017 Jun;82(2):295-307
pubmed: 28290110
Psychol Methods. 2012 Jun;17(2):228-43
pubmed: 22309957
Front Psychol. 2017 Jun 16;8:961
pubmed: 28670291

Auteurs

Javier Revuelta (J)

Universidad Autónoma de Madrid, Madrid, Spain.

Alicia Franco-Martínez (A)

Universidad Autónoma de Madrid, Madrid, Spain.

Carmen Ximénez (C)

Universidad Autónoma de Madrid, Madrid, Spain.

Classifications MeSH