Application of cognitive diagnosis models to competency-based situational judgment tests
Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of t...
| Autores: | ; ; |
|---|---|
| Tipo de documento: | Artículo |
| Fecha de publicación: | 2014 |
| País: | España |
| Institución: | Universidad Autónoma de Madrid |
| Repositorio: | Biblos-e Archivo. Repositorio Institucional de la UAM |
| Lenguaje: | Inglés |
| OAI Identifier: | oai:repositorio.uam.es:10486/665721 |
| Acceso en línea: | http://hdl.handle.net/10486/665721 https://dx.doi.org/10.7334/psicothema2013.322 |
| Nivel de acceso: | Acceso abierto |
| Palabra clave: | Cognitive diagnosis models (CDM) G-DINA model Situational judgment tests (SJT) Great eight model Modelo great eight Modelos de diagnóstico cognitivo (MDC) Modelo G-DINA Tests de juicio situacional (TJS) Empresa Psicología |
| _version_ | 1878737824288604160 |
|---|---|
| author | García, Pablo Eduardo |
| author2 | Olea Díaz, Julio Torre, Jimmy de la |
| author2_role | author author |
| author_browse | García, Pablo Eduardo Olea Díaz, Julio Torre, Jimmy de la |
| author_facet | García, Pablo Eduardo Olea Díaz, Julio Torre, Jimmy de la |
| author_role | author |
| collection | Biblos-e Archivo. Repositorio Institucional de la UAM |
| description | Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies |
| eu_rights_str_mv | openAccess |
| format | article |
| id | ES_a583ecb802a32fbb33dbf63c96b5cd8d |
| institution | Universidad Autónoma de Madrid |
| instname_str | Universidad Autónoma de Madrid |
| language | eng |
| network_acronym_str | ES |
| network_name_str | España |
| oai_identifier_str | oai:repositorio.uam.es:10486/665721 |
| publishDate | 2014 |
| publishDateSort | 2014 |
| publisher | Colegio Oficial de Psicólogos del Principado de Asturias |
| publisherStr | Colegio Oficial de Psicólogos del Principado de Asturias |
| reponame_str | Biblos-e Archivo. Repositorio Institucional de la UAM |
| spelling | Application of cognitive diagnosis models to competency-based situational judgment tests García, Pablo Eduardo Olea Díaz, Julio Torre, Jimmy de la Cognitive diagnosis models (CDM) G-DINA model Situational judgment tests (SJT) Great eight model Modelo great eight Modelos de diagnóstico cognitivo (MDC) Modelo G-DINA Tests de juicio situacional (TJS) Empresa Psicología Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. Method: The generalized deterministic inputs, noisy “and” gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish fi nancial company. The fi t of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. Results: The G-DINA showed a good fi t to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. Conclusions: This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies Muchas organizaciones definen sus puestos de trabajo en base a las competencias profesionales que requieren. La medición de tales competencias mediante tests de juicio situacional (TJS) presenta problemas de validez, en tanto no suele estar claro los constructos que miden. El objetivo principal de este estudio es evaluar si la aplicación de los modelos de diagnóstico cognitivo (MDC) a estos tests permite clarificar y estimar de forma precisa las competencias medidas. Método: se aplicó el modelo G-DINA (generalized deterministic inputs, noisy “and” gate) a 26 ítems de juicio situacional que medían competencias profesionales fundamentadas en el modelo great eight. Se aplicó el test a 485 trabajadores de una entidad financiera española. Se examinó el ajuste del modelo a los datos, y la validez convergente entre las competencias estimadas y dimensiones de personalidad. Resultados: G-DINA mostró un buen ajuste a los datos, y los factores competenciales estimados adaptarse y aguantar, e interactuar y presentar mostraron una relación positiva con estabilidad emocional y extraversión, respectivamente. Conclusiones: este trabajo muestra que los MDC pueden ser una herramienta útil para la medición de competencias profesionales a través de TJS, aclarando las competencias que miden y obteniendo estimaciones precisas de las mismas This research was supported in part by the UAM-IIC Chair for Psychometric Models and Applications Colegio Oficial de Psicólogos del Principado de Asturias http://hdl.handle.net/10486/665721 https://dx.doi.org/10.7334/psicothema2013.322 |
| spellingShingle | Application of cognitive diagnosis models to competency-based situational judgment tests García, Pablo Eduardo Cognitive diagnosis models (CDM) G-DINA model Situational judgment tests (SJT) Great eight model Modelo great eight Modelos de diagnóstico cognitivo (MDC) Modelo G-DINA Tests de juicio situacional (TJS) Empresa Psicología |
| title | Application of cognitive diagnosis models to competency-based situational judgment tests |
| title_full | Application of cognitive diagnosis models to competency-based situational judgment tests |
| title_fullStr | Application of cognitive diagnosis models to competency-based situational judgment tests |
| title_full_unstemmed | Application of cognitive diagnosis models to competency-based situational judgment tests |
| title_short | Application of cognitive diagnosis models to competency-based situational judgment tests |
| title_sort | Application of cognitive diagnosis models to competency-based situational judgment tests |
| topic | Cognitive diagnosis models (CDM) G-DINA model Situational judgment tests (SJT) Great eight model Modelo great eight Modelos de diagnóstico cognitivo (MDC) Modelo G-DINA Tests de juicio situacional (TJS) Empresa Psicología |
| topic_facet | Cognitive diagnosis models (CDM) G-DINA model Situational judgment tests (SJT) Great eight model Modelo great eight Modelos de diagnóstico cognitivo (MDC) Modelo G-DINA Tests de juicio situacional (TJS) Empresa Psicología |
| url | http://hdl.handle.net/10486/665721 https://dx.doi.org/10.7334/psicothema2013.322 |