The emic-etic divide in test development and adaptation: Recommendations to authors to address cross-cultural comparability.
European Journal of Psychological Assessment, Vol 40(2), 2024, 97-100; doi:10.1027/1015-5759/a000823This editorial focuses on the emic-etic divide in test development and adaptation and encourages authors to make extra efforts in order to ensure that the tests they develop have a significant probability of being cross-culturally valid outside the direct scope of the development process, and of the data that they use in order to offer proof of validity. This extra effort can either be addressed in separate and dedicated studies or integrated into planned studies through straightforward extensions. At the very least, test au...
Source: European Journal of Psychological Assessment - April 8, 2024 Category: Psychiatry & Psychology Source Type: research

The potential of machine learning methods in psychological assessment and test construction.
European Journal of Psychological Assessment, Vol 40(1), 2024, 1-4; doi:10.1027/1015-5759/a000817The goal of this editorial is to provide a brief overview of the potential of machine learning (ML) methods in psychological assessment and test construction. In the following, the authors focus on three applications they believe more research is needed on and which the European Journal of Psychological Assessment (EJPA) would welcome: (1) automated item generation, (2) automated test assembly, which both focus on test construction, and (3) clinical decision support systems, which address questions relevant to the psychological...
Source: European Journal of Psychological Assessment - January 11, 2024 Category: Psychiatry & Psychology Source Type: research

Assessing children in developmental research: Challenges in testing through infancy to adolescence.
European Journal of Psychological Assessment, Vol 39(6), 2023, 385-389; doi:10.1027/1015-5759/a000808This editorial addresses key challenges for measurement across age groups in developmental psychology, such as differences in assessment methods, narrow domains, small sample sizes, lack of standardized assessment instruments for some constructs, and potential differences in construct structure across age groups. (PsycInfo Database Record (c) 2023 APA, all rights reserved) (Source: European Journal of Psychological Assessment)
Source: European Journal of Psychological Assessment - November 20, 2023 Category: Psychiatry & Psychology Source Type: research

On the death of implicit association tests (IATs).
European Journal of Psychological Assessment, Vol 39(5), 2023, 317-322; doi:10.1027/1015-5759/a000778“The IAT Is Dead, Long Live the IAT [...]” is the title of an article that might reflect the impression of many researchers who are unsure about whether IATs are useful measures or not (Jost, 2019, p. 10). A Web of Science search on the number of IAT-related publications shows that although IAT research has increased over the years, there are several ups and downs (Figure 1). This editorial provides insights into some issues that may partly explain this phenomenon and encourage researchers to use in-depth analyses to he...
Source: European Journal of Psychological Assessment - September 14, 2023 Category: Psychiatry & Psychology Source Type: research

Response tendencies to positively and negatively worded items of the Rosenberg Self-Esteem Scale with eye-tracking methodology.
European Journal of Psychological Assessment, Vol 39(4), 2023, 307-315; doi:10.1027/1015-5759/a000772The Rosenberg Self-Esteem Scale (RSES) was developed as a unitary scale to assess attitudes toward the self. Previous studies have shown differences in responses and psychometric indices between the positively and negatively worded items, suggesting differential processing of responses. The current study examined differences in response behaviors toward two positively and two negatively worded items of the RSES with eye-tracking methodology and explored whether those differences were more pronounced among individuals with h...
Source: European Journal of Psychological Assessment - August 14, 2023 Category: Psychiatry & Psychology Source Type: research

Theory matters: An example of deriving process indicators from log data to assess decision-making processes in web search tasks.
European Journal of Psychological Assessment, Vol 39(4), 2023, 271-279; doi:10.1027/1015-5759/a000776Following an extended perspective of evidence-centered design, this study provides a methodological exemplar of the theory-based construction of process indicators from log data. We investigated decision-making processes in web search as the target construct, assuming that individuals follow a heuristic search (focusing on search results vs. websites as a primary information source) and stopping rule (following a satisficing vs. sampling strategy). Drawing on these assumptions, we describe our reasoning for identifying the ...
Source: European Journal of Psychological Assessment - August 14, 2023 Category: Psychiatry & Psychology Source Type: research

Process data in computer-based assessment: Challenges and opportunities in opening the black box.
European Journal of Psychological Assessment, Vol 39(4), 2023, 241-251; doi:10.1027/1015-5759/a000790This editorial provides a comprehensive framework and overview of potential uses and next steps in research on process data in computer-based assessments, expanding toward broad perspectives on the field and an exploration of future directions and emerging trends. After briefly reflecting on the evolution of process data use in research and assessment practice, we discuss three key challenges, namely (1) the theoretical grounding and validation of process data indicators, (2) assessment design for process data, and (3) ethi...
Source: European Journal of Psychological Assessment - August 14, 2023 Category: Psychiatry & Psychology Source Type: research

Face validity: A critical but ignored component of scale construction in psychological assessment.
European Journal of Psychological Assessment, Vol 39(3), 2023, 153-156; doi:10.1027/1015-5759/a000777Face validity continues to cause a lot of confusion. Some of this confusion comes from the different meanings that are attached to the term “face validity” across different areas of science. In this editorial, we aim to provide some clarity regarding what face validity is, what it is not, and how we might go about measuring face validity in psychological assessment. (PsycInfo Database Record (c) 2023 APA, all rights reserved) (Source: European Journal of Psychological Assessment)
Source: European Journal of Psychological Assessment - June 15, 2023 Category: Psychiatry & Psychology Source Type: research

Theory-based behavioral indicators for children’s purchasing self-control in a computer-based simulated supermarket.
European Journal of Psychological Assessment, Vol 39(4), 2023, 289-298; doi:10.1027/1015-5759/a000757The present study aims to investigate elementary school children’s self-control as an important aspect of their purchasing literacy in a simulated supermarket. To this end, 136 children were asked to shop on a limited budget and work through a given shopping list. We processed the data of this task in two ways: First, we combined process and product data into a common score for a differentiated assessment of task performance. Second, we derived theory-based behavioral indicators from the log data. By means of a structural...
Source: European Journal of Psychological Assessment - April 20, 2023 Category: Psychiatry & Psychology Source Type: research

Going beyond observable actions: A cognition-centered approach to interpreting pauses represented in process data.
European Journal of Psychological Assessment, Vol 39(4), 2023, 263-270; doi:10.1027/1015-5759/a000756Pauses represented in process data captured from digital learning and assessment tasks are defined as the time elapsed between two subsequent events. Pauses are used as a marker of unobservable cognitive processes, such as encoding, problem-solving, and planning, that underlie test takers’ subsequent observable actions in educational assessment. To make valid inferences about the underlying cognitive processes represented by pauses, we argue that applying a task-specific cognitive modeling approach is required. We discuss...
Source: European Journal of Psychological Assessment - April 20, 2023 Category: Psychiatry & Psychology Source Type: research

Mouse chase: Detecting careless and unmotivated responders using cursor movements in web-based surveys.
This study constructed indicators of such data presented correlations between them and provided an interpretation and validation of these components by correlating them with previously known indices of careless responding. Finally, it tested cursor movement indices during different motivational states induced by experimental instructions. Cursor movement indices proved to be moderately related to classical careless responding indices but some of them (horizontal distance traveled as well speed and acceleration on vertical dimension) were as responsive to manipulation conditions as classical indices. The potential role of c...
Source: European Journal of Psychological Assessment - April 6, 2023 Category: Psychiatry & Psychology Source Type: research

Computerized process-oriented dynamic testing of children’s ability to reason by analogy using log data.
In conclusion, the findings seemed to indicate that investigating process indicators within computerized dynamic testing of analogical reasoning ability provided information about children’s learning processes, but that not all processes were affected in the same way by training. (PsycInfo Database Record (c) 2023 APA, all rights reserved) (Source: European Journal of Psychological Assessment)
Source: European Journal of Psychological Assessment - April 6, 2023 Category: Psychiatry & Psychology Source Type: research

Process and product in computer-based assessments: Clearing the ground for a holistic validity framework.
European Journal of Psychological Assessment, Vol 39(4), 2023, 252-262; doi:10.1027/1015-5759/a000748There is no consensus among assessment researchers about many of the central problems of response process data, including what is it and what is it comprised of. The Standards for Educational and Psychological Testing (American Educational Research Association et al., 2014) locate process data within their five sources of validity evidence. However, we rarely see a conceptualization of response processes; rather, the focus is on the techniques and methods of assembling response process indices or statistical models. The met...
Source: European Journal of Psychological Assessment - April 6, 2023 Category: Psychiatry & Psychology Source Type: research

Measurement does not take place in a legal vacuum: Ideas regarding regulation (EU) 2017/745 of the European Parliament and of the Council on Medical Devices.
European Journal of Psychological Assessment, Vol 39(2), 2023, 79-84; doi:10.1027/1015-5759/a000764The set of rules to evaluate complex information is specified in several standards which have been developed over decades. For example, the European Federation of Psychologists’ Associations’ review model of psychological and educational tests (EFPA Board of Assessment, 2013) or the American Psychological Associations Standards for Educational and Psychological Testing (AERA, APA, & NMCE, 2014) contain guidelines to evaluate the information supporting a test score interpretation. To guarantee the quality of the actual dia...
Source: European Journal of Psychological Assessment - April 3, 2023 Category: Psychiatry & Psychology Source Type: research

The NB5I: A full-scale Big-Five inventory with evaluatively neutralized items.
We present a 120-item evaluatively neutralized five-factor inventory and compare it to the IPIP-NEO (Goldberg et al., 2006). Psychometric analyses revealed that the new inventory has high factor homogeneity, relatively independent facets with acceptable homogeneity and normally distributed ratings, and relatively evaluatively neutral ratings (as indicated by the level of item popularity). In sum, this new inventory captures the same personality variance as other five-factor inventories but with less influence from individual differences in evaluative responding, resulting in less correlation between factors and a factor st...
Source: European Journal of Psychological Assessment - February 9, 2023 Category: Psychiatry & Psychology Source Type: research