TY - JOUR
T1 - VALID
T2 - A Checklist-Based Approach for Improving Validity in Psychological Research
AU - Kerschbaumer, Susanne
AU - Voracek, Martin
AU - Aczél, Balazs
AU - Anderson, Samantha F.
AU - Booth, Brandon M.
AU - Buchanan, Erin M.
AU - Carlsson, Rickard
AU - Heck, Daniel W.
AU - Hiekkaranta, Anu Pauliina
AU - Hoekstra, Rink
AU - Karch, Julian D.
AU - Lafit, Ginette
AU - Lin, Zhicheng
AU - Liu, Siwei
AU - MacKinnon, David P.
AU - McGorray, Emma L.
AU - Moreau, David
AU - Papadatou-Pastou, Marietta
AU - Paterson, Helena
AU - Perera, Robert A.
AU - Schad, Daniel J.
AU - Sewell, David K.
AU - Syed, Moin
AU - Tay, Louis
AU - Tendeiro, Jorge N.
AU - Toland, Michael D.
AU - Vanpaemel, Wolf
AU - van Ravenzwaaij, Don
AU - Voncken, Lieke
AU - Tran, Ulrich S.
N1 - Publisher Copyright:
© The Author(s) 2025.
PY - 2025/1/1
Y1 - 2025/1/1
N2 - In response to the replication and confidence crisis across various empirical disciplines, ensuring the validity of research has gained attention. High validity is crucial for obtaining replicable and robust study outcomes when both exploring new questions and replicating previous findings. In this study, we aimed to address this issue by developing a comprehensive checklist to assist researchers in enhancing and monitoring the validity of their research. After systematically analyzing previous findings on validity, a comprehensive list of potential checklist items was compiled. Over the course of three rounds, more than 30 interdisciplinary and psychological-science experts participated in a Delphi study. Experts rated items on their importance and were given the opportunity to propose novel items as well as improve existing ones. This process resulted in a final set of 91 items, organized according to common stages of a research project. The VALID checklist is accessible online (https://www.validchecklist.com/) and provides researchers with an adaptable, versatile tool to monitor and improve the validity of their research and to suit their specific needs. By focusing on adaptiveness during its development, VALID encompasses 331 unique checklist versions, making it a one-stop solution suitable for a wide range of projects, designs, and requirements.
AB - In response to the replication and confidence crisis across various empirical disciplines, ensuring the validity of research has gained attention. High validity is crucial for obtaining replicable and robust study outcomes when both exploring new questions and replicating previous findings. In this study, we aimed to address this issue by developing a comprehensive checklist to assist researchers in enhancing and monitoring the validity of their research. After systematically analyzing previous findings on validity, a comprehensive list of potential checklist items was compiled. Over the course of three rounds, more than 30 interdisciplinary and psychological-science experts participated in a Delphi study. Experts rated items on their importance and were given the opportunity to propose novel items as well as improve existing ones. This process resulted in a final set of 91 items, organized according to common stages of a research project. The VALID checklist is accessible online (https://www.validchecklist.com/) and provides researchers with an adaptable, versatile tool to monitor and improve the validity of their research and to suit their specific needs. By focusing on adaptiveness during its development, VALID encompasses 331 unique checklist versions, making it a one-stop solution suitable for a wide range of projects, designs, and requirements.
KW - Delphi study
KW - method reform
KW - open data
KW - open materials
KW - open practices
KW - preregistered
KW - study quality appraisal
KW - tailored online checklist
KW - validity
UR - https://www.scopus.com/pages/publications/105000487941
U2 - 10.1177/25152459241306432
DO - 10.1177/25152459241306432
M3 - Article
AN - SCOPUS:105000487941
SN - 2515-2459
VL - 8
JO - Advances in Methods and Practices in Psychological Science
JF - Advances in Methods and Practices in Psychological Science
IS - 1
ER -