AAA member Adam Wilson’s research focuses on educational measurement and evaluation, which makes him the perfect guest editor for Anatomical Sciences Education’s (ASE) upcoming special issue on psychometrics.
Psychometrics, which comes from the Greek words for mental and measurement, is the field of study that digs into the theory, design, delivery, and interpretation of tests and instruments that measure human intelligence, aptitudes and skills, attitudes, and personality traits.
“My interest and passion for psychometrics began in graduate school with my dissertation that investigated the validity of the script concordance test and its various scoring derivations,” said Wilson, who is now an associate professor and director of anatomy education for the Department of Anatomy and Cell Biology at Rush University in Chicago, IL. “It is relatively commonplace for educators and administrators to blindly place their trust in tests/instruments to make decisions about applicants, students, trainees, and employees without fully appreciating how validity evidence is established.”
Wilson joined the AAA in 2010 and has served on the Committee for Early Career Anatomists, the Anatomy Curriculum Content Task Force, and chaired the Anatomy Education Research Institute (AERI) Task Force.
“During my graduate training, it was evident that becoming a member of an anatomy organization would help me to build valuable networks of collaborators and would allow me to become connected to a broader international anatomy education community,” said Wilson, who won the Rush Medical College’s Daniel Brainard Award for Excellence in Teaching in 2020. “I had always heard the AAA was like one large extended family but needed to experience it for myself to draw my own conclusions. With many AAA conferences now under my belt, I can confidently attest the AAA is indeed one giant extended family of talented professionals.”
While the ASE special issue on psychometrics is still in its early stages – Wilson is currently recruiting
proposals for manuscripts – he gave Anatomy Now a sneak peek into what to expect.
Q: Why psychometrics? What makes psychometrics so valuable when it comes to teaching
anatomy?
A: For this special issue, I wanted to peel back the layers of psychometrics to help fellow educators better understand how validity arguments are constructed. During my training, I was never content accepting a generally positive statement about the quality of a test or instrument. I always wanted to understand how data-driven evidence informs us of the quality and utility of the measures we employ. I’m hoping this special issue will spark the same interest and desire for evidence among other anatomists.
Pursuing this line of research has allowed me to contribute many works to the field of medical education. In several instances, I have cautioned the use of certain instruments for making high-stakes decisions about individuals due to the test’s/instrument’s poor validity properties. No one wants to make a high-stakes decision about an individual only to learn the test/instrument they were using did not accurately and/or reliably portray the individual’s knowledge, skills, behaviors, or perceptions. It’s simply not fair for any individual to be misjudged on the bases of extensive measurement error.
As such, I have made it a personal mission through my research to help others better understand the quality and efficacy of tests, instruments, and pedagogies through psychometric studies and meta-analyses.
Q: What do you hope the readers of this ASE special issue will take away from the journal? What do you hope the special issue accomplishes?
A: An ASE special issue on psychometrics is important for a variety of reasons:
It engages an international audience of researchers from an important subfield of education (i.e., psychometrics, quantitative psychology, educational measurement and evaluation) to demonstrate how this research field, conducted across many different disciplines and student populations, is directly transferable to medical and anatomical sciences education.
• It showcases the importance of using psychometrics to help establish evidence-based practices.
• It provides examples of different forms of research studies (aside from commonly employed efficacy studies and survey-based methodologies) that others can learn from and adapt to their own research agendas.
• It will help educate practitioners on how to recognize weak versus strong validity arguments so that individuals can be more cognoscente of the quality and efficacy of the tests/instruments they employ for educational assessment or research purposes.
One of my goals is to publish several systematic reviews and/or meta-analyses to help summarize and draw conclusions about the validity of certain tests, instruments, and psychological scales. These papers are useful for helping others to justify the selection of instruments and tend to reveal gaps in validity arguments. This, in turn, leads to recommendations for future research and helps to propel the field forward.
Manuscript proposals for the ASE special issue on psychometrics can be submitted via the following link: https://airtable.com/shrmhI433AN15EwbG