‼️ Just out in Psychological Assessment! Check out our new paper exploring the hierarchical structure of the HiTOP-SR scales and their associations with daily life experiences.
dx.doi.org/10.1037/pas0...
Moderated nonlinear factor analysisで検討すると，HiTOPのスペクトルレベルでも下位因子レベルでも測定不変性は認められない。
Measurement invariance of hierarchical taxonomy of psychopathology across sociodemographic covariates: A moderated nonlinear factor analysis approach.
doi.org/10.1037/abn0...
I'm in the Guardian today, writing about the question of overdiagnosis of mental illness. I argue we need to stop seeing this as a binary yes/no question - is overdiagnosis happening or is the increase real? - and acknowledge that multiple things can be happening at once
tinyurl.com/yzsey97c
「Blueskyが成熟するにつれ、会社には事業拡大とその推進に集中する経験豊富なオペレーターが必要になっています。その一方で、わたしは自分が最も得意とする、新しいものをつくる仕事に戻ります」
BlueskyのCEO、ジェイ・グレイバーが退任へ
wired.jp/article/blue...
📣Revised preprint by @cas-goos.bsky.social
Measurement reliability, validity, and reporting in psychology still has a long way to go...
We compared original studies w replications, and where possible recalculated reliability & unidimensionality.
Some findings >
osf.io/preprints/ps...
MDCは変化の確実性には対処するが重要性には対処せず，MICは変化の重要性には対処するが個人レベルでの確実性には対処しない。測定の正確性と意味のある変化をきちんと区別すること。
Article: doi.org/10.1080/1445...
Letter to the Editor: doi.org/10.1080/1445...
Letter to the Editor (reply): doi.org/10.1080/1445...
Another EXCELLENT paper about exposure. But this supports my claim that we have to study recommendations that come from basic science and often we don't find they improve outcomes... www.sciencedirect.com/science/arti...
P.S. Pre-post differences are *not* valid treatment effect estimates. Why? Here's a post by @statsepi.bsky.social: statsepi.substack.com/p/one-simple..., here's a post by me: www.the100.ci/2025/01/22/r... >
HAM-D <-> MADRS (Leucht et al., 2018)
www.sciencedirect.com/science/arti...
BDI-II, CES-D, PHQ-9 -> PROMIS Depression (Choi et al., 2014)
pmc.ncbi.nlm.nih.gov/articles/PMC...
うつ症状評価尺度のcommon metric:
11のPROMs (Wahl et al., 2014)
www.sciencedirect.com/science/arti...
HAM-D <-> BDI/BDI-II (Furukawa et al., 2019)
doi.org/10.1017/S204...
🚨 New publication: How to improve conceptual clarity in psychological science?
Thrilled to see this article with @ruimata.bsky.social out. We discuss how LLMs can be leveraged to map, clarify, and generate psychological measures and constructs.
Open access article: doi.org/10.1177/0963...
Our crowdsourced megastudy comparing a diverse set of 12 single-session interventions for depression is out today in @nathumbehav.nature.com!
Read the full paper here: rdcu.be/e6pzz (no paywall)
We also published a brief non-academic piece about the study today: theconversation.com/free-10-minu...
Clinical psychology depends on scientific evidence, but research from @chopwood.bsky.social et al. suggests that the kinds of data most commonly produced may not always align with what clinicians find most useful in practice. Read the article in American Psychologist: doi.org/10.1037/amp0...
「IMC（註：質問の教示文をよく読んで回答したかを確認する方法）には注意喚起効果があり，回答者が調査の冒頭でIMCに触れると，その後回答精度が高まる」
トラップ質問に接した回答者は、その後の回答行動を変えるのか？：不注意・努力不足回答識別法による注意喚起効果
www.jstage.jst.go.jp/article/acs/...
This is consistent with earlier psychometric work that suggests 5-7 is the best response scale options, but good to see that the finding holds up in contemporary research. Also, good to see that labeling scales whether anchored or not has little impact on findings. academic.oup.com/ijpor/articl...
Per protocol analysis strikes again!
Folks, if you randomize but then don‘t analyze some of the people who got randomized (maybe because they didn’t adhere to instructions, maybe because they dropped out), randomization will no longer do all the heavy causal inference lifting.
This recent RCT of an "AI stethoscope" claims the technology "shows promise" for diagnosing cardiovascular conditions.
It does not.
It is a textbook example of the risks of conducting unprincipled 'per protocol analyses'. Once again, peer review at a major medical journal has failed.
🧵 1/
New post! "Valuing the Process vs. the Product in Research," in which I try to describe some of the tensions around using GenAI/LLMs in scientific research, and why it can be so difficult to have productive conversations on the topic. getsyeducated.substack.com/p/valuing-th...
David Moore (aka Bing & Ruth) のピアノソロ。弱っている自分にとても沁みる。
bingruth.bandcamp.com/album/graze-...
測定不変性の分析方法よりも，理論的根拠や解釈の仕方を多く解説していて勉強になった。心理療法の作用機序を検討するときのヒントにもなりそう。
The Dire Disregard of Measurement Invariance Testing in Psychological Science
doi.org/10.1037/met0...
Paper on statistical power necessary for interaction effects
doi.org/10.1177/2515...
Recent work has shown how vulnerable online survey research is to LLMs. Motivated by this, we examined our online Posner cueing data from Prolific. It's concerning. We now must carefully consider when (or whether?) online behavioral data can be trusted.
see our comment:
www.pnas.org/doi/10.1073/...
Bots have made their way to Prolific experiments. Our lab has stopped online testing of adults entirely now for this reason - we want to know if what we study is real. Probably data collected 2-3 years ago are ok, but moving forward we just can't know. www.pnas.org/doi/10.1073/...
We investigated the @hitop-system.bsky.social Brief Report (HiTOP-BR) in two German samples. Although there is room for improvement in certain areas, the HiTOP-BR provides a time-efficient and psychometrically acceptable assessment of the 6 HiTOP spectra. doi.org/10.31234/osf...
Comparison of Psychometric Approaches to Evaluating the PROMIS Depression Instrument
www.isoqol.org/comparison-o...
Psychometric evaluation of the PROMIS® Depression Item Bank: an illustration of classical test theory methods
link.springer.com/article/10.1...
著者は研究信頼性運動に否定的というわけではなく，何なら超一流のトライアリストとして透明性の高い臨床研究を数多く行っている（私の憧れの研究者の一人）。その方がこうしたコメンタリーを出すのはとても興味深かったし，ケースシリーズ研究に積極的な理由も理解できた。
