When you collect data online, are the results from humans or AI? In a project led by Booth PhD student Grace Zhang, we estimate the prevalence of AI agents on commonly used survey platforms:
osf.io/preprints/ps...
๐งต
When you collect data online, are the results from humans or AI? In a project led by Booth PhD student Grace Zhang, we estimate the prevalence of AI agents on commonly used survey platforms:
osf.io/preprints/ps...
๐งต
Three Neat Rows Pierre Pellegrini
The spines of the collected edition of MONK. The final season's spine art is upside down compared to the rest.
The collected edition of a show about a man with crippling OCD...
I keep talking about estimands and people usually politely nod and say "yes, of course, research questions needs to be articulated clearly."
But actually I think I might have to make my demand more explicit: Actually spell out the (factual or counterfactual) variables and worlds you're contrasting!
If this turns out as described, this is massive news.
www.fastcompany.com/91503415/byd...
โผ๏ธ Postdoc recruitment
Want to help build and understand the future of scientific collaboration? We are seeking a postdoc in computational metaโscience.
๐ UF (Gainesville, FL)
๐ฐ $55โ60k (1-3 years)
๐ง High intellectual agency
๐
Deadline March 10
Send us your idea. Details attached!
I really like this chart: terminology for cause vs describe vs predict.
Weโre hiring!๐ฌThe MAClab at Texas A&M is looking for a lab manager to join our team in College Station. If youโre organized, passionate about research, and interested in emotion and the brain, we want to hear from you!
๐Apply at the link in our bio!
#PsychSky #PsychSciSky #neuroskyence #AcademicSky
Today I am excited to introduce respyra - an open-source Python toolbox for respiratory tracking experiments in interoception research!
Now on PyPI (pip install respyra) with a preprint on PsyArXiv:
osf.io/preprints/ps...
GitHub: github.com/embodied-com...
Scientists: for a new story, I have one big questionโ>
What is a โgood dayโ in the lab?
Iโm looking for epic examples of the best day ever to general criteria for what constitutes a โgood dayโ compared to a nothing-burger day.
Ping me if you have examples to share!
Re-posts appreciated!
You need to bring in the same toolkit as in studies that try to establish causality without randomization.
I know it sounds unfair, but I donโt make the rules. These situations are instances of post-treatment bias, if you want to read up on it as a psychologist:
Gen Z loves Friemds!
Screenshot of job ad for postdoc. Follow link for details.
T32 Postdoc position in developmental psychopathology at UMN Institute of Child Development! There are many excellent primary mentors available, as well as an even better set of secondary mentors to choose from (including me). See link for details, due April 1. drive.google.com/file/d/18SoO...
Are you a junior faculty member interested in spending 2-4 weeks at Princeton Psych? Consider applying for our Microsabbatical program! Itโs a fully funded visit for professional development and creating long-term collaborations.
psych.princeton.edu/diversity/mi...
Letโs find a 10K?
The half!
Recent work has shown how vulnerable online survey research is to LLMs. Motivated by this, we examined our online Posner cueing data from Prolific. It's concerning. We now must carefully consider when (or whether?) online behavioral data can be trusted.
see our comment:
www.pnas.org/doi/10.1073/...
Go Tufts!
New paper, on a worrying trend in meta-science: the practice of anonymising datasets on, e.g., published articles. We argue that this is at odds with norms established in research synthesis, explore arguments for anonymisation, provide counterpoints, and demonstrate implications and epistemic costs.
hello friends! does anyone know of open data of an RL task (single- mult-armed bandit tasks) that also list (a variable) ITI per trial in humans?
#computationalcognitivescience #computationalpsychiatry
Happy birthday to one of my favourite haters, Charles Darwin
Nominate a Project for a SIPS Award! ๐
Help us recognize contributions to improving psychological science!
๐ก SIPS Awards honor impactful projectsโnot individualsโbecause collective work drives progress. ๐โจ
Simulated null distribution for data with a sample size of 100, difference in group means of 5, and a p-value of 0.142
Simulated null distribution of a slope of 0.8 and p-value of 0.002
Finally, we have to decide if the p-value meets an evidentiary standard or threshold that would provide us with enough evidence that we arenโt in the null world (or, in more statsy terms, enough evidence to reject the null hypothesis). There are lots of possible thresholds. By convention, most people use a threshold (often shortened to ฮฑ) of 0.05, or 5%. But thatโs not required! You could have a lower standard with an ฮฑ of 0.1 (10%), or a higher standard with an ฮฑ of 0.01 (1%). Statistically significant The p-value is < 0.001 and our threshold for ฮฑ is 0.05 In a world where there is no relationship between x and y, the probability of seeing a slope of at least 0.901 is < 0.1% Since < 0.001 is less than 0.05, we have enough evidence to say that the slope is statistically significant.
Evidentiary standards When thinking about p-values and thresholds, I like to imagine myself as a judge or a member of a jury. Many legal systems around the world have formal evidentiary thresholds or standards of proof. If prosecutors provide evidence that meets a threshold (i.e. goes beyond a reasonable doubt, or shows evidence on a balance of probabilities), the judge or jury can rule guilty. If thereโs not enough evidence to clear the standard or threshold, the judge or jury has to rule not guilty. With p-values: If the probability of seeing an effect or difference (or ฮด) in a null world is less than 5% (or whatever the threshold is), we rule it statistically significant and say that the difference does not fit in that world. Weโre pretty confident that itโs not zero. If the p-value is larger than the threshold, we do not have enough evidence to claim that ฮด doesnโt come from a world of where thereโs no difference. We donโt know if itโs not zero. Importantly, if the difference is not significant, that does not mean that there is no difference. It just means that we canโt detect one if there is. If a prosecutor doesnโt provide sufficient evidence to clear a standard or threshold, it does not mean that the defendant didnโt do whatever theyโre charged withโ โit means that the judge or jury canโt detect guilt.
I just whipped up this little #QuartoPub site last week that demonstrates how I teach p-values/hyp-testing through simulation both with live OJS and with #rstats, and I think it's super neat! It has examples for diff-in-means, diff-in-props, and regression slopes nullworlds.andrewheiss.com #statsky
โIโve reviewed over 50 sticky toffee puddingsโ is an incredibly powerful way to begin a video
I made a map of 3.4 million Bluesky users - see if you can find yourself!
bluesky-map.theo.io
I've seen some similar projects, but IMO this seems to better capture some of the fine-grained detail
And on today's episode of "I can't believe I get paid to do this" ๐ค ๐๐ผ
Disturbingly detailed analysis of my first rewatch incoming