Questions tagged [statistics]

For questions about statistical methods that might be appropriate for certain paradigms within psychology, psychiatry, neuroscience, or cognitive science.

Filter by
Sorted by
Tagged with
23 votes
5 answers
2k views

Can response time be incorporated into signal detection theory?

In signal detection theory, one typically uses "signal" and "no signal" responses to analyze the data (that is, the analysis is based on a discrete choice for each trial, generating the four possible ...
user avatar
  • 1,414
18 votes
6 answers
11k views

How to analyze reaction times and accuracy together?

Is there a good way to analyze reaction times and accuracy together, other than MANOVA? I have data from an experiment in which participants had to respond to stimuli in two different conditions in a ...
user avatar
  • 790
14 votes
5 answers
6k views

Which R packages have good collections of psychology datasets?

The open source statistical software R has a range of contributed packages. Some of them include datasets. I teach research methods in psychology and I'm looking for interesting real-world dataset ...
user avatar
13 votes
3 answers
592 views

Introductory resources on bayesian modeling for cognitive sciences

On Cross Validated there is a great question about best introductory books for bayesian statistics. Also, Jeromy Anglim blogged recently about use of JAGS, rjags, and Bayesian Modelling, with some ...
user avatar
  • 2,347
12 votes
3 answers
27k views

How should results from linear mixed models (LMMs) be reported?

Are there any official APA guidelines for reporting linear mixed model results? Can I take an approach similar to what would be done with an ANOVA (i.e., report the p-value, standard error and .95-CI ...
user avatar
12 votes
2 answers
568 views

Fitting a psychometric function when data does not lend itself to a sigmoidal fit

I'm fitting a psychometric function to a range of data. The majority of this data lends itself to a sigmoidal fit (i.e. participants can do the task), but some individuals are absolutely unable to do ...
user avatar
  • 396
11 votes
3 answers
5k views

What tools are available for EEG analysis on the R platform?

I'm starting some EEG studies on attention, and would really like to use R for preprocessing (filtering/artifact rejection), visualization, and analysis, but I can find very little in the way of tools....
user avatar
  • 2,903
11 votes
2 answers
5k views

What is the standard way to analyze EEG data in a mismatch negativity paradigm?

I'm running an EEG experiment using a modified auditory mismatch negativity (MMN) design, and I'm wondering if anyone can tell me the best method for data analysis (and recommend any stats programs/...
user avatar
  • 111
11 votes
1 answer
206 views

Are there any journal articles in psychology that have promoted and discussed reproducible data analysis?

I consider reproducible analysis to be really important. In particular, I'd like to see more researchers in psychology: sharing their data producing their journal articles using literate programming ...
user avatar
10 votes
2 answers
2k views

What articles use structural equation modelling in a meta-analytic context to model mediation?

I'm interested in structural equation modelling (SEM) meta-analysis and its application to modelling mediation relationships. Mike W.-L. Cheung has written a few articles on the topic of SEM Meta-...
user avatar
10 votes
2 answers
1k views

The current recommended text for statistics in behavioural sciences

I have an old book: Statistics for the Behavioural Sciences (4th ed.) by Gravetter & Wallnau. I want to transition my textbooks to eBook format, but this book doesn't come like that (as far as I ...
user avatar
10 votes
3 answers
9k views

Calculating d-prime

I'm currently working on a research that has to use and calculate D Prime values for a task where subjects are presented an image at different speeds and they have to report if they saw the image or ...
user avatar
  • 101
10 votes
3 answers
4k views

When is it defendable to use manifest instead of latent variables in psychological research?

In psychology, most of the concepts, theories, ideas etc. of interest refer to latent variables, where a latent variable is one that can't be observed directly. Instead, one has to find a manifest ...
user avatar
  • 2,496
10 votes
2 answers
6k views

Which statistical tests to use when analyzing NASA TLX?

The NASA Task Load Index (NASA-TLX) is a subjective, multidimensional assessment tool that rates perceived workload. A set of different scales (Mental Demand, Physical Demand, Temporal Demand, ...
user avatar
  • 3,471
10 votes
1 answer
176 views

Which statistical test should I use when there are multiple latent predictors and multiple latent outcomes?

Which statistical method should I use when Predicting organization commitment (composed of 3 latent variables) using the five factors of personality? Its a cross-sectional design with survey data. ...
user avatar
  • 213
9 votes
1 answer
48k views

How to calculate IQ score based on raw score and adjust for age?

I am having a hard time grasping how IQ scores are calculated. I think it has something to do with their age score ratio multiplied by 100. Say I have a test that holds 30 questions. How would I ...
user avatar
9 votes
2 answers
1k views

How to estimate an expected effect size for a planned psychology study?

When planning a psychological study, researchers are often asked to formulate an estimate of expected effect sizes for important hypotheses in the study. This might be the expected group mean ...
user avatar
9 votes
2 answers
486 views

Best practice to handle double negatives when using the expectancy-value model?

My question is regarding the multiplicative combination rule in the Expectancy-value model developed by Fishbein and Ajzen, and the issues regarding the expectancy value-muddle, or the case of "double ...
user avatar
8 votes
3 answers
398 views

Analysis of parameter estimates from Ratcliff diffusion model

I would like to analyze a dataset in which subjects' reaction time and error rate have been recorded. In order to account for potential speed-accuracy trade-off I am planning to make use of the ...
user avatar
  • 653
8 votes
1 answer
95 views

What paper discussed the cognitive properties of Likert/visual analogue scales in ratings?

I seem to recall a recent paper investigating whether ratings created using Likert or Visual Analogue Scales formats had the cognitive properties of interval or ratio data (since they are generally ...
user avatar
  • 2,903
8 votes
1 answer
1k views

In fMRI analyses, what is the t-test actually comparing?

In a 1st-level fMRI analysis, it is unclear to me what the t-test performed for each voxel is actually comparing. I've seen this being described in one of two different ways: The t-test estimates how ...
user avatar
  • 919
8 votes
2 answers
148 views

Reproducible meta-analysis in psychology

I am a big proponent of reproducible data analysis. In particular, I like when researchers share documents in formats like Sweave and knitr which weave statistical output (e.g., text, tables, and ...
user avatar
8 votes
1 answer
136 views

Are there any models of the human visual field of view taking into account head, neck and eye movements and calculating likelihood of fixation?

I would like to know if there are studies that (1) model the field of view taking into account all degrees of freedom of the head, neck and eyes and (2) if there is any probabilistic model assigned to ...
user avatar
  • 121
7 votes
1 answer
233 views

Do we need a pre-test to compare the effectiveness of two treatments?

Assume, I want to evaluate how effective two teachers are in teaching English to German children. Both teachers have been teaching at the same high school for twenty years, and both use a distinctly ...
user avatar
7 votes
1 answer
106 views

What are the benefits of using all 30 personality facets in multiple regressions compared to just including hypothesised facets?

What are the advantages/disadvantages of using all 30 facets (NEO PI-R; Costa & McCrae, 1992) in a multiple regression versus only using the facets that you have a hypothesis for? I see that the ...
user avatar
7 votes
1 answer
790 views

Minimizing Halo Error

I'm working with a dataset wherein participants rate five different attributes of six device variants; the attribute ratings different variants are very tightly correlated, suggesting that this ...
user avatar
  • 2,903
7 votes
1 answer
117 views

Are there any standard psychometric scales that are only applicable to within-subject designs?

A while ago, I asked the question whether Presence questionnaires are valid in between-subject designs (see the question for the background to this assumption). While the question garnered some ...
user avatar
  • 306
7 votes
1 answer
2k views

How common is the form of amnesia depicted in fictional works?

There are any number of movies and television shows based on some variation of the same premise: A character suffers some sort of mishap (the most frequent mishap being a bump on the head), which ...
user avatar
7 votes
1 answer
9k views

What are the real life applications for Probability Learning?

Probability learning is a principle that states probability of a response tends to match the probability of the reinforcement. How does one achieve such rationality under uncertainty? What are the ...
user avatar
  • 79
7 votes
1 answer
151 views

What are the most used statistical methods in WM research besides (generalized) linear modeling?

I mean, by cognitive psychologists. I skimmed over a few articles from Journal of Cognitive Neuroscience and Trends in Cognitive Science and concluded that ANOVAs and t-tests are mostly used (without ...
user avatar
6 votes
1 answer
1k views

Correct measure of central tendency for reaction times analysis

I'd like to know what would be the less biased measure of central tendency to compare RTs in two conditions with a lot of trials (~700). Mean is really sensitive to outliers, and median really robust, ...
user avatar
  • 61
6 votes
1 answer
302 views

Is most of Kahneman's 'Thinking fast and slow' not supported by evidence/non replicable?

'So, replicability [of all studies in this book] is somewhere between 12% and 46%. Even if half of the results are replicable, we do not know which results are replicable and which one’s are not.' '...
user avatar
6 votes
2 answers
270 views

Recent Peer Review Studies on How Many Have Narcissistic Personality Disorder

Are there any peer-reviewed studies that show what percent of the population are believed to have Narcissistic Personality Disorder that have been published within the past ten years? I have read ...
user avatar
  • 287
6 votes
1 answer
255 views

Significant baseline, Oddball paradigm

I recently conducted an EEG experiment using a passive Oddball paradigm with two experimental conditions : standard stimuli (occurring with a 85% probability) and deviant stimuli (occurring with a 15% ...
user avatar
6 votes
2 answers
5k views

In a forced-choice task, what proportion of responses is above chance level?

If I give a task in which there are only two response-options, and I want to categorise the participant according to their responses, what is the 'cutoff' or required proportion of one type of ...
user avatar
  • 349
6 votes
1 answer
285 views

Controlling for response bias in a forced choice memory task

I want to present participants a pair of items $a$ and $b$, each with an association $x$ or $y$. Later on participants will presented with the items singularly, and asked 'what was the association?'. ...
user avatar
  • 390
6 votes
0 answers
241 views

Testosterone in women vs. estrogen in men?

It is known that women with higher estrogen are more likely to find men with higher testosterone as more attractive. Positive feedback is also known. But are women with higher testosterone level are ...
user avatar
  • 515
6 votes
0 answers
974 views

What to do when you have a speed-accuracy trade-off in your data?

Many studies report that a speed-accuracy trade-off (SATO) did not occur in the data since there is a positive correlation between RTs and error rates. In other words, people took longer to respond ...
user avatar
  • 919
5 votes
3 answers
160 views

Should I look at the data of an experiment before the dataset is complete?

For a research internship I am running psychological experiments online. As it takes a while until the experiment is done (meaning that enough people participated, so that a sufficient sample size is ...
user avatar
5 votes
2 answers
14k views

How should I report results of a likelihood ratio test?

I'm using likelihood ratio testing to assess whether a behavioral model is a better description of my data than a simpler (so called restricted) model. How should results of such statistical tests be ...
user avatar
5 votes
2 answers
2k views

in R : How to check RT's for ex-gaussian fit with the fitdistrplus package

I have several response times from participants in a mental rotation task. I'm really puzzled how to get the best distribution model to fit my data. I had checked several ones with the fitdistrplus::...
user avatar
5 votes
1 answer
143 views

How is sample size determined in animal research?

In human research, we define our universe and estimate the effect size we expect to observe, then we can draw the a sample of a given size. How is sample size determined for experiments in the animal ...
user avatar
5 votes
2 answers
69 views

How to statistically test whether parents and children share similar humor styles?

I have data from children and their parents on their humor styles (using the Humor Styles Questionnaire by Martin (2003)). For the adult version: It's a 32-item measure, with 4 subscales for each ...
user avatar
  • 51
5 votes
1 answer
180 views

Why so few subjects in psychophysics?

Why is it that most psychophysics experiments only use a handful of subjects (typically around five, but sometimes even four, three or two), whereas the "norm" for experimental psychology (assuming a ...
user avatar
  • 919
5 votes
1 answer
78 views

How many samples are there when test subjects come through different recruitment strategies?

Let's assume I want to conduct a survey. To find test subjects, I post an ad in a local newspaper, one on a locally relevant website, distribute flyers in front of the train station, and have managed ...
user avatar
5 votes
1 answer
293 views

Inferring relationships between psychological variables in clinical samples and issues in generalisation

Context I sometimes speak to researchers studying the relationship between variables in clinical psychology samples. A typical example is as follows: 100 patients with diagnosed depression many ...
user avatar
5 votes
1 answer
559 views

Facet versus scale prediction of Big 5 personality

NEO facets and scales: The NEO model of personality has 5 scales (i.e., extraversion, neuroticism, agreeableness, openness, and conscientiousness). For each scale there are 6 facets (e.g., neuroticism ...
user avatar
5 votes
1 answer
54 views

Is it reasonable to have a factor with only two levels in a carry-over design for an fMRI study?

I'm planning a carry-over design for an fMRI study. To save time, since it seems that I'll need a huge number of trials for my purpose, I'm wondering if it's reasonable to have a matrix 2x3x3, ...
user avatar
5 votes
2 answers
376 views

Are there any tests for one's belief or philosophy?

I know of the varying types of personality tests and I find them interesting (specifically HEXACO due to it having multiple facets to expand its 6 main factors and I believe it is open-source or free ...
user avatar
  • 151
5 votes
1 answer
284 views

Correlation between BIS and BAS responses

As a part of my lab experiment, participants had to answer questions for BIS and BAS (BAS reward, drive and fun) scales. The correlation matrix shows that BIS is significantly positively correlated ...
user avatar