13 votes
Accepted

What tools are available for EEG analysis on the R platform?

Antoine Tremblay has just released an advanced analysis toolbox: http://onlinelibrary.wiley.com/doi/10.1111/psyp.12299/abstract It's missing about half the features on your list, although ...
user avatar
  • 2,414
9 votes

Calculating d-prime

To calculate $d'$ you need to know two things: the hit rate and the false alarm rate. The hit rate is the proportion of trials where the stimulus was present and the subject responded that the ...
user avatar
7 votes

Can I use data taken in a 5-point Likert Scale, and convert it as if it were taken as a 4-point Likert?

In general, from my extensive experience, using a four or a five point response scale is not going to change much the psychometric properties of a typical psychological self-report scale (e.g., ...
user avatar
7 votes

What is the rationale for the normal distribution of intelligence?

Short answer IQ scores are distributed normally, because they follow the central limit theorem. Background When we measure IQ scores in sufficiently large populations, they will be normally ...
user avatar
  • 19.6k
7 votes

Is most of Kahneman's 'Thinking fast and slow' not supported by evidence/non replicable?

This is complicated. There's no easy answer, but the outlook for replicability/reproducibility of a lot of the empirical evidence is not great. The R-index (that the blog authors use to rank the ...
user avatar
  • 499
6 votes

Which statistical tests to use when analyzing NASA TLX?

In Stevens' levels of measurement framework, the NASA-TLX is an ordinal scale, not an interval scale, because there is no way to know a priori how much "workload" each point corresponds to. In other ...
user avatar
6 votes

How to know whether a methodological technique is quantitative or qualitative?

ANOVA and t-tests are statistical tests for significance and therefore quantitative. The other mentioned items are scales (adding numbers to a certain choice) and therefore they can be considered as ...
user avatar
  • 19.6k
6 votes

How to report an F statistic in APA style?

The F ratio statistic has a numerator and denominator degrees of freedom. Thus, you report: F (numerator_df, denominator_df) = F_value, p = ..., effect size = ... ...
user avatar
6 votes
Accepted

How to know whether a methodological technique is quantitative or qualitative?

It's important to distinguish between measures and analyses, because only analyses can be quantitative or qualitative, not measures. Measures are, essentially, systematic processes by which we ...
user avatar
6 votes
Accepted

How should results from linear mixed models (LMMs) be reported?

The APA style manual does not provide specific guidelines for linear mixed models. Additionally, a review of studies using linear mixed models reported that the psychological papers surveyed differed '...
user avatar
5 votes

How to report an F statistic in APA style?

The numbers inside the parentheses are the degrees of freedom for the F-statistic. The second number is the within-group degrees of freedom. When you have the same number of subjects in all ...
user avatar
5 votes

How long does physical attraction typically last in a permanent relationship?

I'm not sure I can give you the data purely for physical attractiveness, but what has been intensively researched is passionate love, which includes physical attraction. Passionate love is usually ...
user avatar
  • 2,414
5 votes
Accepted

How should I report results of a likelihood ratio test?

General reporting recommendations such as that of APA Manual apply. One should report exact p-value and an effect size along with its confidence interval. In the case of likelihood ratio test one ...
user avatar
  • 309
5 votes
Accepted

What variables allow one to empirically and scientifically quantify trends for learning curves?

Short answer In psychophysical tests, often %correct rates are determined. Hence, training effects are often measured by determining correct rates. The ultimate outcome measures can be wildly variable,...
user avatar
  • 19.6k
5 votes
Accepted

Should I look at the data of an experiment before the dataset is complete?

Short answer From an ethical standpoint, not including interim evaluations may be bad practice. Background I will start off with a more extreme case than in your question example, just for ...
user avatar
  • 19.6k
5 votes

Should I look at the data of an experiment before the dataset is complete?

gjacob is correct that optional stopping is a common research degree of freedom, and one that has a considerable and unfortunate intuitive basis. Yet, depending on the context of your research, AliceD'...
user avatar
  • 286
5 votes
Accepted

What are the benefits of using all 30 personality facets in multiple regressions compared to just including hypothesised facets?

I wrote a paper that focuses on this question (Anglim & Grant, 2014; pre-print is https://osf.io/g8kbj/download). In short, if you're interested in estimating how well facets predict an outcome, ...
user avatar
5 votes
Accepted

Recommended resources (journals, blogs, etc) for nurturing a background of statistical/methodological rigour in behavioural science research?

There are various loosely-defined 'camps' among reform-minded methodologists, so you probably want to try to follow a representative of each. Andrew Gelman is a prominent landmark in this area, and ...
user avatar
5 votes
Accepted

Recent Peer Review Studies on How Many Have Narcissistic Personality Disorder

While not a peer-reviewed study per se, but the DSM-5 says that the prevalence of Narcissistic Personality Disorder in the population is 6.2%, or approximately one out of sixteen members of the ...
user avatar
  • 287
4 votes

Should raw response time data be transformed?

You can transform RT, i.e., by log(1/RT). This makes the distribution roughly normal. The problem is that you don't usually run the ANOVA on the RT values collected at each trial, but on the average ...
user avatar
4 votes

Calculating d-prime

The index of sensitivity $d'$ is typically defined in terms of two equal variance normally distributed random variables with means $\mu_s$ and $\mu_n$ and standard deviation $\sigma$: $$d'=\frac{\...
user avatar
  • 2,617
4 votes

Which statistical tests to use when analyzing NASA TLX?

I am particularly concerned with whether or not the task load index could be considered an interval variable, Yup. This is a fundamental assumption people make when constructing, administering ...
user avatar
  • 1,227
4 votes
Accepted

How common is the form of amnesia depicted in fictional works?

What you are referring to is something called dissociative fugue. It is characterized as an official psychiatric disorder and dissociative disorder in the DSM-5, and its prevalence has been estimated ...
user avatar
4 votes

Why so few subjects in psychophysics?

It is partly as you already guessed, because the phenomena that are studied don't vary as much between individuals. This doesn't necessarily mean that individual differences in perception are smaller, ...
user avatar
  • 2,563
4 votes

in R : How to check RT's for ex-gaussian fit with the fitdistrplus package

To answer the question relating to start values for the parameters for use with fitdist: I would like to check for an ex-gaussian distribution fit (GAMLSS ...
user avatar
  • 141
4 votes
Accepted

How do scientists/psychologists deal with conflicting experiment results?

Meta-analysis is the statistical practice of combining results across studies in a principled way. Meta-analyses weight the relative strength of evidence from different studies to generate an overall ...
user avatar
  • 5,816
3 votes

How to measure precision in classical test theory framework?

'Precision' in classical test theory Most accounts of classical test theory do not have a notion of precision as such, but occasionally, reliability may be called precision instead. The relationship ...
user avatar
3 votes
Accepted

Optimal number of dimensions in multidimensional scaling

I guess it depends on your purpose. If you are doing the MDS for more heuristic purposes, then often two dimensions (or possibly three) will provide the greatest visual insight. Also, my sense from ...
user avatar
3 votes

Fitting a psychometric function when data does not lend itself to a sigmoidal fit

What you are looking for is called Hierarchical, Multi-level or Random-effects model. In your particular case the solution is a hierarchical logistic regression. Assume $y_{st} \in \{0,1\}$ is the ...
user avatar
  • 309

Only top scored, non community-wiki answers of a minimum length are eligible