I mean, by cognitive psychologists. I skimmed over a few articles from Journal of Cognitive Neuroscience and Trends in Cognitive Science and concluded that ANOVAs and t-tests are mostly used (without effect sizes). I'm sure that there are more scientific journals of cognitive psychology than these two, and I guess, that there are also more advanced statistical tools than comparing groups. For example, in social psychology, structural equations modelling and mediation analysis are in fashion.

When asking this question, I had working memory in mind. Common methods to measure working memory empirically are, among others: dual task paradigms, n-back tasks and composites of simple memory measures. The main statistical tools that are applied to these measures seem to be mainly ANOVAs, t-tests, and other variations on traditional linear modeling, but what are the alternatives?

What are the most used statistical methods in WM research besides (generalized) linear modeling?

  • $\begingroup$ Statistical methods should be chosen based on the purpose, not on the discipline. If you can provide us with a more detailed question that would be great. For now, I vote to close this question because it is too broad. $\endgroup$
    – AliceD
    Feb 25 '15 at 8:23
  • 1
    $\begingroup$ @ChrisStronks I tried to improve it, but if it still to broad, don't hesitate to close it. $\endgroup$ Feb 25 '15 at 10:52
  • $\begingroup$ I think this greatly improves the question, thanks. I retracted my close-vote. +1 Good luck! $\endgroup$
    – AliceD
    Feb 25 '15 at 11:17
  • 2
    $\begingroup$ To reiterate @Chris' comment, the choice of analysis is completely dependant on the design of the experiment, and what the DV is, not the domain being studied. If you're looking at a continuous DV between groups, you use t tests/ANOVA (paired or unpaired), if you're looking at binary outcomes, you use logistic regression, and if you're looking at complex, nested, or unbalanced designs, you use mixed models. You'll really need to specify what kind of experiment you're thinking about, and consider posting on CrossValidated $\endgroup$
    – Eoin
    Feb 25 '15 at 12:19
  • 1
    $\begingroup$ @ChristianHummeluhr Thank you very much. I hope it helps. However soon it will turn out, that I'm gonna answer this question myself, by reviewing many psychological articles on my own... $\endgroup$ Mar 23 '15 at 15:02

It is difficult to overstate the extent to which analysis of variance-based linear modeling based for different groups dominates the cognitive sciences. A recent methodological review of the psychology literature suggesting that these analyses are used to test hypotheses in as much as 95% of studies (citation pending me recovering it). There are alternatives in working memory, but they often have more limited empirical support due to the dominance of the aforementioned analyses.

Hierarchical models

One alternative that doesn't veer too far from established practices is to use a hierarchical modeling approach, as you suggest. For example, Lee and Webb (2005) proposed a Bayesian hierarchical modeling of working memory which accounted for both individual differences and aggregated group data. The main benefit here is to take advantage of both individual- and group-level variability, but we ultimately end up with a linear model.

Many evaluations of cognitive models rely on data that have been averaged or aggregated across all experimental subjects, and so fail to consider the possibility of important individual differences between subjects. Other evaluations are done at the single-subject level, and so fail to benefit from the reduction of noise that data averaging or aggregation potentially provides. To overcome these weaknesses, we have developed a general approach to modeling individual differences using families of cognitive models in which different groups of subjects are identified as having different psychological behavior. Separate models with separate parameterizations are applied to each group of subjects, and Bayesian model selection is used to determine the appropriate number of groups.


An emerging, but currently more niche approach is to use topology. Topology is making some exciting inroads in the psychological methodology literature (e.g., Butner et al., 2014), but so far has not managed to see substantial use in the empirical WM literature. However, there are a few early birds who've made some attempts to capture WM within a topological context, namely Glassman's work on a "theory of relativity" for working memory (Glassman, 1999; Glassman, 2003).

In the succeeding excerpt, he explains why human verbal memory capacity is 3-4 items from a topological perspective:

Thus, a moment’s WM is hypothesized here to reside in myriad activated cortical planar “patches,” each subdivided into up to four amoeboid “subpatches.” Two different lines of topological reasoning suggest orderly associations of such representations. (1) The four-color principle of map topology, and the related K4 is planar theorem of graph theory, imply that if a small cortical area is dynamically subdivided into no more than four, discretely bounded planar subareas, then each such segment has ample free access to each of the others. (2) A hypothetical alternative to such associative adjacency of simultaneously active cortical representations of chunk-attributes is associative overlap, whereby, in dense cortical neuropil, activated subpatches behave like Venn diagrams of intersecting sets. As the number of Venn-like coactive subpatches within a patch increases, maintaining ad hoc associativity among all combinations requires exponentially proliferating intersections. Beyond four, serpentine subpatch shapes are required, which could easily lead to pathologies of omission or commission.


I am tangentially aware of related attempts to develop a theory of (working) memory as a form of foraging behavior, but not sufficiently to give a summary of it. Hopefully, the link is instructive.


  • $\begingroup$ You mean, this 'topology' that is a part of mathematics? $\endgroup$ May 3 '15 at 11:07
  • $\begingroup$ @Lili That's the one. $\endgroup$ May 3 '15 at 11:16
  • $\begingroup$ To my knowledge, topology is a family of open sets and I don't know what that has in common with WM... but I have downloaded the article. $\endgroup$ May 3 '15 at 12:15
  • $\begingroup$ @Lili Well, it is that, but that's not all topology is. I've fixed the broken link to the Butner article, which clarifies the relationship to cognitive science research (including WM). $\endgroup$ May 3 '15 at 12:29

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.