Questions tagged [methodology]

For questions about experimental and theoretical methods, procedures, and tools used while conducting research in the cognitive sciences.

Filter by
Sorted by
Tagged with
29
votes
12answers
10k views

Open source software for running Internet psychological experiments that collect reaction time data

I've often used Inquisit to run psychological experiments online. The software enables delivery of stimuli (e.g., text, images, etc.) and collection of reaction times. Obviously general purpose ...
25
votes
11answers
5k views

How can I create computer based psychology experiments using OS X?

I've used E-prime to create computer based psychology experiments (you know, the kind where you for example show a number of pictures to the participant and record their responses to them, for example ...
24
votes
2answers
8k views

Free online intelligence test with norm table, high reliability, and must be printable?

I am looking for a general intelligence test which meets the following requirements: available online for free there is a table which translates "points" to IQ (I don't want a hidden online ...
23
votes
5answers
2k views

Can response time be incorporated into signal detection theory?

In signal detection theory, one typically uses "signal" and "no signal" responses to analyze the data (that is, the analysis is based on a discrete choice for each trial, generating the four possible ...
18
votes
4answers
4k views

Public domain scientific intelligence test available for use in research

The IPIP is an example of a public domain scientific personality inventory that can be used for research. Are there any good public domain scientific measures of intelligence? Requirements Do not ...
18
votes
3answers
1k views

Longitudinal mobile mood tracking app with random reminders

The goal is to take simple measurements of mood using Likert scale over an extended period of time (e.g. two months). I know there is a large number of mobile apps for tracking mood on every ...
17
votes
6answers
11k views

How to analyze reaction times and accuracy together?

Is there a good way to analyze reaction times and accuracy together, other than MANOVA? I have data from an experiment in which participants had to respond to stimuli in two different conditions in a ...
16
votes
2answers
4k views

What is the relation between measures, constructs and concepts?

It is uncontroversial to say that the cognitive sciences do not exclusively deal with directly observable phenomena, but nonetheless aim to study the physical causes of behavior and cognition ...
16
votes
8answers
1k views

Software for online psychological experiments that don't require users to download anything

We are currently using Inquisit to conduct Internet experiments. Ideally, we would like to implement something that is strictly browser-based, without any extra plug-ins or downloads. We also ...
16
votes
1answer
2k views

Is there a reasonably valid and reliable self-measure of computer literacy?

Measuring computer literacy or skill is important when grouping respondents for usability studies and other Human Computer Interaction studies. But for the life of me I can't find a good, simple but ...
15
votes
7answers
13k views

Where to post online psychology studies for participant recruitment?

A common challenge when running psychological studies is getting enough participants. Of course, there are many general strategies for recruiting participants, but I was specifically interested in ...
15
votes
11answers
3k views

Are there any cognitive test (or test suites) available on the iPad?

I find the IPad to be a great piece of hardware that is easy to bring along and that has an intuitive touch interface. This would make it an ideal platform for many cognitive tests such as n-back. As ...
13
votes
4answers
4k views

How valid are reaction times collected from online studies?

Online studies promise the possibility of greatly increased numbers of and variability in populations to study, but there are many potential concerns and need for validation, and diving in head first ...
13
votes
3answers
458 views

Is there a random walk theory that can account for situations with more than two choices?

In the article "Two-stage Dynamic Signal Detection: A Theory of Choice, Decision Time, and Confidence" from 2010 by Pleskac and Busemeyer, a random walk model is presented for situations where a ...
12
votes
3answers
1k views

Neurotransmitter based imaging techniques

All the brain imaging techniques I know fall into two categories: Tracking blood Either by looking at the magnetic (fMRI), or near-infared absorption (diffuse optical imaging, NIRS) properties of ...
12
votes
2answers
242 views

Measuring the adoption of norms

I'm trying to make a survey and I'm having trouble to find a scale to measure the adoption of norms. The people who fill in the survey have to think about a situation in which they were ashamed. For ...
12
votes
2answers
554 views

Fitting a psychometric function when data does not lend itself to a sigmoidal fit

I'm fitting a psychometric function to a range of data. The majority of this data lends itself to a sigmoidal fit (i.e. participants can do the task), but some individuals are absolutely unable to do ...
11
votes
3answers
5k views

What tools are available for EEG analysis on the R platform?

I'm starting some EEG studies on attention, and would really like to use R for preprocessing (filtering/artifact rejection), visualization, and analysis, but I can find very little in the way of tools....
11
votes
2answers
5k views

What is the standard way to analyze EEG data in a mismatch negativity paradigm?

I'm running an EEG experiment using a modified auditory mismatch negativity (MMN) design, and I'm wondering if anyone can tell me the best method for data analysis (and recommend any stats programs/...
11
votes
2answers
1k views

Is it possible to quantify cognitive bias?

We know that bias exists, and that it affects our judgment and perception. This effect has to do with user's experience in life. That experience is taken care of by the brain, and if you counter a ...
11
votes
1answer
2k views

How to measure group differences incorporating reaction time / accuracy trade-off?

In a psychological experiment I am measuring subjects' reaction time as well as their error rate. Now I would like to compare two groups (males & females). There might be a bias in the sense that ...
11
votes
3answers
432 views

Are there third party providers of Mechanical Turk psychology experiment services?

For various reasons it can be difficult to run a Mechanical Turk experiment (i.e., you don't have the technical expertise, you don't reside in the United States, etc.) Have any third-party providers ...
11
votes
1answer
214 views

Problems with using personal feedback to motivate participation in an online psychological experiment?

I am planning on running an online psychological experiment where participants must learn about various simulated environments and then make inferences about them. Because completing the experiment ...
11
votes
1answer
221 views

Is there a report of a successfully EEG-Based Brain-Computer Interface (BCI) using image training?

Currently I am involved in constructing an EEG-Based BCI. The goal of the BCI is to control which light in a series of lightbulbs lights up. The plan is to use different images (i.e. a flower versus ...
10
votes
5answers
196 views

Web-based tools for documenting studies?

I am interested in how open science could be done in psychology. Are there good web-based tools that could house and share a study? When I say "study" I mean: Lab notes from collecting data Raw ...
10
votes
2answers
2k views

What articles use structural equation modelling in a meta-analytic context to model mediation?

I'm interested in structural equation modelling (SEM) meta-analysis and its application to modelling mediation relationships. Mike W.-L. Cheung has written a few articles on the topic of SEM Meta-...
10
votes
2answers
4k views

What are “Stimulus locked” and “Response locked” in Philiastides & Sajda (2006)

While going through the below-mentioned paper, I came across some plots which were said to be "locked" with reference to either response or stimulus. Does the locking refer to the initiation of the ...
10
votes
2answers
4k views

When is it defendable to use manifest instead of latent variables in psychological research?

In psychology, most of the concepts, theories, ideas etc. of interest refer to latent variables, where a latent variable is one that can't be observed directly. Instead, one has to find a manifest ...
10
votes
2answers
5k views

Which statistical tests to use when analyzing NASA TLX?

The NASA Task Load Index (NASA-TLX) is a subjective, multidimensional assessment tool that rates perceived workload. A set of different scales (Mental Demand, Physical Demand, Temporal Demand, ...
10
votes
1answer
5k views

Open-source software for analyzing Electrodermal activity

Electrodermal activity (EDA) is a measure of the sympathetic activity, typically caused by stress or an emotional state. Analysis not a straightforward process like analysing reaction times. It ...
10
votes
1answer
153 views

What research exists in the areas of formulating questions and "problem shaping"?

After recalling Eric Steven Raymond and Rick Moen's How to Ask Questions The Smart Way and a discussion in a systems engineering course regarding the impact of the proper formulation of a problem in ...
9
votes
2answers
8k views

Calculating d-prime

I'm currently working on a research that has to use and calculate D Prime values for a task where subjects are presented an image at different speeds and they have to report if they saw the image or ...
9
votes
2answers
375 views

How do cognitive scientists measure creativity?

Einstein said once something like creativity is more important than intelligence. Intelligence as it is measured is really one's speed and efficiency at processing information. How one processes the ...
9
votes
2answers
1k views

How to estimate an expected effect size for a planned psychology study?

When planning a psychological study, researchers are often asked to formulate an estimate of expected effect sizes for important hypotheses in the study. This might be the expected group mean ...
9
votes
3answers
835 views

What are some examples of controversial themes in psychology?

There are a number of themes that are controversial (provoke debate, are unsettled, polarize opinion, or are reflected by a range of positions) in psychology. One example involves nature vs. nurture: ...
9
votes
1answer
4k views

What is the relationship between sociology and cognitive sciences?

I want to know what is the relationship between sociology and cognitive sciences. Let me start by short consideration of both: Sociology - well established discipline or a field of research ...
9
votes
1answer
129 views

Why aren't sleep measures consistently measured as mediators/moderators of cognitive performance?

Knowing that sleep quantity and quality affects cognitive performance across many domains, why aren't pre-test sleep measures or intra-test measures of arousal a standard part of all cognitive test ...
9
votes
1answer
408 views

The mind as a state of matter or physical system?

What examples of attempts to formalize a principled physical basis for consciousness and/or a general theory of the mind exist? I read a fascinating ArXiV preprint last year called Consciousness as a ...
9
votes
1answer
612 views

What is the test-retest improvement in Block Design test?

Background: My lab is conducting a research on perceptual training. We train participants on different tasks, and assess them pre- and post- training on a large battery of tests. Obviously, people ...
9
votes
1answer
229 views

Appropriate metric(s) for quantifying the accuracy gain obtained from averaging dyads of estimates instead of adopting individual estimates?

Background The question relates to research I am doing into the Wisdom of Crowds effect (Galton, 1907; Page, 2007; Surowiecki, 2004), in which an average of the estimates made by individuals proves ...
9
votes
1answer
13k views

What is the difference between RR-intervals and NN-intervals in HRV-data?

Heart rate variability (HRV) is often used as a measure of the sympathetic nervous system. One way to quantify HRV is by calculating the Inter-beat interval (IBI), also referred to as the RR-interval. ...
9
votes
2answers
2k views

How to use Mechanical Turk for longer studies (i.e., 30 minutes+)?

I'm interested in using Mechanical Turk as a means of recruiting participants for online psychology studies. I have never used it for any research. However, many of my studies take around 30 minutes ...
9
votes
2answers
472 views

Best practice to handle double negatives when using the expectancy-value model?

My question is regarding the multiplicative combination rule in the Expectancy-value model developed by Fishbein and Ajzen, and the issues regarding the expectancy value-muddle, or the case of "double ...
9
votes
1answer
14k views

What were the long-term effects on the participants of the Stanford Prison Experiment?

It has been maintained by Dr. Philip Zimbardo that the experiment has had no long-term harm on the participants. However, one out of the 24 initial participants, who had suffered a breakdown within 36 ...
8
votes
3answers
3k views

Differential equations in psychology [duplicate]

I am wondering (and searching with no success) if there are any examples of differential equations in psychology? I mean, no tutorial explaining what is differenetial equations or even partial ...
8
votes
2answers
2k views

How to assess participant awareness of experimental deception without inducing awareness?

I am designing a memory experiment with a deceptive critical trial, wherein an item is swapped without the participant's knowledge. What is the best way to determine if the participant has noticed ...
8
votes
3answers
1k views

Freeware for measuring keystroke duration

I am searching for freeware to measure the duration of a keystroke or mouse-click, both would work. Does anyone have an idea? Matlab toolboxes are, unfortunately, of no use to me.
8
votes
3answers
6k views

Analyzing control questions data for a survey

I have an experimental study with a list of demographic and related questions and in order to identify data from participants that were potentially just answering the questions at random (to get ...
8
votes
1answer
129 views

Is it possible to distinguish recall and calculation?

Say I ask subjects what $20 \cdot 20$ is. Is there any way, besides introspection, to evaluate whether subjects recalled the answer or calculated the answer? In general, I would expect that the ...
8
votes
1answer
120 views

How does one study the effect of a dietary supplement on cognition?

I've really enjoyed this talk by Molly Crockett: Beware neuro-bunk. The speaker outlines the limitations of modern neuroscience when accessing the effectiveness of dietary supplements intended to ...

1
2 3 4 5 6