14

Sites: The social psychology network has a page for posting online social psychology studies. There are a range of requirements. In particular, it needs to be closely related to social or personality psychology. SampleSize Subreddit is a community dedicated to completing surveys. They like it when results will be provided at study completion. It has close ...


13

For an open source JavaScript/HTML/CSS solution, check out jsPsych: http://www.jspsych.org. It can be used for reaction time measurement and interactive designs. An article describing the library was recently published in Behavior Research Methods. A subsequent article investigated the properties of reaction time distributions collected with JavaScript ...


12

Does the locking refer to the initiation of the measurement with starting cue being being the presentation of stimulus or the response of the subject? More or less, yes. When measuring brain activity, you usually make a long, continuous recording during which you expose your study participants to a task over and over again. There's a lot of noise in ...


12

Antoine Tremblay has just released an advanced analysis toolbox: http://onlinelibrary.wiley.com/doi/10.1111/psyp.12299/abstract It's missing about half the features on your list, although fundamentally, spectral density is a simple task and LORETA is a stand-alone package anyways (although similar approaches, e.g. general CSD estimation, are implemented in ...


12

In speaking to constructs vs. measures, I believe that the difference is clear and implied in your background: constructs are that which cannot be directly measured (but we assume exists), where measures are directly measurable attributes that we assume relate to the construct. The process you seem to be questioning is that of the operational definition, or ...


11

The basic approach that you are describing sounds like inverse efficiency scores (e.g., see Townsend and Ashby, 1978,1983), which are measured as $$\frac{r}{1-e} = \frac{r}{c}$$ where $r$ is reaction time, $e$ is proportion error, and $c$ is proportion correct. John Christie provides a critique of inverse efficiency scores here or see the discussion in ...


9

Programs/packages for EEG analysis There are decent MatLab toolboxes with good tutorials for for the analysis of EEG data. The EEGLAB toolbox (tutorial) can be operated by both GUI and command-line (and script). The fieldtrip toolbox (tutorial) is mainly operated by command line / script. Of course there are also (commercial) software packages for EEG ...


9

A consensus within cognitive psychology is that there really is no such thing as "computation", though that depends how you define it. It seems all arithmetic ( + - * / ) is simply fact retrieval from long-term memory. More complex problems simply rely on the fact that we can break them down into simpler problems. For instance, when you learn to solve 364+...


9

I'd like to address important issues that Jeromy Anglim raised in the "Personal thoughts" section of his answer, namely that correlation parameters (i.e., true, population, or infinite-sample correlations) often vary and covary among studies, and this between-studies\interstudy heterogeneity implies heterogeneity in studies' parameters for a structural ...


9

Answer based on your original depression example Note that this answer was originally written based on your initial example, where you asked: Assume, I have developed a new intervention for people with light depression. I want to compare the effectiveness of this intervention (E) with an existing intervention (C). For this, I recruit test subjects ...


9

To calculate $d'$ you need to know two things: the hit rate and the false alarm rate. The hit rate is the proportion of trials where the stimulus was present and the subject responded that the stimulus was present. The false alarm rate is the proportion of trials where the stimulus was not present, and the subject responded that the stimulus was present. ...


9

I have found a list of Python and Matlab packages. I'll summarize them over here. As soon as I have gone through the packages, I'll provide some additional details. Online edaExplorer: Also in Python.* EdaExplorer is a tool that is able to detect noisy data from clean data. Five second epochs are made which will be categorized by a model that is the result ...


8

If you come to this question from the bayesian tradition, then there is only one place where you can sneak in bias: your prior. This dovetails nicely with the wikipedia definition: a pattern of deviation in judgment that occurs in particular situations, leading to perceptual distortion, inaccurate judgment, illogical interpretation, or what is broadly ...


8

OpenSesame is a recent entry that is cross-platform and seems to promote GUI-based design while allowing customization via Python scripting. It can be found at their website (link above). A recent article has references and summarizes 16 other tools as well (including some reported in the other stackexchange responses). I found great video tutorials and ...


8

I don't know of any well-validated general short scales. Here are a few thoughts: A major distinction is between self-report versus ability based measures. Self-report measures will ask the participant to rate their knowledge, skills, and experience. Ability based measures will require demonstration of competence. If you are limited to "self-measures", ...


8

Experimental psychologists seem quite happy working with single item ad hoc self-report scales, physiological measures, etc. with very little psychometrical assessment so even before talking about a full-fledged latent variable modeling approach, confirmatory factor analysis and the like you might want to wonder why they appear relatively unconcerned with ...


8

I think it's a basic concept of experimental design that you have control groups. So for example, if you want to study the effect of X (e.g., a drug) on Y (e.g., performance), you could manipulate X (e.g., give half the drug and the other half no drug) and randomly assign the participants to either group. Random assignment is a strategy for making the groups ...


8

Apologies in advance for the long answer. I tried to narrow down the scope by focusing on only a single construct, and only a single aspect of validity, and it still turned out like an essay... Let's take intelligence research as an example. This work started with an intelligence concept – a fairly vague and ambiguous idea about a personality trait that ...


8

Short version: A question is possible to answer sociologically if and only if its scale and region (informally speaking, its context) are completely defined and its variables of interest are operationalized. Long (really long) version: The following answer may be colored by my quantitative background, but if you give me the benefit of the doubt here and ...


8

The Torrance Test of Creative Thinking is a good place to start. It scores for fluency (number of responses) as well as originality (statistical rarity of responses) and elaboration (level of detail) on a variety of different tasks. The validity of the TTCT has been examined with several long-term studies, so there is a fair amount of data on its ...


8

The Hodgkin and Huxley model of neuronal firing is based on non-linear differential equations. A significant portion of research on sensation and perception is based on such models.


8

EEG research all started with Hans Berger, who in 1929 reported that brain activity could be recorded by measuring electrical activity on the scalp. Although the notion of ‘brain waves’ that were found by Berger was controversial, over the years many researchers replicated the results, which led to the acceptance of EEG as a real phenomenon. Neurons Before ...


7

I use the FieldTrip toolbox in Matlab to analyze my own modified auditory MMN experiment :) But I use MEG, so I don't have that many software options. The toolbox is very powerful but it has a steep learning curve and I would recommend it only if you already have both Matlab and EEG data analysis experience. I don't analyze my data in the classical MMN way ...


7

The following reviews some of the articles that I found discussing and implementing SEM meta-analysis to examine mediation. Cheung and Chan (2005) The authors distinguish three approaches of meta-analytic structural equation modelling (MASEM). Univariate two-stage MASEM: This includes a collection of two step approaches (note that Cheung and Chan call it ...


7

There are a wide variety of memory tests available for different purposes (sometimes clinical, sometimes for research). Also as Ben Brocka mentions, they can be more targeted as well. One test I can think of at the top of my head that is available for free online is the Montreal Cognitive Assessment (MOCA) that you might be interested in. It serves as a ...


7

The Open Science Framework will do some of what you ask for. Additionally, it will allow you to preregister your hypotheses to properly distinguish confirmatory and exploratory research. Features (quoted from the homepage). Document and archive studies Share and find materials, scripts, data Detail individual contributions Increase transparency ...


Only top voted, non community-wiki answers of a minimum length are eligible