14

Sites: The social psychology network has a page for posting online social psychology studies. There are a range of requirements. In particular, it needs to be closely related to social or personality psychology. SampleSize Subreddit is a community dedicated to completing surveys. They like it when results will be provided at study completion. It has close ...


13

For an open source JavaScript/HTML/CSS solution, check out jsPsych: http://www.jspsych.org. It can be used for reaction time measurement and interactive designs. An article describing the library was recently published in Behavior Research Methods. A subsequent article investigated the properties of reaction time distributions collected with JavaScript ...


13

Antoine Tremblay has just released an advanced analysis toolbox: http://onlinelibrary.wiley.com/doi/10.1111/psyp.12299/abstract It's missing about half the features on your list, although fundamentally, spectral density is a simple task and LORETA is a stand-alone package anyways (although similar approaches, e.g. general CSD estimation, are implemented in ...


12

Does the locking refer to the initiation of the measurement with starting cue being being the presentation of stimulus or the response of the subject? More or less, yes. When measuring brain activity, you usually make a long, continuous recording during which you expose your study participants to a task over and over again. There's a lot of noise in ...


12

In speaking to constructs vs. measures, I believe that the difference is clear and implied in your background: constructs are that which cannot be directly measured (but we assume exists), where measures are directly measurable attributes that we assume relate to the construct. The process you seem to be questioning is that of the operational definition, or ...


11

The basic approach that you are describing sounds like inverse efficiency scores (e.g., see Townsend and Ashby, 1978,1983), which are measured as $$\frac{r}{1-e} = \frac{r}{c}$$ where $r$ is reaction time, $e$ is proportion error, and $c$ is proportion correct. John Christie provides a critique of inverse efficiency scores here or see the discussion in ...


9

I'd like to address important issues that Jeromy Anglim raised in the "Personal thoughts" section of his answer, namely that correlation parameters (i.e., true, population, or infinite-sample correlations) often vary and covary among studies, and this between-studies\interstudy heterogeneity implies heterogeneity in studies' parameters for a structural ...


9

Answer based on your original depression example Note that this answer was originally written based on your initial example, where you asked: Assume, I have developed a new intervention for people with light depression. I want to compare the effectiveness of this intervention (E) with an existing intervention (C). For this, I recruit test subjects ...


9

To calculate $d'$ you need to know two things: the hit rate and the false alarm rate. The hit rate is the proportion of trials where the stimulus was present and the subject responded that the stimulus was present. The false alarm rate is the proportion of trials where the stimulus was not present, and the subject responded that the stimulus was present. ...


9

I have found a list of Python and Matlab packages. I'll summarize them over here. As soon as I have gone through the packages, I'll provide some additional details. Online edaExplorer: Also in Python.* EdaExplorer is a tool that is able to detect noisy data from clean data. Five second epochs are made which will be categorized by a model that is the result ...


8

I don't know of any well-validated general short scales. Here are a few thoughts: A major distinction is between self-report versus ability based measures. Self-report measures will ask the participant to rate their knowledge, skills, and experience. Ability based measures will require demonstration of competence. If you are limited to "self-measures", ...


8

Experimental psychologists seem quite happy working with single item ad hoc self-report scales, physiological measures, etc. with very little psychometrical assessment so even before talking about a full-fledged latent variable modeling approach, confirmatory factor analysis and the like you might want to wonder why they appear relatively unconcerned with ...


8

I think it's a basic concept of experimental design that you have control groups. So for example, if you want to study the effect of X (e.g., a drug) on Y (e.g., performance), you could manipulate X (e.g., give half the drug and the other half no drug) and randomly assign the participants to either group. Random assignment is a strategy for making the groups ...


8

Apologies in advance for the long answer. I tried to narrow down the scope by focusing on only a single construct, and only a single aspect of validity, and it still turned out like an essay... Let's take intelligence research as an example. This work started with an intelligence concept – a fairly vague and ambiguous idea about a personality trait that ...


8

Short version: A question is possible to answer sociologically if and only if its scale and region (informally speaking, its context) are completely defined and its variables of interest are operationalized. Long (really long) version: The following answer may be colored by my quantitative background, but if you give me the benefit of the doubt here and ...


8

The Torrance Test of Creative Thinking is a good place to start. It scores for fluency (number of responses) as well as originality (statistical rarity of responses) and elaboration (level of detail) on a variety of different tasks. The validity of the TTCT has been examined with several long-term studies, so there is a fair amount of data on its ...


8

The Hodgkin and Huxley model of neuronal firing is based on non-linear differential equations. A significant portion of research on sensation and perception is based on such models.


8

EEG research all started with Hans Berger, who in 1929 reported that brain activity could be recorded by measuring electrical activity on the scalp. Although the notion of ‘brain waves’ that were found by Berger was controversial, over the years many researchers replicated the results, which led to the acceptance of EEG as a real phenomenon. Neurons Before ...


7

Ethics of Feedback: The APA's code of ethics (2010) as well as the Advisory Group on Conducting Research on the Internet (AGCRI) report (2004) summarize ethical issues related to conducting offline and online psychological research. Feedback is normal in psychological experiments, and researchers are encouraged to debrief participants, before, immediately ...


7

To the general question of how to test the claims , there's a couple things you want to show: 1) that the body absorbs the supplement (measure the absorption rate) 2) that the supplement crosses the blood brain barrier 3) that the supplement actually plays the role of agonist, antagonist, or allosteric modulator (or possibly even has a toxic effect). ...


7

First off, what button-box you use is going to be influenced by what software you're using to run the experiment, so ideally you should specify that. The PST serial response box is probably the industry standard, and is what we have in my lab, although a lot of that is probably down to it coming from the makers of EPrime. EPrime doesn't work on OSX though, ...


7

The study design sounds pretty good. Some of the good things you are proposing: Using a repeated measures design will give you more statistical power than a between subjects design, which is particularly useful when your sample size is small. Randomising or counterbalancing for order should mostly control for order effects. Double blind will focus the test ...


7

Based on your comments I interpret your question as: "(1) What is the definition of the signal-to-noise-ratio (SNR) and (2) how do I determine the SNR for event-related potential (ERP) amplitudes in an EEG signal?". (1) Signal-to-noise-ratio (SNR) is a term often encountered in electrophysiology (e.g. EEG) and signal processing and can be loosely defined ...


7

Try the IAPS--International Affective Picture System; they have disgusting images as well as norming procedures and data. You can read about it here and request it (as long as you have a faculty advisor) here.


7

There are a few factors that could contribute to differences between online versus in-lab reaction time measurement. Hardware variation Participants in an online experiment will use their own computers to complete the task, which will result in lots of variation in hardware. Many studies have looked at how hardware variations affect response time ...


6

http://www.collegeboard.com/prod_downloads/sat/html/may2002/sat_may02.pdf This webpage includes an answer key and conversion table. The test is fair, valid, and reliable at no cost.


Only top voted, non community-wiki answers of a minimum length are eligible