Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [experiment-design]

The tag has no usage guidance.

0
votes
0answers
22 views

experimental design

How does a researcher come up with the number of experimental stimuli (e.g. number of targets and number of foils) for the experiment? My supervisor told me there should be at least 8 items for the ...
2
votes
2answers
32 views

What is the difference between “target” and “foil” in experimental design?

What is the difference between "target" and "foil" in experimental design in psychology? And how is a foil different from a distractor?
1
vote
1answer
13 views

Are there any online survey/questionnaire makers which allow use of sound clips?

I am looking to create an online data collection tool which would involve questions where a short sound clip is played, and the respondents would need to use a rating scale (possibly a slider) to ...
1
vote
1answer
49 views

How do psychologists measure malicious behaviour?

How do psychologists measure malicious behaviour in humans? Is there a definitive definition of what constitutes malicious behaviour? Are there varying scales of malicious behaviour? Is it possible do ...
2
votes
1answer
108 views

How is the term “physiological measurement” defined?

Does the measurement have to be subconscious? Can measurement such as eye-tracking be counted as physiological measurement? (I thought it is because of its relatively subconscious nature until I saw ...
1
vote
1answer
28 views

How can two-way dependencies in factorial designs be interpreted?

Scenario: Given there are results from two factorial experiments that show a two-way dependency between two variables A and B. Details: In the first experiment A is the independent variable with two ...
2
votes
1answer
41 views

What is an empirical proof that two concepts are not independent/orthogonal?

Given there are two psychological concepts A and B that are considered to be independent/orthogonal. Would the following empirical results proof the opposite? If not why? In the first experiment A ...
1
vote
2answers
65 views

What is the difference between the structure and the conception of an empirical study in psychology?

Can someone explain to me the difference between the structure of an empirical study in psychology and its conception? My interpretation is so far that structure means the test arrangement and ...
5
votes
1answer
156 views

How to report a quasi-experiment in APA?

As one reads the psychology literature (e.g. social psychology), it seems to me, and I hope I'm not wrong, that such a discipline is highly dependent on quasi experiments (correct me if I'm wrong ...
3
votes
0answers
36 views

Inducing error-related negativity

Which tasks induce the strongest error-related negativity? I'm trying to build a classifier that measures EEG signals to detect when a subject observes an error being committed by another subject. It ...
4
votes
1answer
67 views

Which experimental design is this? Factorial vs within groups

I have two independent variables (age and gender) and one dependent variable (the results of a questionnaire using a Likert scale). I'm trying to see whether age and/or gender have an effect on the ...
3
votes
1answer
138 views

In general, how does one resolve two competing theories in Psychology?

In looking at a post on twitter from a somewhat well-known psychologist Tal Yarkoni, he references a paper which lists multiple sets of competing theories in Psychology that have not been resolved. ...
0
votes
1answer
40 views

What would the effect on psychology experiments be if we found out that one person sees blue if another sees red?

Suppose we conducted an experiment that found that the color red makes people depressed and the color blue makes people happy. Now suppose we found out that when looking at a red object, person A ...
4
votes
1answer
74 views

What is a “norming experiment”?

I am a non-psychologist reading some papers from psychology. I keep seeing the term "norming experiment" (e.g. "Normative Representation of Objects: Evidence for an Ecological Bias in Object ...
2
votes
1answer
47 views

Is it recommendable to put participants in different conditions across trials?

In a pilot study we want to give participants 3 different problems. Those come in two versions, one (supposedly) easier than the other. Participants will randomly be assigned one version of the ...
1
vote
0answers
14 views

Quasi-experiment: If I change some procedures from my pilot experiment, can I still compare post-intervention results to the pilot results?

I am running a quasi-experiment with English proficiency as a factor (native speakers=9, ESL speakers=10) I just completed a pilot and fully plan to conduct the intervention as closely to the pilot's ...
2
votes
0answers
51 views

How to implement an incidental processing task without a fMRI-compatible response box?

Background I'm planning an event-related fMRI-experiment to investigate the difference in processing natural and computer-generated facial emotion expressions. My supervisor and I are discussing ...
7
votes
2answers
91 views

How can I run a placebo medication pills study? Practical advice needed

I am a lab manager looking to design a placebo experiment in a behavioral lab with a medical doctor. I believe our study needs to be credible and professional. I'd appreciate any recommendations on ...
2
votes
0answers
75 views

Desigining an online survey with two levels of randomisation

I'm trying to create an online survey where the participant hears a series of randomly determined sound files and rates each of them on a likert scale. We will have around 1000 participants, each ...
5
votes
2answers
85 views

What are the benefits of giving feedback to subjects during a discrimination task?

Context I am planning an experiment where the subjects would need to determine the language of the stimulus after listening to it once, given two alternatives, L1 or L2. In total I have 500 trials ...
1
vote
0answers
45 views

How much evidence is needed to support a claim? [closed]

Let's say that I hypothesised that if I behave in a certain way (X) then the people I interact with will respond with behaviour (Y). How much evidence do I need to make such claim ?
2
votes
1answer
46 views

What variables allow one to empirically and scientifically quantify trends for learning curves?

Specifically, I am trying to quantify trends in learning for certain mediums of audio-visual communication, and what I've gathered so far suggests that there are 4 distinguishable types, being linear, ...
3
votes
1answer
3k views

How to measure and quantify concentration or focus?

How can we measure and quantify concentration or focus? For example, if I were to say: "If you do Activity X while using Y, you will be more concentrated than if you were using Z" How can I ...
4
votes
1answer
66 views

Understanding a negative correlation between Pc and signal strength

When I present two signals in paired comparison and ask the respondent to select the stronger signal in the pair, I find that it is the signal strength of the second signal that more so determines ...
2
votes
0answers
21 views

Reading / Math task for evoking affective states

I plan to measure affective states with bio-sensors. For the affective states I will use engagement, confusion, boredom and frustration. For the bio-sensors I will use ECG and skin conductance. I ...
4
votes
1answer
230 views

At what time in a psychophysical test are catch trials preferably presented?

I am designing a tone-in-noise detection task (specifically a high frequency N0Spi task). For various reasons I need to use a yes-no paradigm and the method of constant stimuli. I am severely limited ...
0
votes
1answer
1k views

How do you decide how many trials to have in an experiment? [duplicate]

I'm currently designing an experiment with several conditions - how do I decide how many repetitions / stimuli within each condition? I know that I can justify sample size with an a priori power ...
1
vote
1answer
38 views

What is the best way to reduce measurement biases when studying topics that can evoke insecurity?

I'm interested in measurement biases relating to self reporting in surveys. To add more context: Under some circumstances, people have been known to add a positive spin when surveyed regarding goals ...
3
votes
1answer
38 views

Experimental design with two groups, pre-post measurement, and where everyone is treated

I am designing a study in which a large number of people are being treated. I cannot influence the treatment (e.g., a delayed treatment). I am able to make pre and post treatment measures on the ...
2
votes
0answers
26 views

Syncing up CPT device with EEG recording

I'm working on setting up an EEG experiment that will be going through a battery of various cognitive tasks. One of the tests is a Continuous Performance Task and to conduct that we'll be using a ...
5
votes
1answer
124 views

Do the results of psychological studies change our behaviour?

This is a question that has been bugging me for a very long time. Let me illustrate with a silly example. Suppose that a study finds out that the majority of the population associate the number 1 ...
3
votes
0answers
92 views

Testing earworms without ethical problems

Earworms (or sometimes referred as sticky tunes, involuntary musical imagery, stuck songs) is a phenomenon that many people experience in their daily lives. Although several studies suggest that they ...
2
votes
2answers
102 views

How do you raise the stakes in an experiment without actually paying people money?

I am trying to run a psychology experiment for one of my courses and it involves people trying to guard some "treasure" of theirs and trying not to lose it. My problem is that I can't ethically (or ...
4
votes
1answer
1k views

Does gender as a factor always make my experiment quasi-experimental?

I remember reading in a lot of introductory psychology texts that since there can be no random assignment of gender as a factor, the experiment can only be seen as a quasi-experiment. How does this ...
1
vote
0answers
26 views

What is the optimal way of structuring a multiple choice preference evaluation to determine most popular photo in a set?

Say I have a set of photographs and I want to ascertain the most popular one based on a group of people choosing their favourite. What is the most optimal way of structuring a survey to derive a ...
1
vote
1answer
31 views

How to convince subjects that the computer is playing fairly

We are planning an experiment using the odds-and-evens game. The rules of the game are simple: player A selects either "1" or "2"; player B selects simultaneously either "1" or "2"; if both select the ...
2
votes
0answers
54 views

How to handle duplicated recommendations in an online experiment for the recommender system

I am about to run an online user experiment to compare different strategies of the recommender system. I will compare 18 strategies and each strategy produces five recommendations, thus I have to ask ...
7
votes
1answer
1k views

How to measure stress quantitatively?

I am wondering what the most straightforward way is to measure stress levels objectively and quantitatively *, and specifically, cognitive load. I am open to suggestions, but my understanding is that ...
3
votes
1answer
28 views

Does work exist on relative valuations versus numeric valuations?

I've been trying to use Google Scholar to find something on this issue, but I fear I may not have found anything due to using incorrect terms. I am looking for any work which looks at rating systems ...
0
votes
1answer
91 views

Which is a better statistical option to compare differences across groups?

I have two groups (13 experimental and 13 control participants) performing on two cognitive tasks. I have accuracy (omissions, commissions) and reaction time measurement from each test for each person....
0
votes
3answers
61 views

How to random assign subjects to a group without any equipment?

I am working with a clinician and need her to randomly assign patients into one of two groups with the goal of having roughly equal numbers in both groups. The clinician does not have access to a ...