# Other emotions relative to angry/happy base emotions

In my layman's experience, I'm vaguely aware there are four base emotions: happy, sad, afraid/surprised, and angry/disgusted.1

Some background: We're training an AI to learn the difference between happy voices and angry voices. We've had some success, by showing it 200 angry audio clips, 200 happy audio clips, and 200 neutral. It can now reasonably tell when we're talking pleasantly or confrontationally... but the accuracy could be better.

Our total training dataset is made up of these audio clips: Happy, angry, neutral, calm, sad, fearful, disgust, and surprised. I think we can be more accurate by including these emotions.

But this is the problem:

Happy/angry/neutral span opposite ends of a spectrum; like binary. It's easy to say:

Happy     1
Neutral   0
Angry    -1


That's the shape of the data we need to train a neural network to recognize 'Happy'.

So the question would be, is there any 'right answer' on filling in these blanks? I've given it my best guesses below, but I'm hoping for something more scientific....

Happy     1
Angry    -1
Neutral   0
Calm      X  (0.5?)
Fearful   X  (-0.5?)
Disgust   X  (-0.75?)
Surprised X  (0.75?)


1: http://www.theatlantic.com/health/archive/2014/02/new-research-says-there-are-only-four-emotions/283560/

• I believe this is more of StackOverflow Question but what you could do is have 8 different output nodes in the output layer that can be either 0 or 1. With some sigmoid functions in the hidden layer and supervised learning I believe this may be the best way. What you could also do is output a probability (0 to 1) for each emotion. Then you can select the one with the highest value. I would not recommend going with your approach, because it will probably often confuse surprise with happy e.g., given their proximity. I don't believe you can arrange these emotions so linearly namely. – Robin Kramer Jun 21 '16 at 19:49
• What is the evidence (or reasoning) for why happy and angry span opposite ends of a spectrum? Which spectrum? – mrt Jun 21 '16 at 19:59
• To clarify further, the emotions you listed can either differ or overlap on several dimensions, including valence, arousal, and conceptual content. What you may be distinguishing in your happy vs. neutral vs. angry paradigm is not the emotions per se, but their valence or arousal. – mrt Jun 21 '16 at 22:42
• @mrt The spectrum is customer satisfaction, so dissatisfied seems to translate into angry and satisfied to happy, if you agree? We're also capturing the meaning/sentiment of the words said too, for context, but that's a separate process. – RJB Jun 27 '16 at 18:29
• @RobinKramer We're using pyAudioAnalysis for our black box. Not much idea how it sciences the audio. Our hypothesis isn't necessarily to pinpoint an exact emotion, but to be able to tell like a 'good mood' vs a 'bad mood' voice -- by identifying traits of negatively and positively charged emotion – RJB Jun 27 '16 at 18:50