I'm reading Reinforcement learning and causal models by Sam Gershman, which states that TD-learning provides an account of second-order conditioning that provides an explanation for the phenomenon occurred in trace learning (pg. 7, 3rd paragraph). The idea is as follows:
In trace conditioning, a reward is presented after some cue A with some relatively large time delay. If a second cue, B, is presented during this gap, this facilitates the learning of a conditional response to A. He says that this is because B receives a large positive value which generates a large positive prediction error at the offset of A. I do not see why this is true. If you look at TD-learning, the values of A and B should strictly be a function of their temporal distance from the reward, i.e. $$\gamma^{T-t} r_T$$, where $t$ is the current time and $T$ is the time of the reward. He goes on to say that this is related to how the prediction error is changed with the presence of B. Could somebody explain to me why having B increases the prediction error?