A network can only multiply and add, so on its own it only draws straight lines. Write bend(value): it gets one number, whatever arrives at a hidden unit (when x is 2, the top unit gets 2 and the bottom one gets −2), and returns the number that unit passes on. The same bend goes into both networks below: network 1 adds the two units and must draw a V; network 2 subtracts them and must still draw the straight line x.
x goes in: the top unit’s bend gets x as its value, the bottom one’s gets −x. Network 1 adds what comes out, network 2 subtracts it. What should bend pass on?
bend(value)| value | one number arriving at a hidden unit, e.g. 2 or -2 | e.g. −3 |
| returns | the number that unit passes on | |