Curiosity Is Our Built-In “Exploration Bonus”
Psychologist Tom Stafford, writing for the BBC:
“In the world of artificial intelligence, computer scientists have explored how behavior evolves when guided by different learning algorithms. An important result is that even the best learning algorithms fall down if they are not encouraged to explore a little. Without a little something to distract them from what they should be doing, these algorithms get stuck in a rut, relying on the same responses time and time again.
Computer scientists have learned to adjust how these algorithms rate different possible actions with an ‘exploration bonus’—that is, a reward just for trying something new. Weighted like this, the algorithms then occasionally leave the beaten track to explore. These exploratory actions cost them some opportunities, but leave them better off in the long run because they’ve gain knowledge about what they might do, even if it didn’t benefit them immediately.
The implication for the evolution of our own brain is clear. Curiosity is nature’s built-in exploration bonus. We’re evolved to leave the beaten track, to try things out, to get distracted and generally look like we’re wasting time. Maybe we are wasting time today, but the learning algorithms in our brain know that something we learned by chance today will come in useful tomorrow.
Obviously it would be best if we knew what we needed to know, and just concentrated on that. But in a complex world it is impossible to know what might be useful in the future. And thank goodness—otherwise we would have evolved to be a deadly-boring species which never wanted to get lost, never tried things to just see what happened or did things for the hell of it.
Evolution made us the ultimate learning machines, and the ultimate learning machines need a healthy dash of curiosity to help us take full advantage of this learning capacity.
Or, as Kurt Vonnegut said, ‘We are here on Earth to fart around. Don’t let anybody tell you any different.'” (Read more here.)
Remember Vonnegut’s immortal words next time you’re wondering whether to try something new. Give it a shot!