Comment by mjburgess

Both POV here can be reconciled with an experience-dependent exploitation-exploration tradeoff.

For everyone,

Eg., suppose t is the reward for exploitation, and r for exploration, and xp is your experience.

Then as xp -> inf, t -> inf and r ->0.

As xp -> 0, the reverse happens: t -> 0 and r -> inf.