Bandit problems, exploration versus exploitation and Thompson sampling#

Fill me in.