Oil Coolers

Just a quick question... when do we need oil coolers? Or do we need them at all? I've seen a lot of after market ones and was just wondering what stage you have to be at to really need one. Thanks.