We study a unique experiment to examine the importance of rating agencies' private information for bank shareholders. On July 20, 2011, Fitch Ratings refined their bank standalone ratings, which measure intrinsic financial strength, from a 9-point to a 21-point scale. This refinement did not affect their all-in ratings, which combine assessments of intrinsic strength and extraordinary sovereign support and provide an estimate of banks' creditworthiness. Thus, the impact of the standalone rating refinement was cleanly limited to bank shareholders. We find evidence suggesting that the refinement resulted in higher than expected standalone ratings, but we find only weak evidence of ratings catering. We also find a positive relationship between stock price reactions and rating surprises, revealing that the rating refinement delivered useful information about the importance of bank characteristics for assessing intrinsic financial strength.