Why is Kentucky considered 'Horse Country?'

The Kentucky Derby is in Louisville, and Lexington is, of course, the "Horse Capitol of the World," but why Kentucky? Why pick here for "Horse Country?"