He has big problems with his party, most of whose members feel ignored and despised by the metropolitan elite who lead it. 
In fact, these days it's a feature of British politics that its top brass live and socialise mainly in fashionable, influential London circles and are increasingly detached from their traditional supporters. 
 
http://www.independent.ie/opinion/columnists/ruth-dudley-edwards/gay-marriage-tricky-sell-to-tory-loons-29297276.html