Of those population figures, I'd suspect a fairly large majority of those numbers don't actually give a shit about football and would choose to spend their disposable income somwehere else. Our crowds should still be larger than they are though. Breaking through the sad and unfortunate apathy and disinterest of a large number of people who call themselves football fans is the tough part
Get things right on the park and the rest will follow