Shouldn't the best universities be in the best cities?

Can we agree that the best universities in America are Harvard and Stanford. Can we also agree that the top cities are Los Angeles and New York? Wouldn't one expect that the best universities would be in the best cities? Wonder why they're not.