There is always going to be people that criticize you for your decisions, and all you can do is ignore them, amirite?

unless of course they are critizing it because it is a bad decision.

Or you could take that criticizing and see if there is any merit to it. Maybe they're concerned because you're making a bad decision.