Do what you want! You know your situation...just make a plan and stick to it. These non boosted guys are just jelly that your going for it and they haven't.
If everyone waited until it was a good financial time to mod their car, no mods would ever be done.