I've found contrary to what you may think, they actually need to be bent or adjusted outward. There are several bolts you need to remove to adjust the lower half of the fender. If the door is not sagging and the frame is not bent, this will fix your issue. If out of alignment enough, you may need to loosen the bolts along the engine bay as well to align properly. I'm fairly sure you don't need any new panels, unless they're damaged or bent by something.