Have you replaced the bushings that mount the sway bar to the frame? If not, there is a good chance that they are the source of your banging noise.
They do wear and shrink over time. If they are bad enough, you can actually move the bar in the bushings by hand but otherwise look fine. It also might not show up until it's cold enough for the metal and bushings to shrink, allowing the movement. The latter is an issue I'm dealing with.
Also, when you check the ball joints, do you have the suspension sitting on a jack or jack stand while trying to move the suspension with a long bar prying on the wheel? A bad ball joint will not show itself if the suspension is unloaded.
The comment made about sway bar links is pretty true as well. Today's parts aren't all that great anymore. One method to combat some of it is to install the sway bar links with the suspension holding the vehicle weight. If there is any quality to the part, installing them that way will allow the links to seat properly and not pop and bang in the holes of the suspension arm and the sway bar.