Do you mean the menubar icons? If so you have to change each app's resources folder individually. Right click the application icon and select "show package contents". Open the contents folder and then the resources folder. Replace the menubar icon with another one of your choice. It has to be named exactly like the original icon. This is valid for most applications but some store their menubar icon elsewhere.
What buttons of what windows are you referring to?