You can always roll all the blinds up if you don't want to hear the flapping. I only open the windows at night and little or no banging noise. But our sunscreen allows quite a bit of breeze through.
Woodsey, maybe the brackets you have is not big enough? I know they come in diff sizes.