Is 2 years a long time to wait for our new house?

Our house has taken nearly 2 years to build and we are fed up. The builder seems to have a very casual approach to his work ( initially we should have done more homework) and his co-ordination skills are appalling. It's not until we need roof trussess that he thinks to order them and consequently living in the country we have to contend with delays from suppliers. This seems to be the situation at all stages of building - there seems to be no forward planning. We signed a contract with the builder and he stipulated 9 months building time. We have had a total of 26 weeks no activity at our site. The house has now been painted but there is still lots more to do yet. Also some of the brick pillars at the front of our house have the supporting poles off centre on the pillar - is this a thing to complain about, or are we being pedantic.

The builder has about 5 different jobs on the go at once, and being a small company he spreads himself fairly thin,

I have searched high and low for somebody to consult regarding his poor practice, and to complain about his building ethic, but have come to a dead end each time. He belongs to a reputable Builders Association, but they haven't bee helpfu to my enquiriesl so far. Is there anybody to contact who can take on complaints and give advice. I live in South Australia.

Also, are we being unfair expecting to be in our house sooner than this?
Starting date was Septemver 2004.