I would be much more concerned about the SS having little confidence in his own ability as well as his non acceptance of the new home owner's legal rights. Just how far will this lack of professionalism extend? I wouldn't want someone like that supervising my build...too many similar stories in these threads.
What should be my course of action if I find there are defects in the works carried out Apart from asking the SS to fix them? I do have a building inspection report detailing all the defects.
And yes I am also building with the same builder and SS as above.