I totally agree with you, I usually visit after hours when there's no-one there.
I have been warned in writing, I don't care I will visit whenever I please. The only way they know I've been there is because I ring and let them know about things that aren't quite right, they should be thanking me.