Turns out that the only windows our neighbours have on that side is an ensuite one so I'm happy!
It would make more sense to take it on an as-needed basis or "if there are complaints you must change it" basis, rather than a blanket restriction. In this case, the need for your window to be obscured is non existent because the neighbours window is.