I asked the neighbor I said, "What if I get into your property without your permission?" He didn't answer but he just grinned.

That is the problem with people who has double standards. They think they can do whatever they want but they themselves don't want things like that done to them.