The neighbor seems to be a person of unreasonable thoughts rather a fanatic.
If his tortures are intolerable then you issue a legal notice to him instructing him to refrain from interfering in the peaceful enjoyment of your property and also to refrain from indulging in such unnecessary embarrassing activities lest to face legal consequences with costs
If he behaves in the same unbecoming manner, you may consult an advocate in the local and file a suit to restrain him from indulging in such activities which disturbs your peaceful possession and enjoyment of your property.