Mental and Verbal harrasment from landlord

Hello Sir/Madam, We are being humiliated and mentally harassed by our house owner(Vijayalakshmi) and her brother(Venkatesh). The house owner used to verbally abuse us(me specifically) also she used to ask us to pay more money for maintenance cleaning, water bills etc. Because of their torture we have vacated their house recently and moved to other house nearby. We are staying in the same colony a few lanes away from their house. The house owner and her brother reached our to our new house owner and created a bad impression on us that we don't pay rents and bills on time and we are very bad people without manners ets. Also when ever the house owners brother(Venkatesh) comes in front of me while I am walking around in the colony he stares at me as if he is going to hit me and while I am moving away form there he starts murmuring something verbally I feel like he is scolding me. I still kept calm as I didn't want to get into any quarreling or arguments. But he recently they started vising my fathers shop(my father is a shop keeper of a small general store in the same colony). My father is a heart patient and he informed me that Venkatesh is visiting frequently and demanding to pay money for maintenance and electricity bill etc. Which I have already paid and have a proof of that with me. That guy Venkatesh insists my father and is humiliating him stating that we left their house without paying the rent or bills etc. I thought of paying the amount what he has asking for to get rid of them, but this is becoming an ongoing issue and I am afraid that even after paying the maintenance or amount he is insisting, they still does the same and start humiliating me and my family members because of the grudge he and his sister had on us. I do not want to get into police and all stuff as already they have created a false and very bad impression on us in the nearby neighborhood. This is very painful for me even though there is no fault on our end we still have to face all their mental harassment and humiliation. Please assist me if there is a way to deal with it. This situation is becoming cumbersome and harassing day by day. Any suggestions would be appreciated. Thanks & Regards, An Indian.