Action against unmarried women having affair with a married man

A married couple was having some issues and hence was staying separate for around 1 year. In the meantime, I met him and became good friends. We started developing feelings and used to talk intimate things. But we actually did not have any physical relationship, it was verbal only, though i know i cant prove it currently. Recently he has moved to banglore to patch up with his wife. I reside in kolkata. His and his wife's family is also from Kolkata. After he went we dint have any such intimate chats, but recently had one unluckily. His wife took screenshots of the same and send it to their parents, etc. Her family members are continuously calling me and saying that they'll take legal action, involve police, court, etc against me. I received their call once and gave a clarification, but they were nt satisfied. So i dint receive a single call from their numbers after that as i have nothing to say on my behalf. They are now threatening me that if i dnt talk to them, they'll reach my office with all documents, (i dunno which document, may be screenshots). So, my question is, will they be able to harm/reach me at office/home with the help of local police station? What legal steps can they take against me? I am currently not receiving calls from any unknown numbers. They know the area i stay, but not the exact house.