Seller denying to repay token advance

Sir we went through an agent and liked a villa. After discussion with the Villa Site Manager At first a token advance of Rs 10000 was asked to transfer to confirm our genuinity and later it was Rs 50000. Before transferring any amount we had told them that we have our property on sale and if any issues with loans or if we are unable to proceed with the deal , token advance should be returned to which they agreed. And there was no legal agreement signed. On verbal agreement we trusted them. After transferring token advance of Rs 50000 within a week we told them we would not be able to proceed as there is a delay in sale of our property and also we felt there was no transparency in the dealing as they had not given us owner’s contact details even after amount transfer. And then they told us to transfer another 50000 to make agreement and then 2 lakh to make agreement on stamp paper and finally it was 5 lakh. So we decided to call off the deal as we were unable to proceed and did not wanted to trouble the owner also. After much pleading and request The manager took our bank details to forward to villa owner for repayment but soon after she blocked our numbers and the agent was also not responding well. It’s been more than a month we still don’t know who the owner is as they have not given us any details and they r not returning our money also, stating that due to us they lost other interested buyers. Will I not get my money back? Due to all these unwanted tension and stress I’m losing my health too. What am I supposed to do? Can they forfeit my money? Kindly reply Thank you