The lease agreement was entered between the tenant and your deceased father.
The lease agreement is in force till 2024.
If the tenant is not paying the rent to the legal heirs of the deceased owner, then the legal heirs of your deceased father can issue a legal notice to the tenant to vacate the premises for default in rental payment for a period of more than two months.
If your father is reported to have died intestate then the property shall devolve equally on all his legal heirs consisting your mother, yourself and your siblings, if any.
Therefore first get the property transferred to your names and all of you combindely issue a legal notice or anyone of you can issue a legal notice instructing the tenant to vacate the premises for default of rental payments and also for disposing the property.
After that you can file a suit for eviction.
Without going to court you cannot get the desired relief.
Alternately you should have some rowdy elements or anti social elements at your beck nd call to threaten or to throw out the tenant and be ready to face the legal consequences thereon if you do not want to go through the legal process through court of law.