Regarding fencing of my land 49.4 cent from four side

Sir i have 49.4 cent land in my native village in kanyakumari district… it is all recorded legally long time before in nearest taluka office and it is available with proper diagram in their site also… beside our land adjacent ally 5 residential owners are staying… my father long time before have also given one 2 feet path free to use 2 wheeler for their respective home. that path is under the custody of local panchayat. now i have to build the fencing on four sides on my land and for that i applied 3 times in surveyor office. each time surveyor comes but one person among the five families beside our land is obstructing deliberately claiming this measurement is wrong and he need to do measure from his surveyor which till date he haven,t done. he is not allowing to do fencing in spite of police protection (with my local station complaint). interestingly all the other four families with that disputed person is not in good terms and they are not with him. his intention is to grab some more cent path from our land on free basis so that one car can go by through. my query is now how can i proceed to fence my property legally. i would appreciate if you let us know..