Compound wall

Our neighbor constructed the common compound wall without asking the permission without any discussion about design 15 years ago.at that time our house construction was not done,it was plot.Then they asked for half money of the wall.They told that we have done the proper base,and we trusted on them and gave the half money considering that they are neighbors and they will not cheat us,on goodwill basis.The height of wall is one and half feet only.Later our construction completed and we came to live in our house and after few days our transfer has came.and family is shifted to another city and from that time house was lock.Now after retirement we came here to live.Now problem is that neighbor is observing to our ladies while doing household work daily because height of the wall is very small.Neighbor is irritating us daily bydoing the observation of ladies.To stop this we told them to build the wall over the old one which will of minimum 6feet so the problem will be solved permanently without damaging the relationship.but now they are telling that it will not bear the load (old small wall).This way they cheated us.So we told them that we again do the construction from base.but they are not agree to do this also.because they want to continue the observation.Since this issue is about common compound wall.we can't take division alone.Society is not ready put attention in this issue.Society members are saying that it is your own problem,so we will not involve in this matter.Now what to do?How to solve this problem?Please guide me doing observatoon