Notice to demolish part of my house

I completed construction of my house in 2007 in Mambaram in Kannur district falls under Vengad Panchayath. At the time of completion Building Rule in Panchayat was not in force and this was authenticated by then Panchayath Secretary. In January 2011, I have converted one of the rooms into Internet cafe and separate building no. was obtained and made functional after obtaining licence from Panchayath. In short Two separate building numbers were given in facour of house and internet cafe. In April 2016, I received a notice from Panchayath Secretary ordering to demolish the building part of my house (where internet cafe is functioning) basing on a private complaint duly certified by the LSGD overseer wherein it was reported that I have attached the cafe in January 2011 and did not observe a distance limit from the kaithode 1.20 m though it was mentioned in the drawing submitted to Panchayath at the time of applying for new building number for Internet cafe.Against this notice I the submitted a reply stating all facts. But as of date Secretary did not withdraw the notice thereby my shop was closed and I lost my daily income and all the computer accessories were damaged. This also informed to all levels of the Department even upto the Director of Panchayath. Human Rights commission suggested to file a civil against Secretary. I need your opinion on above please