'Hogele', which he called you, in Kannada means 'get lost'. When judged in the backdrop of the meaning which both the terms i.e ''Naayinanmagane'' and ''Hogele'' carry in the ordinary parlance, it is clear that the expression used by you is offensive. As a corollary thereto, he can prosecute you for defamation. If he files a complaint you will have to contest the case on merits. So the answer to your question ''Is there any law to punish me for scolding him angrily.'' is Yes. You did not scold him, you abused him.
As regards the filth he creates on the road you may apply to court for injunction.