You will have to change the DOB in passport as well.
To change the date on passport you will have to complete the formalities as prescribed by the passport authority.
Generally such formalities are not so hard and an affidavit done from the first class magistrate can take care of the situation.