1. You can do but the unwilling brother may file partition suit and seek injunction on construction.
2. If the court refuses injunction then you can proceed with construction. There is no other way out.
3. start doing that.
4. Convince your brother so all of you can execute a deed of partition on consent and register it.