Issue legal notice to agent to return your passport 

if he refuses file police complaint against  agent under section 406,420 of IPC fir criminal breach of trust ,cheating 

• If you have lost your passport, you need to report it to the nearest police station and get a First Information Report (FIR) or a Non-Cognizable Report (NCR) as soon as possible. You also need to inform the Regional Passport Office (RPO) where your passport was issued or the nearest Passport Seva Kendra (PSK) about the loss of your passport.
• To apply for a new passport, you need to register on the Passport Seva Portal and fill up the online application form for reissue of passport. You need to select the option “Lost/Damaged Passport” under the “Services Required” section and provide the details of your lost passport. You also need to upload a self-attested copy of the FIR or NCR along with other required documents.
• After submitting the online application form, you need to pay the fee and book an appointment at the nearest PSK. You need to carry the printout of the application receipt along with the original documents and photocopies for verification. You also need to submit a written statement explaining how, when and where your passport was lost or damaged.
• According to the web search results, after verification of your documents and biometrics, you will be issued a new passport with a new number and validity. The new passport will also have an endorsement mentioning that it is issued in lieu of a lost or damaged passport.

You cannot apply for fresh passport.

You have to get it from him, if he's not returning then you give a complaint to police and try to retrieve it.

Apply to PP office to cancel the PP and issue fresh.

If that person   misuses you pp it will amount to offence by you under Passport Act punishable with imprisonment for a term which may extend to six month or with or both. File a complaint  against him stating he took the  pp by cheating.

You need to lodge a police complaint against that person for illegally withholding your passport. Please do not apply for a fresh passport suppressing facts.

- Legally , no person is allowed to keep others Passport without getting his written consent , and holding others passport is an offence 

- You can lodge a complaint before the police and the passport authority against him.

- Further, if you want a new passport , then firstly you should lodge FIR for missing or theft of the passport , and after submitting the said FIR , you can apply for re-issue of the passport. 

You are suggested to report the matter to police. 

You can file a criminal complaint for criminal beach of trust 

Greetings of the Day,

I have read your issue but find that there are some facts which need to be clarified. You can approach on either nine two one two one two four five eight five or seven zero four two eight three three six eight six for personal approach.

We Hope that a personal consultation would be fruitful to the issue and it would be better for you to talk to someone directly.

Best Regards

SPS Law Chambers
New Delhi.