Speaking with The Hindu from Pune, the MP said he felt torn and that he did not think he was left with any other alternative