The leader of opposition in the Lok Sabha said the Prime Minister's words were "evidence of failure"