Prime Minister Narendra Modi and Home Minister Amit Shah are likely to attend the BJP government's oath-taking ceremony in West Bengal on May 9, after the saffron party won the Assembly elections with a massive margin, ending TMC Supremo Mamata Banerjee's 15-year rule in the state.