"The party is collapsing today solely because of one man: Abhishek Banerjee. His dictatorial attitude and the oppression we faced — false cases filed against us 12 or 13 years ago, demands for money — were unbearable," Ajmal Siddiqui said