Lalit Modi remained associated with the IPL until the end of its third season