Their working relationship deteriorated after three films