Keir Starmer said he would remain as caretaker Prime Minister until Labour selects a new leader in the coming weeks.