Sorry, I didn’t read this correctly the first time. I see how this could be an annoying problem 
.
As @BenLee suggested it, have you tried to right click on those people and remove them 
?
If the right click doesn’t work, I think it might be best to contact the support team directly, so they might take a look at this specific doc.