As a profile manager, you can remove another manager. It's on the profile's Privacy tab. Two things to understand: the ability to remove another manager works both ways, and the project might object to being removed. You might want to discuss with the project first.