Click on the trash can under the menu item "Team" to remove a colleague from your team. You must be an admin to be able to do this.