Also remove grouped properties if the last member is removed via removeObjectMember
(removeBindingByName already takes care of this).