Previously, the server would crash with an assertion failure when trying to remove an observer. Ouch.