To remove an object or group, select the object and either click on the delete button, or right-click on the object name and select delete from the pop-up menu.