There are two ways to delete an icon. Both methods require that you select the icon. Once the icon is selected, you can delete it by clicking on the icon delete control or clicking the delete button in the icon properties panel.
Note: If you inadvertently delete an icon, press [Ctrl] and [Z] keys simultaneously on your keyboard to invoke the Undo command. You can also undo a icon deletion by picking Undo from the Edit menu.