Click or roll over an event to view the Event Information bubble. Choose Edit Event from the Actions drop menu.

You will be able to see your attachment at the bottom of the window, so click the delete button next to the attachment you wish to remove from the event.