Deleting the whole text of the note has the effect of removing it, as hitting the Del key when the note is selected in the attachments view.