You can delete notes through the Review tab.
To delete notes:
Click Delete in the Notes group of the Review tab.
Click Delete under Notes tab of the Editor.
Right-click the segment and click Delete.