Translation Memory can be removed from a project without erasing the file through the Project TM tab.
To remove Translation Memory from the current project:
Reference: Project TM Search and Sort
A TM removal confirmation pop-up appears.