Can we remove an attachment (a file field) instead of just adding or replacing the attachment?

Yes. In a process action OUT parameter, you can link the data that contains the file to an empty field in your form.