It is possible to delete them. I delete mine via ftp on a regular basis. If you want to enable the download option for your members, you will need to keep these files in place. I have that feature disabled, so there is no reason for me to store files in that folder. I do, however, make a backup copy before deleting them, just in case I decide to allow downloading in the future.