If you copy a CAB file to your PocketPC and double-click on it, it will install and then remove itself. Some files are nice to keep on your Pocket PC or Storage Card in case you need to reinstall.
The easiest way to keep the files from deleting is marking them read-only.