Isn't an apk files just an archive which is unpacked when you install a package? So, why should it be kept then?
APK files aren't unpacked when you install the app. The APK file is the only copy of the executable code and static assets belonging to the app. Deleting the APK file would delete the app.
Unpacking the APK files would just take up more storage and take longer to access when you run the app.
They're in /data/data/applicationPackageName. For example /data/data/com.facebook.android but you have to be root.
Oops I'm sorry I thought you were asking where. I'm in the app and can't find the option to delete my answer. Please dismiss it.