Generally speaking, a lot of users permanently delete the files in their computers by use of Shift+Delete hotkeys. Or, they move them to the Recycle Bin first and then delete them from the Recycle Bin. In addition, from this article, you can learn how to realize the same goal using Delete key only.
Video guide on how to permanently delete files with Delete key on Windows 8:
Way 1: Make related settings in the Recycle Bin Properties.
Step 1: Right-click the Recycle Bin icon on the desktop and choose Properties.
Tips: If you are interested in how to add Recycle Bin icon to the desktop, you can find the answer in How to Show and Hide Desktop Icons.
Step 2: Choose "Don't move files to the Recycle Bin. Remove files immediately when deleted." for the disk automatically selected.
Step 3: Choose another disk, select "Don't move files to the Recycle Bin. Remove files immediately when deleted." and click OK.
Note: If there are more disks in your computer, do make sure you select the same setting for all of them one by one.
Way 2: Enable the corresponding setting in Local Group Policy Editor.
Step 1: Open the editor by any method introduced in 4 Ways to Open Local Group Policy Editor.
Step 2: Locate and open the "Do not move deleted files to the Recycle Bin" setting.
FYI, it is located in User Configuration/Administrative Templates/Windows Components/File Explorer.
Step 3: Choose Enabled and click OK in the following window to enable the setting.
In a word, either of these two methods enables you to permanently delete files by Delete key.
Password Recovery Software