There should be an undo button or a recycling bin. No need to explain the undo button, but the recycling bin would be helpful. Here's an example: if your deleted 5 features and didn't realize that the first feature was not supposed to be deleted, you would be able to select that feature through the recycling bin.
We have created the ability for you to restore recently deleted workspaces and bulk-deleted records using a recycle bin. Administrators with account user permissions can find it in Settings ⚙️> Account > Recycle bin.
While I get the suggestion for the RECYCLE product, based on the fact that we have no way to roll back to a data backup I would think there would be more importance to having this as an option, at least as system administrator. I can do this in Salesforce.com so it must be something that can be setup.
Here's a way to solve the recycling bin dilemma: Create a product called Recycle Bin (RECYCLE). Store it at the root of your product hierarchy and edit permissions to meet your needs, such as Product Owners only. Instead of deleting a feature, just change the release to RECYCLE.