Custom tags are a powerful feature. for reasons I'm confident you're aware of.
However, once you create a custom tag field, say "PM_Ideas", there is not the ability to edit or delete the tag value.
This is very limiting in such key ways as 1) Once an item has been decided to be merged into another tag category the old tag definition still show up on the list, and 2) When you want others to use tags for that fields, you will find the too many similar tags with no way to consolidate from the list which is displayed.
For the same reasons the default tag category can allow edits, deletes, renames so should the custom tag fields.
The "Configure tag options" page does allow you to delete custom field tags, but only if they are unused.
Actually you can edit the tags. If you go to the custom field configuration for the field there is a link to "Configure tag options" near the bottom of the dialog. This will allow you to rename tags. Unfortunately we can't support deleting or merging custom field tags.