Ability to move features into already-shipped releases

I'd like a way to easily move a feature into an already-shipped release.  Right now, the Release dropdown for a feature only displays active releases. To move one in this case (let's say the Aha backlog somehow got out of sync with our dev tracker or someone accidentally moved something), I have to re-open the release, move the feature, turn off "ship notifications" to all our team, and re-ship the release which is a pain.