Is that how it does work?

Nope. Once you close a private window or a tab inside, then it's gone for good.

Or could it be made an option?

I don't think it would make any sense, but you can suggest such option in Suggestion Box.