This is how it works. If you have 'Continue where I left off' enabled then i guess they are remembered.

There have been a long time request to remember pinned tabs no matter the start-up option selected.