Found my own work-around, that's working in V32 (my work install doesn't update automatically, presumably a network issue).
Go the website using the speed-dial link, click the heart and choose a new picture. It will update the speed-dial accordingly. Would still be nice to just right-click and edit, but at least there is a way around without deleting all of them and starting again.
Thank you, you made my day.