Same here. Just updated to the latest Opera 24 stable and reinstalled flash and everything. Still happens.
My most recent alert was from tunein.com when I was trying to play a stream. I forgot other sites which the alert pops-up to as well.
It happens on my Windows 8.1 too but I haven't encountered the alert after I updated that one to 24 Stable. I'll try to monitor it though.