It's a Genius K640, it happens only in Opera and only on Youtube. I used Firefox before but I had problems with it. I changed to Opera yesterday and the speed difference is huge. And it's more stable. So changing to Opera is a huge improvement in every area, except this irritating issue. I'm not sure it can only happen on Youtube, but I didn't experience issues like this on other sites yet.
And yeah, I fired up my Firefox again just to check this out, there is no lag there. Just the browser feels slow in overall compared to Opera.