Michael Owen had put Liverpool ahead before Alan Smith's equaliser in the first half.
Riise was in the box to nod back a Biscan chip, and Owen spinned to lift a fine shot into the top corner from eight-yards.
Leeds grabbed an equaliser after 42 minutes. Pennant skipped to the by-line before pulling the ball back for Alan Smith to fire home his 50th goal for United.
Then controversy on 57 minutes. Murphy watched a low free kick from the left bounce into the far corner after Robinson half-stopped the effort.
A referee assistant's flag was raised clearly spotting Liverpool men offside in the box. But after a long discussion with his colleague, Winter awarded the goal, much to Reid's disgust who had to be led back to his touchline seat by the fourth official.
With only five minutes left Pongolle's pace settled the points. Dudek's goal kick was flicked on by Heskey and the little French striker out-ran Zoumana Camara into the box before hooking his first goal for Liverpool past Robinson.
The Whites were unlucky but the Sunday paper's will show yet another defeat and a long, cold winter lays ahead for the boys.