I know very little about statistics so I wouldn't have much of a clue about the right algorithm to use, but I do have a good idea of the behaviour I would like.

I think the behaviour I want is exactly that required by the Netflix Prize:

http://en.wikipedia.org/wiki/Netflix_prize

although rather than rating comments 1 to 5 I think I'd probably just have three levels (don't appreciate, neutral, appreciate).