There are a lot of 3 star difficulty color puzzles that aren't that difficult. They're only tedious. I think that's affecting the algorithm to think it's more difficult.
I'm curious - perhaps a psychologist out there can throw some light on the personality trait which has the obsessive compulsion to state the obvious - I'm referring to the people whose only comment is to repeat the title of the puzzle.