If a game is ridiculously difficult, I'm not going to have fun. I'm going to get frustrated and start yelling/swearing, and then my mom's going to get frustrated and start yelling at me that it's just a game from the other room.
Videogamedunkey did a great video on video game difficulty, though...