Watch "Half Nelson" and "Drive" and that'll change - he is a really, really good actor. My wife thought the same thing until she saw "Drive".
He was really good in "All Good Things" as well. Also, "Crazy, Stupid, Love" was good. It was a comedy, but he did a pretty decent job.