With a down cut blade, you are going to get ragged on the side of the work piece away from the saw. It will also want to push the shoe of the saw off the work piece.
With an up cut blade, you are going to get ragged on the side of the work piece against the saw but it will pull the saw toward the work piece. If you then add a splinter guard, you won't get ragged at all.
Tom