You need to make sure that your Domino stays put when you plunge and remove the bit. You use one hand to press it down, and the other (usually, your dominant hand) to plunge it. Since there is such a big leverage due to the length of Domino, it is very easy to move the Domino sideways or upwards with your dominant hand when plunging the tool or letting it go. You need to make sure that you press it firmly into the place with your non-dominant hand and very gently and slowly plunge it, paying extra attention that it should only be motion in one direction. Do not hurry to move to the next hole. If you think about moving the tool to the left or to the right next, you will move it while cutting and your bit will break. I found that for me personally the odds of making a wrong movement decrease significantly if I hold the "on" slider with my finger and turn the tool on before plunging and turn it off after each hole, rather than keeping it running all the time. This helps me to separate plunging from moving to the next position. I move the tool only when the motor stops. I broke I believe two cutters, always because I moved the tool sideways or upwards while the cutter was still in the hole. The modified work flow helped a lot, bit breakage stopped. Also, do not force the tool, plunge it slowly, do not exert too much force on it. In hardwoods it will be a little slower than in soft woods.
The bits are very hard (which helps them to stay sharp longer) but the downside is that they also brittle. They cannot withstand a significant bending force.