I know that the Jacob's chuck on my T18, C12, and CXS can sometimes have a loud, sucking "pop" when I release it from the tool. To me, this indicates that it's already a pretty tight fit to start with.
I would check the inside of the chuck interface and the fast fix mount itself to see if there's a lot of dirt buildup or any damage.
Do you have similar difficulties installing the chuck on the end of the right angle attachment? It uses the same mount.