Metric is so easy even I can use it,
everything revolves around easily understood increments or divisions by the magic number of ten.
For small stuff the millimeter is accurate and yet again, easy to use. Very seldom one needs precision greater than half a millimeter.
The least used I think is the decimeter, which is used more casually in vague terms of "maybe it should be moved a dec or two" where as (meters and) centimeters and millimeters are what counts.
I usually size thing up in cm and mm and there is no confusing which is what, and it is more or less dependant of how accurate things need be. Some one might say "I want a shelf which is 2.40m high" and to me he says 240cm and if he wants millimeter precision I just measure it up and it might be 2408mm. What I am trying to say is that when you rough up a measure you usually say like around One-and-twenty, meaning 1.20(m), and when you mark it up you are just thinking 120(cm), but not necessarily thinking 1200(mm). The millimeters are just added on a need to know basis. The long meters - kilometers and "real" miles - are just for getting to the site.
An mdf board being 16mm or 19mm or 22mm poses no problem when calculating sizes. If the denominator of 10 works for currency, then you can work out your small change easily when it comes to subtracting or adding for material thickness. Just think "small change" on your dollars and cents and it is not harder than that. That is why I think imperial is harder, you can't think "small change" on something you divide by 12.
I am as you probably figured out, not Imperial savvy.
For metric savvy people it becomes second nature and becoming metric savvy is very easy.