Penny Wise and Pound Foolish: A Rant on Biased Tool Reviews

TinyTiger

Member
Joined
Mar 10, 2013
Messages
83
Something struck me yesterday, and I wanted to get your take on it because it’s bugging me.  Last night I picked up a copy of the “Woodworker’s Journal 2013 Annual Review: Woodshop Tools and Supplies”.  Generally I enjoy looking through review guides like this and always pick up a few ideas on things I can’t live without.  My wife jokingly calls me a “tool snob” because I do love good tools.

The first article in the Handheld Power Tools Section was a review of ¼-Sheet Palm Sanders by Sandor Nagyszalancy.  I have a few of his books and consider him a pretty knowledgeable guy.  Little did I know how much his stock was about to drop (at least in my eyes).  He identified things he looked for and factors he considered.  Those were power and sanding performance, ergonomics, ease of paper change, and dust collection.  Sounds good, right?  He included a review of the RTS 400 EQ in the article.  The first two sentences are “By far the most expensive sander in the test group – more than 10 times the cost of the low cost Craftsman 11177 – Festool’s RTS 400 technically is not a ¼-sheet sander: It accepts only the company’s 5-1/4” x 3-3/16” rectangular hook and loop sandpaper.  The Festool sheets are relatively expensive…..”.  Hmmmm, I thought.  Two dings on cost in the first two sentences.  Where was the cost in the list of things he looked for and factors he considered?  It seemed to be a bit biased.  Then I got to the clincher in the last section entitled “Picking the Winners”.  He wrote “To further narrow the field, I eliminated the otherwise terrific Festool for simply being too expensive”.    WHAT?????????????  [mad]  At that point I had to stop reading because the smoke issuing from my ears was making it hard to see the words.  What happened to power and sanding performance, ergonomics, ease of paper change, and dust collection as being the important factors?  Nope – Festool is too expensive, so it’s outta here, even if it is an otherwise terrific sander.  I only have one thing to say – Shame on you Sandor Nagyszalancy!  And shame on Woodworker’s Journal for publishing an article that doesn’t even follow its own stated criteria.

I started wondering what Sandor would say if I wrote a magazine article saying his books were otherwise terrific but weren’t worthy of consideration because they were too expensive.  I imagine he would say “But they are worth the money because of all the good stuff inside them”.  I would agree.  Isn’t that the same issue here?  You can indeed buy a sander for $20-30, but the more expensive ones have a lot of good stuff inside them.

I started thinking about what is probably the most maligned tool in our recent arsenal – the Domino.  I struggled for years with a sub-standard excuse for a biscuit joiner and hated every minute of it.  The first time I used my Domino, I thought I could almost hear angels sing because it worked so well.  The problem is every woodworking acquaintance I talk to about it says “But they’re too expensive!”, and ends the conversation there.  Really?  I remember about 10 years ago a certain Mr. Norm Abrams on the New Yankee Workshop used a biscuit joiner from Lamello, and everyone had to have one.  It was the best thing since sliced bread.  I also remember it was around $700 at the time for the pro model.  Isnt $700 about 10 years ago just about the same as what we pay for a Domino today?  Strangely, I can’t remember one person complaining about the cost.  You paid it and smiled.  And without taking anything away from Lamello, we can do 10x as much stuff with a Domino as we can with even a high-end biscuit joiner.  I also recall the Lamello Joiners being included in the magazine reviews.  I still have a couple in my archive.  What was said about the cost then?  Nothing!

It just seems to me that there is a bias against higher-end tools by reviewers these days.  The average DIYer doesn’t need higher-end.  I get that.  If you use homeowner or DIY-grade tools and they do what you want and do it well, by all means use them.  I just wish the reviewers would also include a phrase like “If you’re tough on your tools, use them a lot, or want more precision or higher quality, look hard at the Festool”.  Is that too much to ask?

What do you think?  Is there really a bias in tool reviews, or am I looking at this the wrong way?  I’d like to hear your thoughts.
 
I stopped reading tool reviews long ago because there is certainly a bias...there was a thread not too long ago on dust extractors and Fine Woodworking faulted the CT units because the reviewer assumed that people would not buy filter bags.  Same silly logic as what you described in this article.  Several magazines do not even include Festool in the review or the review is just of a few select tools and so there is bias with the tools they are selecting. 

Scot
 
I agree. Cancelled my subscription to Fine Woodworking soon after that review.

Most tool reviews are worthless. The best review is the one you conduct yourself, and in conjunction with Festool's return policy you cannot go wrong trying out a Festool for yourself.
 
Same here, most are useless. Every now and again when I have to rely on reviews/tests, it is with much irritation that I battle my way through them. Example; Although not a tool, some weeks back I wanted to get new snowboard shoes. I have big feet so trying to find shoes to try on in a shop is a waste of time as I've found out, they have one, maybe two models in my size at the most. And what does it tell me anyway if they do fit? I have to get them up on the slopes to decide if they're any good, are the right stiffness etc but then I have to keep them. So online I went and ploughed through tons of useless and or biased/sponsoredinformation to get an idea of what's what in the world of snowboard boots. Tssss.... Waste of time.... In the end I took the plunge and bought some shoes online, not sure they're the right shoes for me, have to wait for next season to see what they're like.  :-\

There are maybe two people I actually take seriously when it comes to tools and even that doesn't mean I take their word for it. Your example with Sandor is quite stunning though. I can understand the pricing will always be an issue for some folks but at least keep the tools in the test and the conclusion. That's why most mags have the distinction between a best buy and overall best product for instance. Your not comparing his products to IKEA right?

In any case, it's his loss. You'll think twice before taking his scribblings seriously again, right?
 
I just wrote a post along the same lines as this...

I am somewhat jaded and wonder if people are just jealous. Or, are the magazines sellouts to the highest paying ad revenue.

Sadly, this behavior is not limited to just the magazines. I went to a local woodworkers club in my area. Several of the members criticized me for overpaying for tools(Festool, Lie Nielsen, and few other custom makers). I find it humorous because I make a very average wage, live in a household that includes three generations of family, my wife and I have one car which is 13 years old, and have not had a car payment in almost 9 years. On average it takes me 3-6 months to save up for a tool purchase. Yet, the same people who mock me do nothing in construction or manual labor and drive new 2500 trucks maxxed out with heated premium leather, dvd player, and every optional package you can upgrade with.

The real kicker are these are the first people to complain about the big box store and how their 30 day return policy sucks or how the tool they bought just six months ago died and they have to pay shipping costs that equal the cost of the tool to get it fixed.

Funny thing is, my TS55, CT33, and C12 drill that I bought back in mid 2000s are still kicking and have never missed a beat. They have helped me on several Habitat homes, have been dropped, and I have yet to have any of the tools fail and need replacement/repair. Knock on wood, I am somewhat disappointed I have not had to use Festool's awesome customer service that I hear great things about.

way off topic... I skipped reading the tool reviews and have cancelled all of my magazines except for Popular Woodworking(only because I am huge fan of WIA and support them for that). I personally think there is a bias somewhere... Why didn't Wood magazine compare the ClearVue in with the other vacuum systems...
 
Woodworking isn't the only industry that has its share of of paid blitherers.  Look at any firearms- or transportation-related publication as an example.  These alleged experts get paid to put words on a page within a certain timeframe needed for publication.  I learned long ago to read, but do it with discrimination.  Some days I have to wonder what the author was drinking/smoking/ingesting when writing that particular stream of drivel, and whether they actually believe it or not.  Some ideas presented just can't possibly square with my experience or observation, making me throw the BS flag.  Nothing beats personal experience for validating or refuting claims.  My Festool investment has a long way to go to pay for itself, but when I need a tool for a specific function, I know that the Festool selected won't let me down or embarrass me.  One could say the same thing regarding Snap-On tools. 
 
reviews should really differentiate between the hobbyist/home owner market and the professional market.
there is a gray area between them, but that doesn't mean the issue should be ignored.
one had ought to be getting what one pays for, and if one does, they save money/time/fatigue in the long run with better purchases.

for instance i just bought a makita plate joiner- the thing seems perfectly fine, but wow is it LOUD!
made me notice again how quietly the festool gear runs.

one friend insists on buying mid/low grade RO sanders for his work. he throws one out every year after it busts.
after a few years, he's way past he cost of buying a Festool, Mirka, or whatever brand tool that would have been better in the first place anyhow.
i explain this to him, but he's not interested (!!)
 
For 10 years or so, I got all the magazines and read almost every word in them.  I think if you hang out on other WW boards, there are those who tend to own Festool and European style machinery and those who swear that tweaked Harbor Freight is the best bang for the buck.  Most of us tend to fall somewhere in the middle.  I think reviewers are the same way.  Sandor Nagyszalancy was around back then and I recall not liking his reviews much.  I remember one of the FWW guys being pretty weak also.   On the other hand, there is Chris Schwarz, who doesn't bother with stuff he doesn't like.  But his good reviews can cause tools he does like to sell out.  Wood magazine was generally pretty good back then because they gave a lot of info regardless of what they picked.  The editors usually have some sort of hangup that makes them pick a certain thing, but I find their biggest point is often something I don't even care about.  I remember reading a mid-sized router review while I was waiting for my pre-order on the OF1400.  The review made no mention of dust collection at all.  I had chosen the Bosch 1617 kit a few years earlier specifically because of the excellent DC accessories.
If you are looking for a piece of WW equipment, the reviews are just a data point.  There is usually some decent info contained in them.
As far as 1/4 sheet palm sanders go, they are and occasional use tool to me.  Even when both my 1/4 sheet and ROS were low end PC brand, I rarely used the 1/4 sheet.  Thus why I don't have a Festool version.  The ROS is just a better solution for most things.  Maybe that was Sandor's point for not spending the big bucks on a palm sander ... or maybe not.
 
Do they still make magazines?

All that printed rubbish is a waste of good wood!  [wink]

 
Cost is about the only thing people can find to  piss and moan about, when they are comparing other tools to festool.

I learned long ago that I can't afford cheap tools.
 
WarnerConstCo. said:
Cost is about the only thing people can find to   and moan about, when they are comparing other tools to festool.

I learned long ago that I can't afford cheap tools.

Amen to that.
 
A client once told me " my greatest fear is I will pay ALMOST enough to get what I need."
When it comes to tools that statement is especially true!

Gerry
 
Bob Gerritsen said:
In any case, it's his loss. You'll think twice before taking his scribblings seriously again, right?

Right you are!  He does a good job of explaining features.  I think he needs to stick to that.
 
panelchat said:
reviews should really differentiate between the hobbyist/home owner market and the professional market.
there is a gray area between them, but that doesn't mean the issue should be ignored.
one had ought to be getting what one pays for, and if one does, they save money/time/fatigue in the long run with better purchases.

Well said!  I couldn't agree more.
 
The most helpful reviews I read are on forums like this and others. Even Amazon if you take the time to browse a reviewer's other reviews can be a good source of information.

At one time I had stacks of ww magazines, I subscribed to several including FWW, Woodsmith and Wood Magazine (from their first issue). I haven't bought one in years, in the internet era I don't know how they survive
 
TinyTiger said:
I remember about 10 years ago a certain Mr. Norm Abrams on the New Yankee Workshop used a biscuit joiner from Lamello, and everyone had to have one.  It was the best thing since sliced bread.  I also remember it was around $700 at the time for the pro model.  Isn’t $700 about 10 years ago just about the same as what we pay for a Domino today?  Strangely, I can’t remember one person complaining about the cost.  You paid it and smiled.

I think you are mixing up the facts to make the story support your position.  Yes Norm used a Lamello plate joiner.  One or two shows maybe.  But he didn't become biscuit crazy until Porter Cable produced their first plate joiner.  The original one with the D handle on back and the fixed fences.  He used that model on every show.  It was also about $150 new.  After Porter Cable opened up the market to low cost plate joiners, the sales exploded.  And DeWalt, Elu, Makita came out with their models similar in price to the Porter Cable.  No one ever got anywhere close to the Lamello in price.  Price drove the plate joiner sales.
 
Interesting coincidence.  I was in need of a small rectangular sander and I needed it fast.  So, I checked with my Festool dealer and he had an RTS 400 in stock to make sure I was covered.  Just to be fair I went and tried a Craftsman, and every single one that you can get at HD and Lowes.  And I tried them all. 

What a laugh.  The others were JUNK JUNK JUNK JUNK.  It's not that the RTS is a good sander,  THE RTS IS THE ONLY SANDER.  Really I don't know what those other things they call 1/4 sheet and 1/3 sheet sanders are but they aren't sanders.  I don't know, maybe you could give yourself a nice scalp massage.

Something's fishy about that reviewer.  Something's not on the up and up.

 
If cost is important , then he should count the medical costs of long term exposure to the nasty vibrations of those cheap tools.....(not to mention sawdust exposure!)
 
Reviews are fine but always do your own homework. Never can tell peoples biases, experience levels, or hidden agendas.
 
fshanno said:
Interesting coincidence.  I was in need of a small rectangular sander and I needed it fast.  So, I checked with my Festool dealer and he had an RTS 400 in stock to make sure I was covered.  Just to be fair I went and tried a Craftsman, and every single one that you can get at HD and Lowes.  And I tried them all.   

What a laugh.  The others were JUNK JUNK JUNK JUNK.  It's not that the RTS is a good sander,  THE RTS IS THE ONLY SANDER.  Really I don't know what those other things they call 1/4 sheet and 1/3 sheet sanders are but they aren't sanders.  I don't know, maybe you could give yourself a nice scalp massage.

Something's fishy about that reviewer.  Something's not on the up and up.

I think you gave a great example of a biased review.
 
Back
Top