Judging Criteria

[Brice Burrell]

 David, at this point we don't have enough quality projects to have different themes. This is a very informal contest, coming up with a list a "musts" that we all agree on (after the contest has already started) is going to be a challenge. If the rules and judging criteria had been set in store before we started by Matthew, things would be, well set. The down side is we wouldn't have been able to see how things work out and make changes as we go.

 There is a factor that most people are overlooking about this contest, we all know this is an opportunity for Festool to promote the new tools. The overlooked part is its also a chance for this site to do something with this contest. This is why I think the focus should be on the quality of the project threads. That way the excitement level of the project section will be raised, that in turn will generate interest in the site as a whole. If that encourages members write their first post or new members to join, then the contest is a real success. Not to mention that with quality thread we all win from enjoyment we get and from what we can learn from them. I don't think we would be leveraging all that we can from this contest if we don't focus on improving the quality of the threads and that's makes a better site. And thats what I have to say about that.

 As for scoring, I don't like the idea. I'd like to pick my favorite project thread and give a detailed explanation why I picked it. The judges could choose a top five, then rate the projects, giving the favorite 5 points, then the next, 4 and so on. Then the project with the most points is the month's winner. This way projects never have a score assigned to it, that way we won't have problem in the next month with scores already being assigned. We can rotate some or all of the judges each month to have some diversity in project winners. What do you think?

 

[Matthew Schenker]

Brice,
You make some excellent statements about the contests!  I definitely agree that the contests should be a way to enhance the posts and increase excitement on the forum, or as you put it, to "leverage all that we can from the contest."  That's precisely what I had in mind when I proposed this idea!

Regarding scoring: I will leave it up to each judge to...um..judge how to judge.  But seriously, as I look over all the great projects I am also shying away from a strict point system and instead opting for just a good explanation of which project to choose.  But if one of the judges wants to use an individual point system, and can explain it well, go for it.  In the end, having five different judges each using their own judgment will work out, I'm sure.

Regarding criteria: because we have rolling deadlines, there is no problem with the criteria changing and evolving as we move ahead.  If certain projects don't make it in this month, they are included next month, and so on.

Matthew

 

[Daviddubya]

...What do you think?

Hmmm.  Having spent most of my working career in management roles in Corporate America, I had many opportunities to "judge" candidates for a variety projects.  The must/want/scoring system I suggested comes from those experiences.  "Musts" are typically simple - like a contest entry must be posted in a thread or photo gallery on FOG.  "Wants" allow a potentially complex set of judging criteria to be broken down into a list of individually simple measurements, and then a score given to each contest entry in each of the judging criteria.  Using a scoring system ensures each contest entry gets a fair assessment on each of many measurement points.  Scoring minimizes unequal weighting of the same factor from entry to entry.  An even more effective scoring system uses weighted scores - like craftsmanship is more important than material choice.  The weight (say 1-10) is multiplied by the score (another 1-10) to yield a weighted score for each "want" or judging criteria.  The scores are added to determine the winner.  Each judge can create their own criteria and can score them their own way.  Having used this measurement system many times to make decisions involving choices, I can attest to the fact that it works very well.

 

[Bill Wyko]

IMHO the contest should open only to FOG supporters. Whith a prize like this that's the least we should do for FOG.

 

[Frank Pellow]

IMHO the contest should open only to FOG supporters. Whith a prize like this that's the least we should do for FOG.

I completely disagree with you Bill.  The fact that someone has donated to FOG should not make any difference at all to the way that they are treated on this forum.

Besides, because we have the option of donating as anonymous, no one but Matthew knows whether or not a person is a FOG supporter.

 

[Bill Wyko]

I was only suggesting this because it helps fund the site. On Saw Mill Creek if you donate 6 dollars you are allowed to use other features of the site. I don't know if this site is reliant on donations but if it is, I think it would help fund FOG and the contests. I'm not saying to sell the farm, just a way to generate revenue. I oppologize if I offended anyone.

 

[dirtydeeds]

i hope that my current judging criteria does not break all the rules (too badly)

im a limey  8)    ...................  stuff the rules  ;D

 

[Bill Wyko]

I was just curious, will there ever be a month when just pictures of the finished piece with a detailed write up will judged? (I think that's the only way my big Humidor has a chance )I was looking at the pieces in the contest on the deltaportercable website and noticed that one of the finalists is a SMC member. Beautiful table he built too.

 

[Matthew Schenker]

I was just curious, will there ever be a month when just pictures of the finished piece with a detailed write up will judged? (I think that's the only way my big Humidor has a chance )I was looking at the pieces in the contest on the deltaportercable website and noticed that one of the finalists is a SMC member. Beautiful table he built too.

Sorry for the delay in responding (been tending to lots of other matters lately).  Do you mean, will there be contests in which there does not need to be a process description?  My answer would be, that's up to the judges, or to the members.  Remember, the contests are meant to highlight great projects, as decided by the community.  We have judging criteria, but I would like that to be guidelines rather than strict rules.  There has to be room for interpretation!

So, the answer (if I got your question right) is "yes," if the project is chosen by the community.

Does that make sense?

Stay in touch,
Matthew