If you are taking a multiple choice test, there is an art to them.
1) If you have two answers that are opposites, usually one of those in the answer.
2) The longest answer is mostly likely the correct one, especially if it is exceeding longer than the other ones. Remember, people have to make up wrong answers, so they tend to keep them short.
3) When in total doubt, "C."
4) If two answers are correct and you have "all of the above" that is the one you choose.
5) If it is NRRPT and "Compton's Scattering is a choice, that is most likely the answer (they love CS).
6) Responses that use absolute words, such as "always" or "never" are less likely to be correct than ones that use conditional words like "usually" or "probably."
7)"Funny" responses are usually wrong.
Look for grammatical clues. If the stem ends with the indefinite article "an," for example, then the correct response probably begins with a vowel.
9) Look for verbal associations. A response that repeats key words that are in the stem is likely to be correct.
i.e Who is responsible for the electrical maintenance?
a) electrician b) mechanic c. rad con, d) QA
As a (former) Instructional Technologist I can unequivocally state that some of those recommendations are (or were) dead-on correct... and some are not.
1.) It depends on how the opposites are worded. For instance if the first says "x = y" and the other says "x<>y" then one of them has to be correct, so if one is not the correct answer, there are likely two correct answers which should invalidate the question. However, even in this case if x and y are not relevant to the question asked, then all bets are off.
2.) This would likely be true if test developers were really lazy or stupid. Some are, but in the nuclear world, most are not. On top of that, the tests are reviewed question by question by at least two others before approval, so you would need several lazy idiots for this to hold. I am not saying this situation does not exist in Nuclear Training Programs, just that it is rare. Outside of SAT programs, this technique holds true.
3.) This will work about 20% to 25% of the time, depending on whether there are four or five choices.
4.) This is among the most reliable, but not 100% guaranteed. It depends on what the definition of 'right' is (thank you Mr. Clinton.) If you are absolutely sure that two answers are correct
to an equal degree you can be sure you won't get this one wrong if you answer 'All of the above' because if there are two equally correct answers, the question is invalid. Remember, though that the instructions will usually have a statement like 'Choose
the most correct answer' or 'the choice that
best answers the question' which gives wiggle room. Good arguments can invalidate questions that have two answers that can be shown to be equally correct, but in most cases the distractors have already been tested for this.
5.) I don't remember that being the case in my version of the test, but I can't argue this point.
6.) Spot on. But remember the 'less likely' part of this recommendation-- it is not guaranteed. If you have no clue, this can actually help. Also remember that good test writers know this, too.
7.) Also true. Most test writers can't resist a good play on words... however, there is little room for humor in most accredited programs, so you probably won't see this much anymore.
8.) This works in most sloppily written tests. I doubt you will find this in a test in an accredited program, either.
9.) This falls into the same category as #8.
I have actually taught classes to instructors that covered all of these subjects, to improve test development skills. As a matter of fact, it was part of the Initial Instructor Training, and then used again in Continuing Training when testing skills sagged a bit. Outside of the SAT based training world, these have all been valid recommendations, at least in the past, and some are still valid today. If an instructor handed me a test with any of this on it for my review (and I reviewed a lot of tests) I would hand it back for correction... because training professionals look for them.
Believe it or not these 'rules' used to be quite accurate until better development skills were taught. I used many of them to cruise through High School -- which may account for namlive's 150 IQ rating. I am sure mine was raised a bit by the same knowledge. I even found out it works in Spanish. I took the Spanish Achievement Test for placement in college and scored 750 out of 800, so they placed me in a third year level class -- they could have been speaking Greek, Italian or Swahili for all I knew. I could understand about 10% of what they were saying if they spoke slowly enough. Big time backfire on me.
