What is the way to assess whether you have created a 'good' question (quizfactory), should it be original, tough,theoretical etc

Answer 1

SoloLearn and the quiz mods handle the assessment part. One of the major reasons for submitted quizzes to be declined would be that there are "too many similar quizzes". So common sense tells that it would be a positive to not add to the saturation of certain categories/types. I reckon good quizzes should also be of moderate (?) difficulty, not weighing too much of a test on handtracing nor maths, but rather somewhere in between. These are just my opinion though.

Answer 2

Maybe try Rate Submissions (because, by evaluating existing content you can generate for yourself what you think of as "good" or "needs something")

E.g., I just rated this one:

Fill in the blanks to select the 2th element:

purchase={"Andrea":2, "Martin":1, "Sarah":5}
print(purchase["_____"])

Concerns:
~ Until recently, Python dicts were unordered (element position not guaranteed)
~ There are 3 elements, so...2nd element might be "Martin" (maybe "Andrea")
~ Answer is actually "sarah" (trivial: "s" != "S" but case-insensitivity might be the quiz system)
The author probably meant "5th" by "2th" but even with that 'fix' it may need some clarification.

This was randomly given to me / I don't want the author to think I'm saying it's an example of "bad"; it's just one that needs work...and when you look at how you'd update/fix those...see my opening sentence.

Answer 3

This seems relevant:

https://www.sololearn.com/Discuss/470195/?ref=app

Right or wrong, this is how I rate submissions:

1) Even if it had the potential to be a good question, I automatically hit "Dislike" on anything with a typo, spelling error, or grammatical error since I have no ability to edit/correct it before it passes into the challenge pool -- especially if it makes the meaning of the question unclear. There is no reason to add confusion to learning and it's even worse when the question passes through to the Challenge pool because it then affects users' challenge records (or are at least distracting, even if you can push through the awkwardness and divine the correct answer). I don't believe that the challenge section should be testing users' ability to guess what other users are trying to say.

2) If it takes me too long to understand the question, I can only imagine how hard it would be for non-native English speakers (readers). I hit "Dislike" on these, since challenges are timed.

[tbc...]

Answer 4

[...cfb]

3) Similar thoughts to what Hatsy said about difficulty. If it's a nuanced fact but quick to understand, that's okay. If it's too elaborate (especially the math), then I would prefer we test for the problem-solving aspect of programming ability over rapid math ability.

4) If the right answer isn't accepted or isn't an available option.

As far as whether or not a question is considered "good" even after it has been circulating the challenge pool for awhile, I would simply say that it gives me the feeling that when someone comes across this question, they are learning something or know something useful and possibly important. (For example, the well-phrased question about <noscript> in the HTML section.)

I hope this helps! 😊