A new step I added while doing LR Blind Review

TheDeterminedC

For those of us 7sagers that have done countless PT's and drilling packets, I think it would be safe to say that we all can round about guess what difficulty a question would be---from 1-5 (how it is shown in the analytics). Because of this, I recently started guessing, on each blind review question I did, what the question difficulty might be. I have really found this to be a valuable tool to see what exactly my confidence is in a particular question compared to the community's results in the analytics. At least for myself, I found that my own perception and biases of how difficult the question was tends to skew the 1-5 difficulty guess. Where the questions I got right and I am confident in are usually lower then the actual analytic difficulty. On the other hand, on the questions I got wrong, my guess tends to be even or of a higher difficulty then the actual analytic difficulty. The most helpful part of this process is finding out the questions I got right both in timed and in BR, but I still rated the question higher then the analytics. These questions are ones that would slip though the cracks as the analytics are unable to capture this.

Using the 1-5 metric difficulty guess has started exposing question types that, although I got it right both times, I need to work on more to drop my perceived difficulty. It shows were I am quick and confident, but it also shows where I am lacking this.

I am not sure if this would be useful at all for anyone, but I wanted to share a little something to the community that I learn a lot from. Thank you!

P.S. - I do know there is a 'circle the question' confidence method, but I redo every question in blind review over again so this didn't work for me.

Cant Get Right

That's interesting. It's very important to identify under confidence issues, and this trend of overestimating difficulty on questions where we're under confident is likely a pretty close correlation. I like it!