I would love to see similar data to what we have on exams, such as question type strengths and weaknesses by percent correct, and the ability to filter the results by time: i.e. last month, 3 months, week, or year.
I would like to have the LSAT Test Analytics updated to have the ability to incorporate data from drills. Right now it is only full PT's, but having the ability to see analytics from drills would be amazing.
I struggle a lot with timing, so I would love a way to know which questions types I should strategically skip on the first run based on how much time I spend on it, and still get it wrong.
E.g. I tend to spend 50 seconds over target time on Match the Flaw questions, and still have a 10% accuracy. Maybe an average on over-target time for specific question types mentioned beside the accuracy, only on timed drills/PTs.
Thank you for posing this question! I've thought about this a lot without really realizing it, so appreciate the opportunity to dump my thoughts out to a willing recipient! See a list of stats I would find relevant below
Timing -- it would be beneficial to have a breakdown of how much time I tend to spend on different question types, potentially with a normalizer for difficulty level. This could come in the form of an average and a standard deviation (i.e. on average, you spend 1 min 20 seconds on LR Sufficient Assumption questions, but you spend 45 seconds, or 2 standard deviations, longer on the most difficult questions of this type). A metric of this sort would would give me a better sense of how to pace myself on PTs.
Accuracy by Question Type -- I love my LR and RC Drills, and I would say I spend > 75% of my time on 7Sage engaging with this aspect of my membership. On the whole, I have likely answered 10x the number of questions in Drill mode than in PTs. This makes it all the more frustrating when I have no easily accessible stats for Drill questions, as I know that the supposed "trends" 7Sage provides are based on an entirely unrepresentative sample (my PTs). I would love if we could access a red-circle chart, similar to the one created based on PTs in "Analytics," for Drills (or, even better, Drills AND PTs together). One day, I would hope that the virtual tutor could tell you to focus on a specific question type based on your performance without prompting (as an aside: please make the role of the virtual tutor clearer on the Drills page, as it is currently a bit ambiguous).
Section-Level Time Spent -- Somewhat along the same lines as (1), I would love a statistic telling you how much time you've spent answering drill questions for RC vs LR (more granular would be interesting, but I don't personally see access to more granular info impacting my studying much). I am sometimes conflicted about where to focus my studying on any given day, and I think a summary of my time spent (a) ever, (b) this month, and (c) this week could be a great way to show where I should be concentrating my efforts. This stat can also act as a motivator / indicator of progress for those of us who are more Drill inclined. It would be great if every time I logged in to practice, I was greeted with "XX hours spent on Drills!" or something of that ilk.
Comments
I would love to see similar data to what we have on exams, such as question type strengths and weaknesses by percent correct, and the ability to filter the results by time: i.e. last month, 3 months, week, or year.
Thanks @Landon_brough !
I would like to have the LSAT Test Analytics updated to have the ability to incorporate data from drills. Right now it is only full PT's, but having the ability to see analytics from drills would be amazing.
I agree with Matthew. Not everyone takes full-length PTs. So it would be helpful if the drills analytics are included.
Would it be possible to have analytics on timing?
I struggle a lot with timing, so I would love a way to know which questions types I should strategically skip on the first run based on how much time I spend on it, and still get it wrong.
E.g. I tend to spend 50 seconds over target time on Match the Flaw questions, and still have a 10% accuracy. Maybe an average on over-target time for specific question types mentioned beside the accuracy, only on timed drills/PTs.
Thank you for posing this question! I've thought about this a lot without really realizing it, so appreciate the opportunity to dump my thoughts out to a willing recipient! See a list of stats I would find relevant below
Timing -- it would be beneficial to have a breakdown of how much time I tend to spend on different question types, potentially with a normalizer for difficulty level. This could come in the form of an average and a standard deviation (i.e. on average, you spend 1 min 20 seconds on LR Sufficient Assumption questions, but you spend 45 seconds, or 2 standard deviations, longer on the most difficult questions of this type). A metric of this sort would would give me a better sense of how to pace myself on PTs.
Accuracy by Question Type -- I love my LR and RC Drills, and I would say I spend > 75% of my time on 7Sage engaging with this aspect of my membership. On the whole, I have likely answered 10x the number of questions in Drill mode than in PTs. This makes it all the more frustrating when I have no easily accessible stats for Drill questions, as I know that the supposed "trends" 7Sage provides are based on an entirely unrepresentative sample (my PTs). I would love if we could access a red-circle chart, similar to the one created based on PTs in "Analytics," for Drills (or, even better, Drills AND PTs together). One day, I would hope that the virtual tutor could tell you to focus on a specific question type based on your performance without prompting (as an aside: please make the role of the virtual tutor clearer on the Drills page, as it is currently a bit ambiguous).
Section-Level Time Spent -- Somewhat along the same lines as (1), I would love a statistic telling you how much time you've spent answering drill questions for RC vs LR (more granular would be interesting, but I don't personally see access to more granular info impacting my studying much). I am sometimes conflicted about where to focus my studying on any given day, and I think a summary of my time spent (a) ever, (b) this month, and (c) this week could be a great way to show where I should be concentrating my efforts. This stat can also act as a motivator / indicator of progress for those of us who are more Drill inclined. It would be great if every time I logged in to practice, I was greeted with "XX hours spent on Drills!" or something of that ilk.