What drill analytics do you want?

Comments

• 8 Likes

  Landon_brough Live Member

  December 23 34 karma

  I would love to see similar data to what we have on exams, such as question type strengths and weaknesses by percent correct, and the ability to filter the results by time: i.e. last month, 3 months, week, or year.
• David Busis Member Moderator

  December 23 7405 karma

  Thanks @Landon_brough !
• 11 Likes

  matthew0280 Live Member

  December 23 46 karma

  I would like to have the LSAT Test Analytics updated to have the ability to incorporate data from drills. Right now it is only full PT's, but having the ability to see analytics from drills would be amazing.
• 4 Likes

  Baloch1996-1 Live Member

  December 23 80 karma

  I agree with Matthew. Not everyone takes full-length PTs. So it would be helpful if the drills analytics are included.
• 4 Likes

  lookingforanswers Core Member

  December 24 23 karma

  Would it be possible to have analytics on timing?

  I struggle a lot with timing, so I would love a way to know which questions types I should strategically skip on the first run based on how much time I spend on it, and still get it wrong.

  E.g. I tend to spend 50 seconds over target time on Match the Flaw questions, and still have a 10% accuracy. Maybe an average on over-target time for specific question types mentioned beside the accuracy, only on timed drills/PTs.
• 3 Likes

  shiva.shambayati Core Member

  December 24 edited December 24 2 karma

  Thank you for posing this question! I've thought about this a lot without really realizing it, so appreciate the opportunity to dump my thoughts out to a willing recipient! See a list of stats I would find relevant below

  1. Timing -- it would be beneficial to have a breakdown of how much time I tend to spend on different question types, potentially with a normalizer for difficulty level. This could come in the form of an average and a standard deviation (i.e. on average, you spend 1 min 20 seconds on LR Sufficient Assumption questions, but you spend 45 seconds, or 2 standard deviations, longer on the most difficult questions of this type). A metric of this sort would would give me a better sense of how to pace myself on PTs.

  2. Accuracy by Question Type -- I love my LR and RC Drills, and I would say I spend > 75% of my time on 7Sage engaging with this aspect of my membership. On the whole, I have likely answered 10x the number of questions in Drill mode than in PTs. This makes it all the more frustrating when I have no easily accessible stats for Drill questions, as I know that the supposed "trends" 7Sage provides are based on an entirely unrepresentative sample (my PTs). I would love if we could access a red-circle chart, similar to the one created based on PTs in "Analytics," for Drills (or, even better, Drills AND PTs together). One day, I would hope that the virtual tutor could tell you to focus on a specific question type based on your performance without prompting (as an aside: please make the role of the virtual tutor clearer on the Drills page, as it is currently a bit ambiguous).

  3. Section-Level Time Spent -- Somewhat along the same lines as (1), I would love a statistic telling you how much time you've spent answering drill questions for RC vs LR (more granular would be interesting, but I don't personally see access to more granular info impacting my studying much). I am sometimes conflicted about where to focus my studying on any given day, and I think a summary of my time spent (a) ever, (b) this month, and (c) this week could be a great way to show where I should be concentrating my efforts. This stat can also act as a motivator / indicator of progress for those of us who are more Drill inclined. It would be great if every time I logged in to practice, I was greeted with "XX hours spent on Drills!" or something of that ilk.
• missjurisdoc Live Member

  December 26 848 karma

  an option to attempt question again without the answer being in view for a full drill or single question;-just indication it's wrong and try again or reveal answer
• amcortes10 Core Member

  December 26 4 karma

  @Landon_brough said:
  I would love to see similar data to what we have on exams, such as question type strengths and weaknesses by percent correct, and the ability to filter the results by time: i.e. last month, 3 months, week, or year.

  This is the most important factor for me. I am someone who has done a majority of their studying using drills and this would be a big help.
• zbultman99 Member

  December 28 2 karma

  This is maybe a little out of left field, but an analytic leveraging PCA (principle component analysis) to bucket 7sage users and then suggest drills based on classification seems like conceptually it could really helpful in identifying what to spend time on to study most effectively. Basically, if you're able to group students using the super-rich datasets you've got, and then compare PT improvement for students within those groups based on different drill histories it could help identify what drilling techniques work best for each student's "type" -- it seems like peoples' difficulties in some ways fall into categories, and this could be a cool way to leverage the data of other students in your archetype.
• Jaz Williams Live Member

  December 28 9 karma

  This isn't an analytic but it would be helpful to be able to drill one LR question at a time, and immediately review, instead of the minimum of five.
• David Busis Member Moderator

  December 28 7405 karma

  @"Jaz Williams" we have that feature on our new website, still in beta. Let me know in these comments if you’d like to be a beta tester.
• sheanatnat Core Member

  December 28 3 karma

  this is pertaining to PT's. There should be an option to blind review directly after a section & to review the answers rather than having to take the whole test before being able to review. Some days i am not able to take the full test in one sitting so when I go back to review the questions i got wrong I have already forgotten my reasoning for that question.