ChatGPT Passes Ivy Schools Exams

|

, ,

In to-days headlines on technology is about ChatGPT, a chatbot launched by OpenAI, passing three prestigious ivy schools graduate-level exams. According to CNN, the bot AI passed three law schools exams in four courses at the University of Minnesota and another exams at University of Pennsylvania’s Wharton School of Business.

Jon Choi, one of the University of Minnesota law School professors, who had conducted the law course exams, has published his findings in this paper.

In an interview with CNN, Jon Choi told:

  • He recently graded the tests blindly after completing 95 multiple choice questions and 12 essay questions, the bot performed on average at the level of a C+ student, achieving a low but passing grade in all four courses
  • The goal of the tests was to explore ChatGPT’s potential to assist lawyers in their practice and to help students in exams, whether or not it’s permitted by their professors, because the questions often mimic the writing lawyers do in real life.
  • ChatGPT struggled with the most classic components of law school exams, such as spotting potential legal issues and deep analysis applying legal rules to the facts of a case. But ChatGPT could be very helpful at producing a first draft that a student could then refine.
  • My strong hunch is that AI assistants will become standard tools for lawyers in the near future, and law schools should prepare their students for that eventuality. Of course, if law professors want to continue to test simple recall of legal rules and doctrines, they’ll need to put restrictions in place like banning the internet during exams to enforce that.

And finally, CNN’s opinion piece contributor and a college professor at Arizona State University Peter Bergen writes has published OpEd for CNN written by the chatGPT bot.