I continue
ChatGPT is smart enough to pass a prestigious final exam, even if it's not with a high score.
The powerful AI-powered chatbot was recently legally tested in four programs at the University of Minnesota and another at the University of Pennsylvania's Wharton School of Business, faculty said.
To test how well ChatGPT generated responses to four control tests, University of Minnesota Law School professors recently recorded the tests blindly. After answering 95 multiple-choice and 12 essay questions, the robot performed averagely at the student's C+ level, scored low but passed in all four subjects.
ChatGPT did well on the Wharton Business Management course exam, receiving grades from a B to a B-. Describing performance in detail, Christian Terois, business professor at Wharton, said ChatGPT did a "great job" of answering basic process management and process analysis questions, but ran into more complex instructions and introduced "unexpected errors" in the underlying math.
"These errors can be grave," he wrote.
The test results come as more schools and educators raise concerns about ChatGPT's direct impact on students and their ability to cheat on assignments. Many teachers are currently actively revising their assignments in response to ChatGPT, although it remains unclear how widespread this tool is used by students and how detrimental it is to learning.
Since ChatGPT became available at the end of November, it has been used to generate original articles, stories, and lyrics in response to user requests. He published an abstract research paper that misled some scientists. Some executives even use it to write emails or do bookkeeping.
ChatGPT is trained on large amounts of online data to generate responses to user queries. While it has gained popularity among users, it has also raised a number of concerns, including the potential for continued inaccuracies, bias, and the spread of misinformation.
John Choi, a law professor at the University of Minnesota, told CNN that the aim of the trial is to explore the potential of ChatGPT to help lawyers with their practice and assist students with their exams, whether they are approved or not. Professor, because the questions are often similar to what lawyers write in real life.
"ChatGPT addresses the more classic elements of the law school exam, such as identifying potential legal problems and in-depth analysis of law enforcement on the facts of a case," says Choi. "But ChatGPT can be very useful for creating a first project that students can then improve on."
He argues that human-AI collaboration is the most promising use case for ChatGPT and similar technologies.
"I strongly believe that AI assistants will become a standard tool for lawyers in the near future, and law schools should prepare their students for such scenarios," he said. "It is clear that if law professors want to take an additional test of memorability of legal rules and doctrines, they will have to implement restrictions, such as blocking access to the Internet during exams, for this to work."
Similarly, Wharton's Tervish found that chatbots are "significantly better" at changing their response in response to human signals, such as paraphrasing a response after an error is indicated, demonstrating that humans can work with AI.
However, in the short term, there are still concerns about whether and how students should use ChatGPT. For example, public schools in New York and Seattle have banned students and teachers from using ChatGPT on local networks and devices.
Given ChatGPT's above-average test scores, Tervish told CNN that he agrees that restrictions should be placed on students when they take the test.
"Restrictions are necessary," he said. After all, when you hire a doctor, you want him to know medicine, not how to use a robot. The same goes for other skills certifications, including law and business.
But Tervish believes technology will eventually find its place in the classroom. He said: “If we continue to use the same learning system as before, we will miss out on the great opportunities that ChatGPT provides.
Create an account at CNN.com to get more CNN news and releases.
