You've heard of AI models taking the bar exam,UK but this time, AI also helped write the questions.
The State Bar of California revealed on Monday that it used AI to develop a portion of its exam questions, according to the LA Times. The AI-generated exam questions were created by an independent psychometrician called ACS Ventures hired by the State Bar. The questions were "developed with the assistance of AI and subsequently reviewed by content validation panels and a subject matter expert in advance of the exam," announced the State Bar in a statement addressing technical glitches and question errors that test takers had previously complained about.
TheLA Timesreported that 23 out of the 171 multiple choice questions were made by ACS Ventures. The majority of the multiple choice questions were developed by Kaplan, and a "small subset" were taken from the First-Year Law Students' Exam. This past year, the bar was offered remotely to California-based test takers. Students and educators alike were already outraged about the remote test platform crashing and being riddled with bugs. But now, the discovery that some of the exam questions were created with AI has further fueled that outrage.
"I'm almost speechless. Having the questions drafted by non-lawyers using artificial intelligence is just unbelievable," Mary Basick, assistant dean of academic skills at UC Irvine School of Law told the Times. "It's a staggering admission," Katie Moran, an associate professor at the University of San Francisco School of Law told the outlet.
Moran also pointed out the fact that ACS Ventures, the firm used to craft the AI questions, was the same firm to approve the questions.
Alex Chan, who chairs the State Bar's Committee of Bar Examiners, told the outlet that the California Supreme Court had pressured the State Bar to look into "new technologies, such as artificial intelligence" as a means of improving reliability or cost-efficiency.
Automating tasks with AI has surged since the rise of generative AI — and not just simple tasks or low-stakes work, but critical work that has very real consequences. Some suspect that the formula used to calculate the Trump Administration's tariff rates was created by ChatGPT or something similar. In 2023, two New York lawyers were sanctioned for using ChatGPT in a legal brief, which cited fake cases. And academic journals are flooded with papers that include AI-generated text.
And those are just a few examples of the ones that got caught. Generative AI's ability to rapidly write, summarize, and source information has been an irresistible way for workers to save time and effort. But it has innate hallucination problems and poses ethical issues by outsourcing work to a bot — especially when it comes to law students whose entire career rests on passing the bar.
Topics Artificial Intelligence
Huawei sues Verizon for allegedly using patents without permissionAustralian authorities used phone location tracking to retrace steps of couple with coronavirusEricsson pulls out of MWC due to 'health and safety' concerns from coronavirus'Kidding' Season 2 cements its place as TV's most brilliant comedyThe best and worst moments of the 2020 OscarsMac Pro with 1.5TB of RAM tackles Google Chrome and its insatiable lust for memoryDon't look down: These slacklining photos will give you fullOlivia Colman's Oscars speech deserved an award of its own'Hair Love' director Matthew Cherry tweeted about winning the Oscars 8 years agoWelp, it looks like Antarctica broke its temperature recordHow much is a Lyft worth? Now, about $7 billionNatalie Portman's Oscars outfit recognized snubbed female directorsHillary Clinton's nephew will be a model not a politician because he's super hotPepsi, I wrote your next great commercial for you for freeAustralian authorities used phone location tracking to retrace steps of couple with coronavirusA girl snuck a horse into her parent's bathroom for some selfies, of course'Slings & Arrows' is the best show you can binge in a weekendAustralian authorities used phone location tracking to retrace steps of couple with coronavirusDon't look down: These slacklining photos will give you fullReport claims U.S. government is using cellphone location data to track undocumented immigrants In defense of being a Boyfriend Girl online See every major platform's misinformation policies in this handy chart Jerry Seinfeld hugs it out ... in front of a mural of his failed Kesha hug Joe Scarborough announces millennials' latest victim: the military Just like you, Jason Momoa got totally pumped about that 'Game of Thrones' battle New NYC commuter themed Dad's genius Zoom Halloween costume for his daughter is scary good Everything coming to HBO Max in November 2020 'Fast and Furious' franchise will cross the finish line with 11th film Massive alligator walks right up to a family's front door to say hello Lucasfilm's 'Willow' is set for a Disney+ series with Warwick Davis Florida man discovers huge snake has been living in his attic for years Robert Pattinson's quest for a NYC hot dog is pure art Tom Holland responds to ridiculous meme about a frog hiding in his mouth Disney Channel features interracial lesbian couple and other networks should catch up already Bill Murray saw 'Groundhog Day' on Broadway last night and was extremely Bill Murray The deepfake apocalypse never came. But cheapfakes are everywhere. Drake was also not happy Chris Brown commented on Rihanna's Insta Halloween is a great time to explore wild kinks and BDSM role A few ways Walmart could spend $18 million instead of corporate propaganda