Beautiful Virgin Islands

Sunday, Feb 25, 2024

Students Beat ChatGPT At This Exam, Score 76%, Compared To Chatbot's 47%

Students Beat ChatGPT At This Exam, Score 76%, Compared To Chatbot's 47%

Despite this, they said that ChatGPT's performance was "impressive" and that it was a "game changer that will change the way everyone teaches and learns - for the better."
Researchers found students to have fared better at accounting exams than ChatGPT, OpenAI's chatbot product.

Despite this, they said that ChatGPT's performance was "impressive" and that it was a "game changer that will change the way everyone teaches and learns - for the better."

The researchers from Brigham Young University (BYU), US, and 186 other universities wanted to know how OpenAI's technology would fare on accounting exams. They have published their findings in the journal Issues in Accounting Education.

In the researchers' accounting exam, students scored an overall average of 76.7 per cent, compared to ChatGPT's score of 47.4 per cent.

While in 11.3 per cent of the questions, ChatGPT was found to score higher than the student average, doing particularly well on accounting information systems (AIS) and auditing, the AI bot was found to perform worse on tax, financial, and managerial assessments. Researchers think this could possibly be because ChatGPT struggled with the mathematical processes required for the latter type.

The AI bot, which uses machine learning to generate natural language text, was further found to do better on true/false questions (68.7 per cent correct) and multiple-choice questions (59.5 per cent), but struggled with short-answer questions (between 28.7 and 39.1 per cent).

In general, the researchers said that higher-order questions were harder for ChatGPT to answer. In fact, sometimes ChatGPT was found to provide authoritative written descriptions for incorrect answers, or answer the same question different ways.

They also found that ChatGPT often provided explanations for its answers, even if they were incorrect. Other times, it went on to select the wrong multiple-choice answer, despite providing accurate descriptions.

Researchers importantly noted that ChatGPT sometimes made up facts. For example, when providing a reference, it generated a real-looking reference that was completely fabricated. The work and sometimes the authors did not even exist.

The bot was seen to also make nonsensical mathematical errors such as adding two numbers in a subtraction problem, or dividing numbers incorrectly.

Wanting to add to the intense ongoing debate about how how models like ChatGPT should factor into education, lead study author David Wood, a BYU professor of accounting, decided to recruit as many professors as possible to see how the AI fared against actual university accounting students.

His co-author recruiting pitch on social media exploded: 327 co-authors from 186 educational institutions in 14 countries participated in the research, contributing 25,181 classroom accounting exam questions.

They also recruited undergraduate BYU students to feed another 2,268 textbook test bank questions to ChatGPT. The questions covered AIS, auditing, financial accounting, managerial accounting and tax, and varied in difficulty and type (true/false, multiple choice, short answer).
Newsletter

Related Articles

Beautiful Virgin Islands
London's Iconic British Telecom Tower Sold To Become Hotel
I have a dream, MLK inspiring speech
Ukraine Arrests Father-Son Duo In Lockbit Cybercrime Bust
Aretha Franklin, Marvis Staples - Oh Happy Day
US Offers $15 Million For Info On Leaders Of Cybercrime Group Lockbit
BVI Freedom Song
Russia Claims UK Cultural Agency Spied for Ukraine
Billy Preston - You Can't Beat God Giving (Live)
Apple warns against drying iPhones with rice
VIRGIN ISLANDS REGGAE CARIBBEAN RIDDIMZ
Alexei Navalny: UK sanctions Russian prison chiefs after activist's death
Oh Happy Day Edwin Hawkins - Anthony Brown w FBCG Combined Choir
German economy is in 'troubled waters' - ministry
'Stand by Me' performed by Karen Gibson and The Kingdom Choir
In a recent High Court hearing, the U.S. argued that Julian Assange endangered lives by releasing classified information.
National Anthem of the British Virgin Islands - Oh, Beautiful Virgin
New video
Hello Dolly
Tucker Carlson says Boris Johnson wants "a million dollars, in Bitcoin or cash, from Tucker Carlson to talk about Ukraine.
for KING & COUNTRY - Amen (Reborn) [feat. Lecrae & The WRLDFMS Tony Wi
Russia is rebuilding capacity to destabilize European countries, new UK report warns
Bob Marley - Get Up Stand Up
EU Commission wants anti-drone defenses at Brussels HQ
Yes He Can
Von der Leyen’s 2nd-term pitch: More military might, less climate talk
What A Friend We Have In Jesus
Global Law Enforcement Dismantles Lockbit Ransomware Operation
Unforgettable
Prince William Urges End to Gaza Conflict
Touch The Hem Of His Garment
UK court to hear Assange's final appeal against extradition to the US, where he faces charges related to his journalistic work—the publication of a classified video in 2010 that exposed US war crimes against humanity.
The Lord's Prayer
About 50-60% kids either chose to be YouTuber or influencer
THE GOD MOVEMENT...BEAUTIFUL BVI
A viral video of Nationals MP Barnaby Joyce lying on a Canberra footpath is celebrated by his media mates.
Siyahamba
European Countries React to Navalny's Death by Summoning Russian Diplomats
Ray Charles And The Voices Of Jubilaton, Oh, Happy Day
Israel has gone ‘beyond self-defence’ in Gaza, says Labour’s Streeting
Ramblin' Rose
English farmers to be offered ‘largest ever’ grant scheme amid food security concerns
Protoje - Who Knows ft. Chronixx
Cameron government knew Post Office ditched Horizon IT investigation
Pressure - Virgin Islands Nice
EU Calls for Immediate Ceasefire in Gaza Conflict
Phil Wickham - House Of The Lord
EU Vows To Hold Putin "Accountable" After Meeting Alexei Navalny's Wife
My God Is Real (Yes, God Is Real)
EU Launches Probe Into TikTok Over Child Protection Under Digital Content Law
The Lion King Circle of Life by LEBO M. — LIVE at the HAVASI Symphonic
The EU Initiates Naval Mission to Defend Red Sea Trade Routes
Louis Armstrong - When The Saints Go Marching In
EU and UK Announce Joint Effort on Migration
Kanye West Sunday Service - hallelujah, salvation, and glory
Brazil's Lula Likens Gaza Operation to Holocaust, Israel Says "Red Line" Crossed
Jonathan Nelson - I Believe (Island Medley
Ministers Confirm Proposal to Prohibit Mobile Phone Usage in English Schools
From The Virgin Islands Sqad Up
Microsoft-backed OpenAI valued at $80bn after company completes deal
Common, John Legend - Glory
‘Alexei would want to tell Russia not to give up fighting’
Anthony Evans vs. Jesse Campbell - If I Ain't Got You
Rwandan Footballer's Dismissal Sparks Concerns Over UK Asylum Plan
I have a dream, MLK inspiring speech
Whisky Challenges China's Baijiu Market During New Year Celebrations
Aretha Franklin, Marvis Staples - Oh Happy Day
Avdiivka - Symbol Of Ukrainian Resistance Now In Control Of Russian Troops
BVI Freedom Song
Putin Critic Alexei Navalny's "Killers" Refusing To Hand Over Body, Say Allies
Billy Preston - You Can't Beat God Giving (Live)
"Historic Step": Zelensky Signs Security Pact With Germany
VIRGIN ISLANDS REGGAE CARIBBEAN RIDDIMZ
"Historic Step": Zelensky Signs Security Pact With Germany
Oh Happy Day Edwin Hawkins - Anthony Brown w FBCG Combined Choir
20 Tech Giants Sign Effort To Fight AI Election Interference Across Globe
'Stand by Me' performed by Karen Gibson and The Kingdom Choir
Joe Biden Accuses Putin of Causing Navalny's Death
National Anthem of the British Virgin Islands - Oh, Beautiful Virgin
Russian opposition leader Alexey Navalny has died at the Arctic prison colony
Hello Dolly
Tucker Carlson grocery shopping in Russia. This is so interesting.
for KING & COUNTRY - Amen (Reborn) [feat. Lecrae & The WRLDFMS Tony Wi
Julian Assange's Wife Warns of His Death if Extradited to US
Bob Marley - Get Up Stand Up
‘A lot higher than we expected’: Russian arms production worries Europe’s war planners
Yes He Can
Greece Legalizes Same-Sex Marriage and Adoption Rights
What A Friend We Have In Jesus
Hungarian Foreign Minister: Europeans will lose Europe, the Union's policy must change drastically
Unforgettable
In Britain Homeowners are receiving CPO’s (Compulsory Purchase Orders) so their homes can be redistributed to migrants
Touch The Hem Of His Garment
Microsoft says it caught hackers from China, Russia and Iran using its AI tools
The Lord's Prayer
Influencers Exploit X Platform for Profit Amidst Israel-Gaza Conflict
THE GOD MOVEMENT...BEAUTIFUL BVI
Former Dutch PM And Wife Die "Together Hand In Hand" Via Duo Euthanasia
Siyahamba
Media Giant Paramount Global, Which Owns CBS News, To Cut 800 Jobs
Ray Charles And The Voices Of Jubilaton, Oh, Happy Day
×