Beautiful Virgin Islands


Students Beat ChatGPT At This Exam, Score 76%, Compared To Chatbot's 47%

Students Beat ChatGPT At This Exam, Score 76%, Compared To Chatbot's 47%

Despite this, they said that ChatGPT's performance was "impressive" and that it was a "game changer that will change the way everyone teaches and learns - for the better."
Researchers found students to have fared better at accounting exams than ChatGPT, OpenAI's chatbot product.

Despite this, they said that ChatGPT's performance was "impressive" and that it was a "game changer that will change the way everyone teaches and learns - for the better."

The researchers from Brigham Young University (BYU), US, and 186 other universities wanted to know how OpenAI's technology would fare on accounting exams. They have published their findings in the journal Issues in Accounting Education.

In the researchers' accounting exam, students scored an overall average of 76.7 per cent, compared to ChatGPT's score of 47.4 per cent.

While in 11.3 per cent of the questions, ChatGPT was found to score higher than the student average, doing particularly well on accounting information systems (AIS) and auditing, the AI bot was found to perform worse on tax, financial, and managerial assessments. Researchers think this could possibly be because ChatGPT struggled with the mathematical processes required for the latter type.

The AI bot, which uses machine learning to generate natural language text, was further found to do better on true/false questions (68.7 per cent correct) and multiple-choice questions (59.5 per cent), but struggled with short-answer questions (between 28.7 and 39.1 per cent).

In general, the researchers said that higher-order questions were harder for ChatGPT to answer. In fact, sometimes ChatGPT was found to provide authoritative written descriptions for incorrect answers, or answer the same question different ways.

They also found that ChatGPT often provided explanations for its answers, even if they were incorrect. Other times, it went on to select the wrong multiple-choice answer, despite providing accurate descriptions.

Researchers importantly noted that ChatGPT sometimes made up facts. For example, when providing a reference, it generated a real-looking reference that was completely fabricated. The work and sometimes the authors did not even exist.

The bot was seen to also make nonsensical mathematical errors such as adding two numbers in a subtraction problem, or dividing numbers incorrectly.

Wanting to add to the intense ongoing debate about how how models like ChatGPT should factor into education, lead study author David Wood, a BYU professor of accounting, decided to recruit as many professors as possible to see how the AI fared against actual university accounting students.

His co-author recruiting pitch on social media exploded: 327 co-authors from 186 educational institutions in 14 countries participated in the research, contributing 25,181 classroom accounting exam questions.

They also recruited undergraduate BYU students to feed another 2,268 textbook test bank questions to ChatGPT. The questions covered AIS, auditing, financial accounting, managerial accounting and tax, and varied in difficulty and type (true/false, multiple choice, short answer).
Newsletter

Related Articles

Beautiful Virgin Islands
0:00
0:00
Close
Bodyguard of UK Prime Minister Arrested for Alleged Election Betting
I have a dream, MLK inspiring speech
Global Displacement Crisis: Record Numbers in 2023
Aretha Franklin, Marvis Staples - Oh Happy Day
Muslim Community Leader Criticizes Nigel Farage for Undermining Muslims
BVI Freedom Song
Melinda Gates Discusses 'Horrible' Divorce from Bill Gates
Billy Preston - You Can't Beat God Giving (Live)
Child Obesity Surge in England: A Deep Concern
VIRGIN ISLANDS REGGAE CARIBBEAN RIDDIMZ
U.S. Sues Adobe Over Hard-to-Cancel Subscriptions
Oh Happy Day Edwin Hawkins - Anthony Brown w FBCG Combined Choir
Deadly Heat Wave Claims Dozens of Lives During Hajj Pilgrimage in Mecca
'Stand by Me' performed by Karen Gibson and The Kingdom Choir
Here are today's top worldwide stories you don’t want to miss:.
National Anthem of the British Virgin Islands - Oh, Beautiful Virgin
World’s Largest Pilot Union Calls to Eliminate Terms Like ‘Cockpit’ and ‘Manpower’ for Equity
Hello Dolly
Woman Suing UK Intel Services Denies China Spy Allegations
for KING & COUNTRY - Amen (Reborn) [feat. Lecrae & The WRLDFMS Tony Wi
Iran Sentences Nobel Laureate Narges Mohammadi to 1-Year Prison Term for Propaganda
Bob Marley - Get Up Stand Up
News roundup
Yes He Can
Good day, everyone! We've got some gripping stories for you today, spanning from the Middle East to Europe, and even a touch of Hollywood.
What A Friend We Have In Jesus
Britain’s Refugee Visa Rules Stranding Children in War Zones
Unforgettable
UK Elections Predict ‘Electoral Extinction’ for PM Sunak’s Conservative Party
Touch The Hem Of His Garment
Italian Activist Ilaria Salis Returns Home After Election to European Parliament
The Lord's Prayer
Good morning!
THE GOD MOVEMENT...BEAUTIFUL BVI
England Faces Serbia in Euro Opener with Defensive Concerns
Siyahamba
Dermatologist Warns Against Sunbed Usage
Ray Charles And The Voices Of Jubilaton, Oh, Happy Day
Fake Pro-Reform UK Social Accounts and Their Influence on Elections
Ramblin' Rose
UK Man Jailed for Non-Consensual Condom Removal
Protoje - Who Knows ft. Chronixx
Reform UK Surpasses Conservatives in Historic Poll
Pressure - Virgin Islands Nice
US, Britain, Canada Accuse Russia of Interference in Moldova’s Election
Phil Wickham - House Of The Lord
Taylor Swift Fans Create Seismic Activity in Edinburgh
My God Is Real (Yes, God Is Real)
Sunak Aide Under Investigation for Election Bet
The Lion King Circle of Life by LEBO M. — LIVE at the HAVASI Symphonic
Labour Leader Starmer Focuses on Wealth Creation for Upcoming UK Elections
Louis Armstrong - When The Saints Go Marching In
G7 to Use Frozen Russian Assets for $50 Billion Ukraine Aid
Kanye West Sunday Service - hallelujah, salvation, and glory
Anti-Israel Irish MEP Clare Daly LOST her seat in the EU Election
Jonathan Nelson - I Believe (Island Medley
Johnson & Johnson Settles Talc Safety Claims for $700 Million
From The Virgin Islands Sqad Up
EU Urged to Welcome Skilled Russians to Weaken Putin
Common, John Legend - Glory
EU Elections Overview: Far-Right Gains and Major Political Shifts
Anthony Evans vs. Jesse Campbell - If I Ain't Got You
Israel Rescues Four Hostages from Gaza
I have a dream, MLK inspiring speech
Emmanuel Macron Calls for Snap Election
Aretha Franklin, Marvis Staples - Oh Happy Day
Jordan Bardella: Young Far-Right Leader Poised for Future Political Influence in France
BVI Freedom Song
World's Oldest Privately Owned Book Auctioned for $3.8 Million
Billy Preston - You Can't Beat God Giving (Live)
Animal Rights Activists Deface King Charles' Portrait in Protest
VIRGIN ISLANDS REGGAE CARIBBEAN RIDDIMZ
Dutch Military Intel Uncovers Extensive Chinese Cyber Espionage
Oh Happy Day Edwin Hawkins - Anthony Brown w FBCG Combined Choir
Turkish Student Arrested for Using AI to Cheat in University Exam
'Stand by Me' performed by Karen Gibson and The Kingdom Choir
Rise in Dengue and Other Mosquito-Borne Diseases in Europe Due to Climate Change
National Anthem of the British Virgin Islands - Oh, Beautiful Virgin
EU Elections Overview: Far-Right Gains and Major Political Shifts
Hello Dolly
Far-Right National Rally Dominates France's EU Vote
for KING & COUNTRY - Amen (Reborn) [feat. Lecrae & The WRLDFMS Tony Wi
Macron Calls Snap Legislative Elections After Far-Right Victory
Bob Marley - Get Up Stand Up
Far-Right Gains Significantly in EU Election
Yes He Can
UK Job Market Shows Signs of Recovery
What A Friend We Have In Jesus
Orban’s Fidesz Party Wins Majority in Hungary’s EU Elections as New Challenger Emerges
Unforgettable
Meloni's Far-Right Party Wins European Elections in Italy
Touch The Hem Of His Garment
Key Insights from the European Union Elections
The Lord's Prayer
European Union Elections and Rise of Far-Right Parties
THE GOD MOVEMENT...BEAUTIFUL BVI
England Loses Over 260,000 Social Rent Homes in a Decade
Siyahamba
Campaigners Urge Government to Block Shein's FTSE Listing
Ray Charles And The Voices Of Jubilaton, Oh, Happy Day
×