PanamaTimes

Monday, May 20, 2024

ChatGPT: Can students pass using AI tools at university?

ChatGPT: Can students pass using AI tools at university?

As exam season gets under way, students might be tempted to turn to new artificial intelligence (AI) tools to give them the edge in assessments.

Universities have been scrabbling to understand what AI applications such as ChatGPT are capable of and introduce guidance on how they can be used - and now, they're being urged to teach students how to use them.

Academics at the University of Bath have been considering the challenges and opportunities.

"Our first question was, 'Could this be used by students to answer our assessment questions?'" James Fern says of ChatGPT - an online tool that can answer questions, including producing essays and emails, in human-like language.

James has been looking at how robust his department's assessments are


"Multiple choice questions, for example, it will handle those very well.

"We definitely were not expecting it to do as well as it did... it was getting close to 100% correct."

But with more complex questions, which require students to think critically and which he says make up the bulk of assessment, it struggles.

One example, from a final-year assessment, reads: "Why is it important to understand the timing of exercise in relation to nutrition status in people with [a technical term, according to James] overweight?"

And there are tell-tale signs the answer given by ChatGPT was not written by a student.


"On first glance, it looks very good - it looks very clearly written, it looks quite professional in its language," James says.

But some of the statements are more like those of a GCSE pupil than a university student.

It has a habit of repeating the exact phrasing of the question in its introductions and conclusions, "just written in slightly different ways".

And when citing sources of information, as is standard in academic work, it simply makes them up.


"They look perfect - they've got the right names of authors, they've got the right names of journals, the titles all sound very sensible - they just don't exist," James says.

"If you're not aware of how large language models work, you would be very easily fooled into thinking that these are genuine references."

Since ChatGPT was released to the public, about six months ago, many students have been unsure when they can and cannot use it.

"I might be tempted to use ChatGPT... but currently, I'm too scared to because you can get caught," says one student walking between classes on campus.

"It's not clear yet what is considered cheating with ChatGPT," another says. "If you copied your whole assignment from ChatGPT that's cheating - but it can be really helpful to guide."

Education Secretary Gillian Keegan said in a speech on Monday that AI was "making a difference in schools and universities already", and suggested it could help school teachers with lesson plans and marking.

New advice from Quality Assurance Agency, which reviews standards at UK universities, urges them to equip students with AI skills they can take into the world of work.

It encourages them to explain to new and returning students, in September, how and when AI should be used - and to adapt courses where appropriate.

Marketing lecturer Kim Watts calls it "another tool in the toolbox". And some students in her department have already started using ChatGPT this term, in coursework that asks them to produce a marketing plan.

Kim says ChatGPT will help get "students started on things"


"I'm suggesting that students go to ChatGPT, those who maybe don't know where to start... and start playing around with prompts," she says.

"It won't give them the answers - but it can give them ideas."


'Critical thinking'


Kim demonstrates by asking ChatGPT to produce its own marketing plan.

It responds with a series of numbered points - everything from the creation of a brand identity to the use of social media.

But Kim, looking up from her screen, says: "This will not pass.

"Submitting something like this is just not detailed enough - it doesn't show us any learning, it doesn't show any critical thinking."

Neurodivergent students and those for whom English is not their first language will benefit most from ChatGPT, Kim says.

But any student choosing to use it will be asked to submit their ChatGPT prompts and answers as an appendix, to make it "really clear how far they have come" from the chatbot answers.


Summer exams


As with most universities, Bath's policy on ChatGPT and other AI tools is still in the works. It is due to be in place from September.

After that, a team will meet throughout the year to ensure it keeps up with the rapidly changing technology.

In the meantime, many staff are once again setting in-person, invigilated summer exams.

Dr Chris Bonfield, the head of a team that helps design assessments, says the "default assumption" is students should not be using ChatGPT this year. And, if staff decide to allow it, they should clearly set out their expectations.

The pace at which the technology is evolving poses a challenge for universities - but Bath quickly moved away from conversations about banning it.

Chris says the pace at which the technology changes poses a challenge for universities



"This tool is not going away," Chris says.

"In order to ensure our students are equipped with the skills they need for the future workplace, but also that our degrees remain current, we're going to have to engage."


'Too dangerous'


Last week Geoffrey Hinton, widely regarded as the godfather of AI, resigned from Google, saying he regretted his work - and chatbots could soon be more intelligent than humans.

Prof Verena Rieser, a computer scientist at Heriot-Watt University who has been working in the AI field for two decades, says her own students are "using it in very creative ways" - but chatbots are still in the early stages of development and "can be used to generate misinformation at [a] scale which is obviously very concerning" when it comes to education.

Previous models of ChatGPT were not released because they were deemed "too dangerous", she says.

Its developer, OpenAI, says "like any technology, these tools come with real risks" and it works "to ensure safety is built into our system at all levels".

Since ChatGPT's launch, other companies have focused their efforts on AI. Google, for example, released Bard, which is available to adults only.

"I would expect that we'll soon see different flavours of ChatGPT by different companies out there and hopefully also safer models which actually mitigate for the possible dangers," Verena says.

"At this moment we don't really know how to stop the models outputting information which is wrong or toxic or hateful - and that's a big problem."

Newsletter

Related Articles

PanamaTimes
0:00
0:00
Close
El Salvador's Bitcoin Holdings Reach $350 Million
Teens Forming Friendships with AI Chatbots
WhatsApp Rolls Out Major Redesign
Neuralink's First Brain Implant Experiences Issue
Apple Unveils New iPad Pro with M4 Chip, Misleading AI Claims
OpenAI to Announce Google Search Competitor
Apple Apologizes for Controversial iPad Pro Ad Featuring Instrument Destruction
German politician of the AFD party, Marie-Thérèse Kaiser was just convicted & fined $6,000+
Changpeng Zhao Sentenced to Four Months in Jail
Biden Administration to Relax Marijuana Regulations
101-Year-Old Woman Mistaken for a Baby by American Airlines: Comical Mix-Up during Flight Check-in
King Charles and Camilla enjoying the Inuit voice singing performance in Canada.
New Study: Vaping May Lower Fertility in Women Trying to Get Pregnant
U.S. DOJ Seeks Three-Year Sentence for Binance Founder Changpeng Zhao
Headlines - Thursday, 23 April 2024
Illinois Woman Wins $45M Lawsuit Against Johnson & Johnson and Kenvue for Mesothelioma Linked to Baby Powder
Panama's lates news for Friday, April 19
Creative menu of a Pizza restaurant..
You can be a very successful player, but a player with character is another level!
Experience the Future of Dining: My Visit to an AI-Powered Burger Joint
Stabbing rampage terror attack in Sydney, at least four people killed, early reports that a baby was among those stabbed.
Iran fired more than 300 drones and missiles at Israel overnight. Israel Reports Light Damage After Iran Launches Large Strike.
I will never get enough of his videos and the pure joy and beauty of these women!!
Scientists at the University of Maryland have developed an "invisibility cloak", for AI using adversarial patterns on a sweater, making the wearer nearly undetectable to standard object detection methods.
Lamborghini Bids Farewell to Its Best-Selling Sports Car: The Huracán
Sam Bankman-Fried Appeals 25-Year Prison Sentence for $8bn FTX Fraud
OJ Simpson, ex-NFL star who was acquitted of murder, dies aged 76
British Backpacker Imprisoned in Notorious Bolivian Prison: Family Raises Funds for Legal Fight and Essentials
Argentina: Venezuela Cuts Power to Embassy after Opposition Meeting
El Salvador Offers 5,000 Passports to Skilled Foreign Workers: Tax-Free Relocation and Citizenship
Panama Papers Trial Begins: Founders of Mossack Fonseca Face Money-Laundering Charges
75 Becomes the New 65: Retiring in Your 60s Unrealistic as Life Expectancy Increases and Costs Rise
Total Solar Eclipse of 2021: 32 Million Witness the Mystical, $1.5bn Spectacle Sweep Across North America
New shopping experience…
New world, new reality, let’s get used to it
UK Company Passes Milestone in Developing Space-Based Solar Power, Aiming to Power a Million Homes and Provide Constant Energy
Mexico Breaks Diplomatic Ties with Ecuador after Police Storm Embassy, Arrest Former Vice President
Monty Python were so ahead of their time
If there's a will, there's a way!
Rules about how to dress are important, but not so much if you have a lot of money.
Body Armor Firm Showcases Stab-Proof Vest in Demo on CEO
Mexico Cuts Diplomatic Ties with Ecuador After Embassy Stormed in Quito
Here is a tattoo idea, for engineers
Zoraya Ter Beek, a 28-year-old woman from the Netherlands, will undergo euthanasia in May due to severe mental health challenges
Here's a video featuring Fidel Castro, where he discusses his stance against war and his commitment to preserving life, positions that have put him at odds with the USA:
Woman reaches behind and steals gun from a security guard and shoots three people while getting detained in Chile
Take a walk around the safe and thriving downtown San Salvador.
Joe Biden criticised by Trump campaign for declaring Transgender Day of Visibility on Easter Sunday
Macron says France will help Brazil develop nuclear-powered submarines
A video demonstrating women's self defense class in 1930
×