Matomo

News of the Week: GPT-4 equalizes skills, ChatGPT searches the web again and becomes multimodal

· 9 min read
News of the Week: GPT-4 equalizes skills, ChatGPT searches the web again and becomes multimodal

ChatGPT becomes multimodal

Just before last week's newsletter's deadline, OpenAI launched an app version of ChatGPT with built-in speech and image recognition features. In the application, which is available for both iOS and Android, they have initially made it possible to make speech-to-text and subsequently have the answer read aloud. Thus, one can begin to have a conversation with the language model. At the same time, they have announced that they are starting to roll out image recognition in the model, and thus, it will be possible to combine images and speech in one prompt.

Several examples have emerged showing the new technology, and Mckay Wrigley shows below how students could use image recognition:

0:00
/1:40

Kilde: https://x.com/_borriss_/status/1707412411836162279?s=46

The new multimodal options can thus extend traditional learning resources and adapt the content to the individual. In the long term, images and illustrations will not be static but will become more interactive and engaging for students.

On Viden.AI, we've previously written about MiniGPT-4, which can also be used as an image analysis tool, and how Bing and Bart can be used for visual searches. On the face of it, the new features in ChatGPT seem to be ahead of the competition, and we hope to gain access soon.

ChatGPT can now see, hear, and speak
We are beginning to roll out new voice and image capabilities in ChatGPT. They offer a new, more intuitive type of interface by allowing you to have a voice conversation or show ChatGPT what you’re talking about.

ChatGPT can once again search the web

Paid customers have also been given access to ChatGPT with Bing Search, allowing them to find up-to-date information from the web again. OpenAI had shut down the technology as it was too good at getting behind a series of paywalls and downloading entire articles.

We have tested the feature ourselves, but it is minimal, as you can only get summaries of 80 words (sometimes it says 100 words, though).

The Decoder has investigated the possibilities of searching the web and writing an article whose central message is that traditional search engines are more valuable and accurate. The challenge is that ChatGPT rewrites the information, misses the point, or misses essential aspects of the text, whereas search engines display relevant snippets directly from the source. However, search engines also have problems such as spam, misinformation, and pages not being transparent.

ChatGPT’s new browsing feature is worse than search engines
OpenAI has limited ChatGPT’s ability to read content from web pages to summaries of 100 words. And these summaries are not reliable.

A new study shows that GPT-4 can pose a significant skill equalizer

The Boston Consulting Group conducted the study conducted the study along with several academic researchers, including Ethan Mollick. In the study, the skills of several consultants were assessed, and here, they were divided into two groups based on their performance before using AI. The consultants, who initially performed below average (the bottom half of the group), saw a marked improvement in their work with AI, increasing the quality of their results by as much as 43%.

Distribution of output quality across all tasks. The blue group didn't use AI, the green and red group used AI, the red group got some extra training on how to use AI. Illustration by Ethan Mollick

On the other hand, consultants who initially performed above average (the top half of the group) also improved with the help of AI, although to a lesser extent compared to those who served lower. For this group, the quality of their results improved by 17% after using GPT-4, which is considerably lower than the 43% improvement rate achieved by the bottom half.

We've seen similar studies in education, where the worst-performing group also benefited the most from having ChatGPT.

Below, we have gathered a few links about the study:

Centaurs and Cyborgs on the Jagged Frontier
I think we have an answer on whether AIs will reshape work.…
Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality
The public release of Large Language Models (LLMs) has sparked tremendous interest in how humans will use Artificial Intelligence (AI) to accomplish a variety o
Everyone is above average
Is AI a Leveler, King Maker, or Escalator?

A new article on viden.ai

When writing and talking about bias in language models like ChatGPT, it's usually about the mismatch between what the model writes and what we would like it to write (the ideal world in the eyes of the individual?). In reality, it's more about our expectations regarding the data used to train the models.

Claus has written an article about bias, or bias, as he prefers to call them, in large language models. In the article, he looks, among other things, at why and how it occurs. He also discusses potential biases in Google searches and also rounds up the biases or biases we all have.

As educators, we must enlighten and educate our young people. It is essential that we make future generations critically thinking and reflective people and that they learn to use the new technologies on an informed basis. Informing and teaching about the potential biases of technologies, the need for critical thinking, validation of information, and healthy skepticism might be a good place to start! In any case, we must be very conscious of what to expect from language models when we use them!

Andreas Lindenskov Tamborg, assistant professor from the University of Copenhagen, wrote on LinkedIn:

This is a strong post and an essential contribution to sharpening the precision of what we mean by and understand by bias. As time stands, this should be part of core material in both primary and secondary schools.

Read the article here:

A nuanced view of bias in language models
The use of generative artificial intelligence, such as artificial intelligence, is a major concern. ChatGPT is becoming increasingly prevalent – also in education. When we incorporate new technology into our work and education, it is very important that we understand its possibilities and, in particular, its limitations. Large language models, such

News

Sam Altman Is the Oppenheimer of Our Age
He insists the artificial intelligence he is creating could destroy civilization even as he hastens its advancement. Do we know enough about him?
OpenAI offers a way for creators to opt out of AI training data. It’s so onerous that one artist called it ‘enraging.’
OpenAI is now letting artists request that their work be removed from AI training data. The process is so onerous that it almost seems like it was designed not to work.
AI og chatbots på Rosborg Gymnasium & HF - IT Torvet
Læs blandt andet om en særlig digital studieretning med AI i undervisningen, når rektor Hanne Hautop gæsteblogger.
Generative AI, plagiarism, and “cheating”
Back in January, I wrote a post called Beyond Cheating, reflecting on the ChatGPT bans that were rolling out across various Australian states and the “cheating”
Lærere i debat om kunstig intelligens: Vi kan ikke fortsætte undervisningen som tidligere
Teachers Are Going All In on Generative AI
Surveys suggest teachers use generative AI more than students, to create lesson plans or more interesting word problems. Educators say it can save valuable time but must be used carefully.
Kunstig intelligens er rykket direkte ind i studieværktøjerne: - Det kommer til at flyde over med middelmådige resultater, vurderer ekspert
Kunstig intelligens er med til at forandre læringen i samtlige fag på én gang, mener formanden for Danske Gymnasier.
Recap: Teaching in the Age of AI (What’s Working, What’s Not) - Center for Excellence in Teaching and Learning
by Derek Bruff, visiting associate director Earlier this week, CETL and AIG hosted a discussion among UM faculty and other instructors about teaching and AI this fall semester. We wanted to know what was working when it came to policies and assignments that responded to generative AI technologies li…
Efterskole bruger ChatGPT i alle fag: ‘De skal vide præcist, hvornår de må bruge det’ | Version2
På True North Efterskole fokuseres der på elevernes egne refleksioner og kreativitet i undervisningen og afleveringerne, og derfor må de gerne benytte ChatGPT til de lette opgaver.
ChatGPT er ikke så farlig endda…

Recommendation of the week

Teachers' Room is a podcast about teaching created by Morten Gundel, who teaches social studies and communication & IT at H.C. Ørsted Gymnasium in Lyngby. Through conversations with researchers, teachers, and students, he tries to learn more about some pedagogical and didactic challenges he faces daily as a high school teacher.

This week, Viden.AI stopped by to chat with Morten about what we've learned about artificial intelligence in education after a year with ChatGPT. Listen to the new episode and dive into the other fascinating episodes.

Hvad har vi lært om kunstig intelligens i undervisningen efter et år med ChatGPT? - Lærerværelset
Da OpenAI lancerede ChatGPT for et lille års tid siden, sendte det chokbølger gennem uddannelsessektoren. Den brugervenlige og let tilgængelig kunstige intelligens rejste en masse spørgsmål om uddannelse: Hvad skal vi lære eleverne, hvis kunstig i…