ChatGPT Interviewed: ‘My Strengths and My Limits’

Subhashis Banerjee is a professor of laptop science with Ashoka College and IIT Delhi interviews ChatGPT on TheIndiaForum:

Subhashis Banerjee (SB): Hello ChatGPT, allow us to have a dialog about your self?

ChatGPT: After all! I’m an AI language mannequin created by OpenAI, educated on a various vary of web textual content to generate human-like responses to questions and prompts. My coaching knowledge consists of billions of phrases from web sites, books, and different texts, permitting me to generate responses to all kinds of questions on many matters. Is there something particular you’d prefer to know?

SB: As I perceive, when given a immediate, reminiscent of a query or a sentence fragment, you generate a response by predicting the subsequent phrase in your output sequence relying on pre-trained weights, one phrase at a time. Is that appropriate?

ChatGPT: Sure, that’s appropriate! I exploit a deep neural community with a transformer structure to generate my responses. Given an enter immediate, I encode it right into a numerical illustration after which use that illustration to foretell the subsequent phrase within the output sequence, one phrase at a time. This course of continues till I generate an output of the specified size or till a stopping token is generated. The chances for the subsequent phrase are computed utilizing the pre-trained weights in my mannequin, which have been discovered throughout coaching on massive quantities of textual content knowledge.

SB: Are you able to inform me a bit extra about your inner structure, the variety of inner parameters you could have, and about transformers and neural networks?

ChatGPT: Certain! I’m primarily based on the transformer structure, which is a kind of neural community particularly designed for processing sequential knowledge, reminiscent of textual content. A transformer community consists of an encoder and a decoder, that are each composed of a number of equivalent layers, every containing multi-head self-attention mechanisms and totally linked feed ahead layers.

The encoder takes the enter sequence and produces a steady, fixed-length illustration of the sequence, which is then handed to the decoder. The decoder makes use of this illustration to generate the output sequence, one phrase at a time.

As for the interior parameters, the scale of a language mannequin like me is normally measured by way of the variety of parameters within the mannequin, and I’ve a really massive variety of parameters. For instance, the GPT-3 mannequin, which is without doubt one of the largest fashions developed by OpenAI, has over 175 billion parameters. Having a lot of parameters permits the mannequin to seize plenty of info from the coaching knowledge, but it surely additionally signifies that the mannequin requires plenty of computational sources to run.

In abstract, transformers are a kind of neural community which might be properly suited to processing sequential knowledge, reminiscent of textual content, and I’m an implementation of the transformer structure particularly designed for producing textual content.

🙂 Tons extra within the interview…

Prof  Banerjee usually on ChatGPT:

The ChatGPT (Generative Pre-trained Transformer) instrument launched by OpenAI in November final 12 months is the closest Synthetic Intelligence (AI) has come to passing the Turing check of intelligence, on whether or not a machine can interact in a dialog with a human with out being detected as a machine. It will probably write laptop applications and poetry in specified types, write essays and letters, can seemingly do logical reasoning and make new hypotheses, and typically may even counsel believable strategies of proving a theorem to a professor on a analysis drawback. It additionally makes errors, not solely in reasoning, however typically even on factual issues.

Extra such instruments with extra enhanced capabilities will inevitably observe. Whereas whether or not such machines can actually do human-like reasoning or really exhibit intelligence are open questions in laptop science and philosophy, it’s simple that such instruments may have a profound affect on training and ability constructing as we all know them immediately. They not solely present new alternatives but additionally new challenges. No doubt, society wants to grasp, debate and evolve strategies to take care of such disruptions.

ChatGPT is a superb technological innovation, however there are some actual risks of harmless and abnormal readers being seduced by the floor coherence and class of the textual content generated.

I engaged ChatGPT in a few conversations on itself to grasp these points higher, and it is a transcript curated from the 2 conversations. Whereas the questions have been main, the solutions weren’t pressured out of ChatGPT. There have been simply two classes with very related questions, and ChatGPT’s solutions within the two classes have been remarkably constant. The unique and unedited transcripts of the classes are linked here and here.

For the reason that questions have been main, and the solutions are from a machine, some essential questions come up. Whose opinions – and errors, if any — are mirrored within the conversations? Mine? Is ChatGPT simply mirroring my opinions and biases? ChatGPT’s, if such a notion is sensible in any respect? OpenAI’s? No one’s? Or is it democratised standard knowledge that’s curated and generalised from thousands and thousands of written textual content all around the world? If that’s the case, who all are answerable for these opinions and the way they could be reviewed?

[A]rtifacts hardly ever are politics-free, and statements like “I’m merely a instrument created to help and serve, and it’s as much as folks such as you to find out how AI is used and its affect on society.’’ are problematic…

ChatGPT is a superb technological innovation, however there are some actual risks of harmless and abnormal readers being seduced by the floor coherence and class of the textual content generated, and accepting issues on their face worth with out nearer examination. One solely needs that some accountable and moral instructions additionally originate from the Massive Tech firms after they unleash such merchandise, somewhat than go away it to some hapless college students and a bewildered society to take care of them. In any case, artifacts hardly ever are politics-free, and statements like “I’m merely a instrument created to help and serve, and it’s as much as folks such as you to find out how AI is used and its affect on society.’’ are problematic to say the least.

This entry was posted on February 17, 2023 at 4:00 pm and is filed underneath Discussion. You may observe any responses to this entry by way of the RSS 2.0 feed.
You may leave a response, or trackback from your personal web site.