{"id":115,"date":"2023-01-20T11:10:07","date_gmt":"2023-01-20T16:10:07","guid":{"rendered":"https:\/\/unsung.davidpogue.com\/?p=115"},"modified":"2023-11-16T13:42:50","modified_gmt":"2023-11-16T18:42:50","slug":"chatgpt-and-the-end-of-writing","status":"publish","type":"post","link":"https:\/\/www.unsungscience.com\/index.php\/2023\/01\/20\/chatgpt-and-the-end-of-writing\/","title":{"rendered":"ChatGPT and the End of Writing"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\">Season 2 \u2022\u00a0Episode 4<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">In early 2023, ChatGPT blew up the internet. It\u2019s an AI app that can create any piece of writing you ask for. Poems, homework, lyrics, essays, outlines, recipes, interview questions, even code. All indistinguishable from something written by a person, all instantaneous and free.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In schools, cheaters began cheating immediately. Educators were horrified, calling it the end of homework, college-entrance essays, and even writing skills.New York City schools banned it. Experts called it a potential factory for misinformation (ChatGPT routinely writes authoritative-sounding articles that are simply wrong).&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Everyone agrees that ChatGPT is disruptive. But how do we keep the good\u2014and prevent the terrifying?<\/p>\n\n\n\n<figure class=\"wp-block-audio\"><audio controls src=\"https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3\"><\/audio><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Episode Transcript<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Season 2, episode 4: ChatGPT and the End of Writing.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Intro<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Theme begins.<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ChatGPT may have the clunkiest, least memorable name in software history. But once you\u2019ve seen it\u2026oh, it\u2019s memorable, all right.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:25:47 Look, this machine can generate this piece of writing that\u2019s as good as what someone that would write it themselves could generate. that seems exciting and rather astonishing in many ways.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:36:55 \/ think of it as turbocharging your job as a \u2014 as a lawyer or a doctor or a writer, or writing songs or creating art, doing it better than you ever could do before.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TIMNIT: 11:40:00 I think that we should be really terrified of \u2014 of \u2014 of \u2014 of this whole thing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I\u2019m David Pogue, and this is \u201cUnsung Science.\u201d<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>First Ad<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Before we dive in, I\u2019d just like to say\u2014welcome back! This is the first&nbsp;<em>regular&nbsp;<\/em>episode of season 2\u2014from here on, we\u2019ll be unleashing a new \u201cUnsung Science\u201d episode every other Friday. And you know what else I\u2019d like to say? Thank you. Your emails, tweets, reviews, and ratings have made this whole enterprise super exciting and super fun!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Today\u2019s episode is about what may be the most amazing artificial-intelligencesoftware you\u2019ve ever seen\u2014with what may be the dumbest name. It\u2019s ChatGPT. Not only is that utterly un-catchy, but even if you know what it stands for, you still don\u2019t get it. GPT is Generative Pre-Trained Transformer. Well,&nbsp;<em>that\u2019s&nbsp;<\/em>helpful.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway, in AI circles, ChatGPT is what\u2019s called a large-language model: software trained by feeding it massive amounts of existing written material, and after that, it can generate new text on command.It can write anything, to your specifications. It\u2019s free. You can try it out at chat.openai.com.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Like, I can type in,&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Add subtle typing sounds please<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cWrite a limerick about the effects of artificial intelligence on the future of humanity.\u201d And we get this:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">KEATON: There once was AI so grand,<br>It could help us with tasks at hand,<br>But it also might do harm,<br>If its actions lack charm,<br>So we must use it with care and command.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Add typing sounds please<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Or let\u2019s try this. \u201cTell the story of Goldilocks in the style of the King James Bible.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">KEATON: And it came to pass in those days, that a certain young damsel named Goldilocks did wander into the dwelling of three bears, who were away from their home. And she did behold a bowl of porridge on the table, and she did taste the porridge of the first bear, and it was too hot. And she did taste the porridge of the second bear, and it was too cold. But the porridge of the third bear was just right, and she did eat it all.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Andit goes on. In case you\u2019re wondering what&nbsp;<em>happens&nbsp;<\/em>to Goldilocks, the story ends like this:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keaton: And thus it was written, that Goldilocks and the three bears were forever remembered for this story of trial and error, and the importance of respecting the possessions of others.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ChatGPT can also write letters. Poems. Homework. Essays. Outlines. Recipes. Interview questions. Even computer code. Even song lyrics! Here:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cWrite song lyrics from the point of viewa former Broadway conductor who grew up to host a podcast about science and technology.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keaton: Verse 1: Once a conductor on Broadway,<br>Now he\u2019s found a new way<br>To share his love of science and tech \u2014<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Oh hold on, Keaton\u2014sorry. I got this one.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>(DP sings at piano)<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Once a conductor on Broadway,<br>Now he\u2019s found a new way<br>To share his love of science and tech \u2014<br>On a podcast, he\u2019ll take you on a trek<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Chorus:&nbsp;<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I\u2019m a different kind of conductor now,<br>Guiding you through science and technology,<br>Sharing tales of progress, and how<br>It shapes the world we live in, you\u2019ll see.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Thank you, thank you. Tip your server!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And now, there\u2019s one more demo thing I gotta do. Apparently, it\u2019s a journalistic law: Any story about ChatGPT<em>must&nbsp;<\/em>let ChatGPT write the introduction for the story itself. I mean, at this point, it\u2019s a tired,obvious gag, but look, I wouldn\u2019t want to break one of the core tenets of journalism. So here:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cWrite an introduction to an episode of Unsung Science about the promise and perils of ChatGPT.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keaton: Welcome to the latest episode of Unsung Science, where we explore the cutting-edge technology that\u2019s shaping our world. Today, we\u2019re talking about ChatGPT, a language model that\u2019s\u2014<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">BORRRING!!&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But now I can type: \u201cMake it funnier.\u201d And now I get:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keaton: Welcome to the latest episode of Unsung Science, where we explore the technology that\u2019s shaping our world, or at least trying to. Today we\u2019re talking about ChatGPT, the language model that\u2019s taking over the world, one typo at a time. So put on your thinking caps, or just your headphones and join us as we explore the hilarious, and sometimes terrifying world of ChatGPT.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Dang. That\u2019s actually not bad!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By the way\u2026 the voice ofChatGPT\u2019s output in this episode belongs to Keaton Talmadge. She\u2019s a professional voice actor\u2014and, by the way, Buster Keaton\u2019s great-granddaughter!Kind of a special treat. Hey, Keaton!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>A snippet of our Zoom greeting\u2026 something like:<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keaton: Hey!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">DP: I really appreciate your doing this. \u2018Cause it\u2019s really hard for podcast listeners to read what\u2019s on my screen.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keaton: No problem!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway. As you can imagine, ChatGPT is freaking people&nbsp;<em>out.&nbsp;<\/em>Within a week of its release, a million people were using it. Microsoft, which has a billion-dollar investment in OpenAI, the company behind ChatGPT, is considering building it into Word and PowerPoint. And OpenAI itself is in talks to sell shares at a price that would put the company\u2019s value at 29 billion dollars.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Some people are super excited by the potential of this software.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:26:15 I think this is huge. \/00:26:43 \/ I wouldn\u2019t be surprised 50 years from now, people looked back and say, wow, that was a really seminal set of inventions that happened in the early 2020s.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">00:03:48 I think we\u2019re going to have potentially the best decade of flourishing of creativity that we\u2019ve ever had, because a whole bunch of people, lots more people than before, are going to be able to contribute to our collective art and science.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This is Erik Brynjolfsson. He\u2019s a Stanford professor, and director of Stanford\u2019s Digital Economy Lab. He\u2019s got many great stories about how ChatGPT has been helpful.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:05:47 \/ I happened to be the last speaker at this AI conference \/. And for fun, I decided to have ChatGPT \/ help me with my comments.So, first I had to just do it straight up the way Eric Brynjolfsson would \u2014 would say. \/But then to have more fun, I said, \u201cnow do it in the style of Taylor Swift.\u201d Oh, my God. It was so beautiful. You know, the metaphors, the examples that came out of it I shared it!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It can also be a godsend if you\u2019re not great at writing, or not great at English.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:20:55 \/ one of my colleagues at Stanford had a grad student, um, who gave a research proposal to him.And she was from another country, and it was kind of muddled and you couldn\u2019t quite get like, what\u2019s the point of your proposal? I don\u2019t understand it. He \/ had GPT write it in a clearer way for him. And then he\u2019s like, \u201caha, now I get what she was trying to say.\u201d\/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">00:21:44 \/ these tools can help them express things, thoughts that they had, they weren\u2019t quite able to put in the right words.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To him, ChatGPT represents the ideal use of AI: augmenting our own abilities.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:22:53 \/ The greatest benefit comes from when humans and machines work together. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">00:36:55 And specifically with these tools, they work a lot better with humans in the loop than they do on their own\/. So, think of it as turbocharging your job as a \u2014 as a lawyer or a doctor or a writer, or writing songs or creating art, doing it better than you ever could do before.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Then there\u2019s the story of KokoCares.org, a free, crowdsourcedmental-health hotline, primarily for adolescents who are having trouble. Its cofounder Rob Morris tried a little experiment. Here\u2019s what he said in his video:&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Koko experiment.aiff<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Rob: And so we have a post that just came in, someone saying, \u201cI\u2019m trying to become a better me and having a hard time.\u201d So what we\u2019ve done is, we\u2019ve sent this post to GPT 3. GPT 3 says, \u201cI hear you, you\u2019re trying to become a better person and it\u2019s not easy. It\u2019s hard to make changes in our lives, especially when we\u2019re trying to do it alone. But you\u2019re not alone. There are people here who care about you and want to help you. I send you love and support as you go through this journey.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The AI ,on its own in a matter of seconds, wrote a really nice, articulate response here. So we ran an experiment where we tested it on about 30,000 posts. Responses were rated more favorably when they were co-written by the AI, and they were done in well over half the time.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Now, if you were one of the people providing care, using the ChatGPT response was optional, and you could edit it if you liked. Still, this experiment really upset a lot of people, who called it unethical and maybe even illegal. I mean, how would these struggling teenagers react if they found out that those caring responses were AI autotext?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As it turns out, not well. Morris wrote a followuplater on: \u201cOnce people learned the messages were co-created by a machine, it didn\u2019t work.Simulated empathy feels weird, empty. A chatbot response that\u2019s generated in 3 seconds, no matter how elegant, feels cheap somehow.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Yathink?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway. So yes\u2014lots of potential. But also\u2014SO many questions we have to work out. And really, there are six big ones. Six doozies that perhaps should have been addressed before AI writing bots got unleashed to the world.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">After the ads, we\u2019ll bring some experts on board to help us make sense of \u2018em.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Second Ad Break<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Welcome back. I promised that we\u2019d work through the six massive problems that large-language models like ChatGPT present. Six real doozies.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Doozie #1 is this: Now that AI can write anything we want, in any style, is there any point in teaching anyone to write anymore?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">I mean, school kids are already using ChatGPT to write their homework for them. Editorials are already flying with headlines like, \u201cChatGPT Will End High-School English\u201d and \u201cWill ChatGPT End the Student Essay?\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:25:47 \/ Look, this machine can generate this piece of writing that\u2019s as good as what someone that would write it themselves could generate. And that seems exciting and rather astonishing in many ways.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Jane Rosenzweig is the Director of the Writing Center at Harvard.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:26:25 \/ I think writing is a way of figuring out what you think. And so if a machine is doing the writing, then we need to ask ourselves, where are we figuring out what we think? \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 11:27:19 \/ you don\u2019t need to know structure or syntax or vocabulary or grammar or spelling. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:27:25 But even beyond the structure, the syntax or the grammar or the spelling, which are all important things to putting together a piece of writing that an audience could understand, I think I worry the most about just that thinking piece.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:28:01 \/ I say to my students, what do you want to understand? What do you want to know about the world, about the topic that we\u2019re thinking about? \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:28:18 First, you read things that other people have said about this thing that you want to understand. You talk to people. We have class discussions. \/And in the process of writing about that, you often start examining evidence and trying to make an argument about what you think.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:28:38 \/And so a very common piece of advice that I give my students \/ is, look in your conclusion, because you write yourself to that main idea. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 11:28:58 Huh!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:28:58 So what happens if instead of going through that process, \/ what if instead you just type the prompt into ChatGPT and got the answer there? What do we lose?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 11:29:31 I mean, what&nbsp;<em>do<\/em>&nbsp;we lose? \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:29:38 \/ you would lose figuring out what you think.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At the moment, educators all over the world are struggling to figure out how to proceed. The New York City school system, the biggest in the country, has banned ChatGPT outright.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 11:35:53 \/ what do you hear in the educational industry from people who are confronted with this?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">JANE: 11:36:02 \/ there are these possible paths that \u2014 that people can take with ChatGPT, right? You can turn it off. You can embrace it fully and say, \u201cwe\u2019re going to use this as \u2014 as a teaching tool in these different ways.\u201d Or you can come out somewhere in between.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:36:41 \/ for example, I think a lot of people have been talking \/ about this idea: \u201cWell, perhaps what\u2019s going to happen is that our students will stop being writers and they will become editors.\u201dSo we will say to them, let\u2019s generate three or four different answers to this prompt with using ChatGPT, and then let\u2019s talk about that in class. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:37:22 My initial reaction to that was, are we doing this because ChatGPT exists? Or are we doing this because it\u2019s better than other things that we\u2019ve already done? \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:42:17 \/ to what question is this the answer? 11:42:54 \/ when we\u2019re talking about replacing human writing, human thinking, human teaching with a machine, what \u2014 why are we doing this? To what question is this the answer?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OpenAI declined an interview for this episode, and for my \u201cCBS Sunday Morning\u201d story about ChatGPT\u2014which is interesting, because they&nbsp;<em>did&nbsp;<\/em>gran an interview only a few weeks earlier about its other big product, Dall-E 2, which generates art and photos. That\u2019s when Aditya Ramesh, the creator of Dall-E, told me:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Ramesh.aiff<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">RAMESH: 10:19:39 &nbsp; The goal of the company is to develop artificial general intelligence. And by that, we mean an AI that can doall of the things a human can\u2013 \/ and to deploy it in a way that\u2019s safe and maximizes the positive benefits to society.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Here\u2019s what OpenAI\u2019s own website gives as the reason it created ChatGPT: to help \u201cmake AI systems more natural to interact with.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But that doesn\u2019t&nbsp;<em>really&nbsp;<\/em>answer the question \u201cwhy\u201d?And educators are stuck with finding their way out of this mess.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Doozie #2 has to do with how ChatGPT was trained: by hoovering up hundreds of millions of articles on the&nbsp;<em>internet.&nbsp;<\/em>And\u2014I know that this might come as a shock\u2014but not&nbsp;<em>everything&nbsp;<\/em>on the internet turns out to be true. The problem is\u2026<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TIMNIT: 11:20:44 \/ it\u2019ll just sort of parrot back \/ what was on the Internet. Right?\/it wasn\u2019t taught to understand what is fact, what is fiction or anything like that. What it has learned how to do is tell you the most probable sequences of things, because \u2014 as it\u2019s seen on the Internet. \/.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Timnit Gebru is an AI researcher\u2014kind of a big deal AI researcher. She was the one who co-authored the 2018 study about face-recognition software from IBM, Microsoft, and Amazon. You know, how its error rate on white male faceswas under 1%\u2014but it got Black female faces wrong about 35% of the time.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway, she points out that ChatGPT\u2019s answers&nbsp;<em>sound<\/em>&nbsp;super confident and authoritative\u2014and that makes them even more insidious.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TIMNIT: 11:21:47 \/ the fact that you can even get grammatically correct answers can deceive you even more, right? Because you think this is coming from a person. \/you don\u2019t even have the cues that generally would tell you that something might be wrong. \/it can give you a completely wrong answers for a whole bunch of things.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Typing:<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OK, like here: \u201cWrite the history of the first woman President of the United States.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">KEATON: The first woman President of the United States, Hillary Rodham Clinton, served as the 45th President of the United States from January 20, 2017 to January 20, 2025. Clinton was a former First Lady, U.S. Senator, and Secretary of State.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the general election, Clinton faced off against Republican nominee Donald Trump. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OK,&nbsp;<em>what?&nbsp;<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There\u2019s a computer-science term for this, whenAI churns out baloney statements: Hallucinations. Imagine how dangerous a hallucination would be if you were asking formedical advice.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Doozie #3 isrelated\u2014and it\u2019s really terrifying. Even Erik Brynjolfsson thinks so.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 00:13:00 \/ The other thing that we hear is that these things will be misinformation factories.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: Yeah.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: Now, a Russian bad actor can generate hundreds of thousands of extremely well-written, plausible articles filled with phony studies and research papers. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:13:34 It\u2019s definitely something to worry about. \/ we could have an enormous flood. Each of us could have hundreds, thousands, millions of spam messages sent to us, all kind of plausibly looking like they were done by humans. This could be a catastrophe, and we need to take measures to address it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: Are there any that you\u2019ve heard of? Any proposals?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: Yeah. There are two kinds of approaches people have taken. One is to try to identify which content is generated by a machine with watermarks or other things, and say, \u201chey, that\u2019s a problem. You know, is there sort of a signature?\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Oh right\u2014the watermark thing. OpenAIis already working on this approach\u2014where everythingChatGPT writes will someday be encoded with some kind of digitalwatermark, so we\u2019ll be able to differentiate AI writing from human writing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Obviously, we\u2019re not talking about something visible, or even some hidden data attached to the text document.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">No, this would be some kind of algorithmicwatermark\u2014a statistical pattern of words or punctuation,detectable by special software. It would work only on longish blobs of text, and of course you couldstill bypass it just by rewriting it in your own words.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But there are two bigger problems with the watermarking approach. First, ChatGPT isn\u2019t the only large-language model. Google, for example, has one that they say is even better than OpenAI\u2019s\u2014but they haven\u2019t released it to the public, precisely because of the potential problems we\u2019re talking about.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway, the point is, there will be lots of these things, and not all of their creators will install guardrails the wayOpenAI has.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The second problem with watermarks is, as TimnitGebru points out,<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TIMNIT: 11:45:18 \/ But the thing is that this is now a game of cat and mouse. So, any time people know there is such a system, they\u2019re going to try to game it. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">11:45:43 \/And then, you know, people will update the watermarking system and they\u2019re going to try to game it. And I think that\u2019s what\u2019s going to happen.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OK. Doozie #4 is job losses\u2014or at least job changes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:35:10 \/ Most of the U.S. economy is knowledge and information work, and that\u2019s who\u2019s going to be most squarely affected by this. I would put people like lawyers right at the top of the list. Obviously, a lot of copywriters, screenwriters, um, fiction and then a lot of other people use writing and certainly nurses do a lot of writing, doctors do a lot of writing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\/Professors (LAUGH) will be affected. Um, but \u2014 but I like to use the word \u201caffected,\u201d not \u201creplaced,\u201d because I think if done right, it\u2019s not going to be AI replacing lawyers; it\u2019s going to be lawyers working with AI replacing lawyers who don\u2019t work with AI.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There will be at least one&nbsp;<em>new&nbsp;<\/em>job category made possible by ChatGPT, by the way: Prompt engineer.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:39:30 \/ There\u2019s a new occupation that\u2019s emerging; it\u2019s called prompt engineering. And prompt engineering is,\u201chow do you write a prompt that really evokes the most from GPT?\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It\u2019s funny how slightly different changes in the prompt can lead to very different outcomes. And even the designers don\u2019t fully understand how to write the prompts to get it \u2014 to get \u2014 to get the most from the tool.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\/prompt engineering is, uh, emerging as a way of getting the most from these tools.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: Wow.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:40:23 \/ that will be a new one, uh, in the \u2014 in the 2025 census of occupational codes. I think, uh, we\u2019ll have \u2014may be one of the entries.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Doozie #5 is, as Timnit calls it, automated plagiarism.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OpenAItrained ChatGPT on real people\u2019s writing. Including Timnit\u2019s. Including mine. Once OpenAI becomes a 29-billion-dollar company, do you really think they\u2019re going to pay us for the writingthey incorporated without consulting us?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Timnit: 11:36:55 \/ if let\u2019s say you owned a restaurant, right. You wouldn\u2019t go to a market and steal all the tomatoes and carrots and then make your creation and sell it back to the people who, you know, you took tomatoes and carrots from. Right? We understand that to be theft.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Why is this different? How do we understand this differently? You can\u2019t steal raw ingredients, make something, and then sell it back to the people you stole raw ingredients from.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Finally, Doozie #6: That we\u2019re mistaking&nbsp;<em>writing&nbsp;<\/em>for&nbsp;<em>creativity.&nbsp;<\/em>ChatGPT is not sentient. It\u2019s not human. It can\u2019t really think. All it does is a really good impersonation of things thousands of people have already written. It\u2019s like \u2026 a parrot.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TIMNIT: Precisely. \/ 11:19:18 And so, parrots, we don\u2019t \u2014 you know, we hear them repeating things that they\u2019ve heard, right, and \/ we think it\u2019s funny, we think it\u2019s entertaining. But we\u2019re not saying that parrots understand what\u2019s going on and they, you know, can predict the future or anything like that, right? We just think it\u2019s really interesting that they can parrot back what they\u2019ve seen. And so, \/ these large language models are doing a version of that.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But Erik Brynjolfsson has a different take.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 00:30:32 \/ we\u2019ve heard it \/ called a Pastiche machine. You know, all it can do is mimic stuff that other people have already written, and therefore can never leapfrog to something new.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:30:54 I think that\u2019s the fundamental misunderstanding. I mean, a lot of innovation really is kind of in combinatorial business, an input-output business. Uh, either implicitly or explicitly, when I come up with new ideas, I\u2019m combining different existing old ideas like Lego blocks and create something new. And that\u2019s what\/ these large language models do as well.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\/when I see some of the content, I\u2019m like, wow, \u201cthat\u2019s a beautiful metaphor that \u2014 that it just made. \/ Never been said before.\u201d \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By the way, this is probably a good time to mention the 8000-ton elephant in the room: ChatGPT 4.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OpenAI has always been transparent about the limitations of the current version, ChatGPT 3. Here\u2019s what CEO Sam Altman tweeted about it: \u201cChatGPT is incredibly limited, but good enough at some things to create a misleading impression of greatness. It\u2019s a mistake to be relying on it for anything important right now.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But version 4, now in testing, is slated to come out later this year. OpenAI trained it on 500 times as much data as the current version. And people who\u2019ve seen it say it\u2019s like seeing the face of God.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:16:55 A very senior person at OpenAI, he \u2014 he basically described it as a phase change. You know, it\u2019s like \u2014 it\u2019s like going from water to steam. It\u2019s just a whole another level of \u2014 of ability.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That\u2019s important, because already, there\u2019s such a thing as a ChatGPT detector. A Princeton student named Edward Tianwrote one, for example. It\u2019s a web-based app called GPTZero that got 7 million uses in a matter of days. You paste in some text, and it gives you a guess as to whether it\u2019s human or synthetic writing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But when ChatGPT 4 comes out\u2014I mean, will those things have a chance? It\u2019s gonna be another arms race, at best.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">OK\u2014one last ad break, and then I\u2019ll send you into the sunset contemplating the three possible coping approaches in this new world of AI writing.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Third ad break<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">So\u2026I don\u2019t know, man. The more I read about ChatGPT, the more I talk to people, the more I realize that there are three camps\u2014three ways of looking at the invention of large-language models.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">First, there\u2019s what I call the Skynet Philosophy.Remember Skynet, in the \u201cTerminator\u201d movies?&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>Skynet clip.aiff<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">SARAH: I need to know how Skynet gets built.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ARNOLD: The Skynet funding bill is passed. The system goes on-line on August 4, 1997. Human decisions are removed from strategic defense. Skynet begins to learn at a geometric rate. It becomes self-aware at 2:14 a.m. Eastern time, August 29.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You could also call it the \u201cI, Robot\u201d Philosophy, or the \u201cMatrix\u201d Philosophy, or the \u201cAvengers: Age of Ultron\u201d Philosophy, because they all basically have the same plot.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway, the point is\u2014the Skynet Philosophy says that we\u2019ve just unleashed something that might be marketed as a useful tool\u2014but we haven\u2019t really thought it through.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">TIMNIT: 11:40:00 I think that we should be really terrified of \u2014 of \u2014 of \u2014 of this whole thing.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">12:03:49 We should understand the harms before we proliferate something everywhere and mitigate those risks before we put something like this out there.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The second possible approach is the Coexistence Philosophy. You know: Well, this thing is here, and we\u2019ll adapt. On the Great Spectrum of Panic, seems like that\u2019s where Harvard\u2019s Jane Rosenzweig falls.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>JANE:<\/em>&nbsp;11:48: \/ I do think teaching writing will still go on. I can\u2019t predict what the next round of technology will bring, but I think it\u2019s really important for people to think about the fact that when we teach writing, we\u2019re not just teaching a set of skills that a machine can take over.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\/ A machine can do the part where it puts ideas on paper, but it can\u2019t do the part where it puts your ideas on paper. So that\u2019s \u2014 that\u2019s why I\u2019m somewhat optimistic.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway. The third possibly philosophy, you could call the Embrace Our New Overlords philosophy, perhaps best described by Stanford\u2019s Erik Brynjolfsson.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:02:00 \/ We\u2019re going to have better essays, better stories, better art, better poems, better songs than we ever had in history. This is a tool that turbocharges what we could do compared to what we did before.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You know, always in history, when some new technology comes along, like books, you know, the Greeks were like, \u201coh, my God. Stop memorizing epic \u2014 epic poems?! That\u2019s going to be terrible for our brains!\u201dOr calculators, you know. \u201cHow is that \u2014 how \u2014 no one\u2019s going to know how to like take the square root of a six digit number on but \u2014 but the pen and pencil or long division.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:06:47 \/ one of the things that I\u2019m quite convinced is that for some time, we want to keep humans in the loop, that the human and machine working together. You know, these tools, anyone who\u2019s worked with them know that they can do some amazing stuff. Sometimes they can do incredibly boneheaded stuff as well. They lie. They don\u2019t understand the world entirely.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\/and they do things that sound good on the surface, but we think more carefully aren\u2019t exactly right. So, you want to keep the human in the loop. And that cooperation of human and machine is where most of the value comes.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 00:09:05 \/ So are there other examples in history where there is some game-changing new technology that caused everybody to panic, that didn\u2019t turn out to be such a big deal?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:09:30 Well, I would say that\u2019s the norm, not the exception. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You know, he\u2019s got a point. I mean, I remember\u2014when I was in fourth grade, calculators had just been invented. And my school got a set of them. And I can remember all the parents freaking out\u2014 \u201cOur kids won\u2019t learn how to do long division anymore! They won\u2019t know how to multiply big numbers anymore!\u201dThe same kind of hysteria.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And, as it turns out\u2026they were kinda right! These days, lots of kids&nbsp;<em>don\u2019t&nbsp;<\/em>know how to do those problems, but nobody\u2019s setting their hair on fire about it. Maybe AI writing bots will be like that? They\u2019ll do most of the writing, and we\u2019ll turn our attention to other things?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Anyway\u2014sorry to interrupt there, Erik. Go on.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:18:16 you know, when cars were invented, there were accidents. You know, when fire was invented, and people got burned. \/ If you think every technology was completely 100 percent had no negative effects whatsoever, you know, progress would grind to a halt.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">00:19:50 \/ So technology has always been destroying jobs, technology has always been creating jobs, and that churn is very natural. If you want to have higher living standards, the answer is not to try to freeze in place all the existing industries and jobs and companies. \/<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">POGUE: 00:20:24 So in other words, I, as a writer, might feel momentarily like a horse and buggy driver (LAUGH) but society as a whole might wind up better off?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">ERIK: 00:20:34 Society as a whole&nbsp;<em>and<\/em>&nbsp;you individually, if you embrace these technologies, I think writers like me and you will, um, benefit from these technologies and create new kinds of content that we never were able to create before. And that could be really fun.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But you know who I&nbsp;<em>haven\u2019t&nbsp;<\/em>asked about ChatGPT\u2019s effect on the future?&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You guessed it.ChatGPT.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>&nbsp;(typing)<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cI\u2019m worried aboutChatGPT\u2019s effects on education, misinformation, and jobs.\u201d<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">KEATON: ChatGPT, like any technology, has the potential to produce harmful effects if it is not used responsibly. \/ However, the technology is meant to assist, rather than replace human creativity, critical thinking, and writing skills. It is also important to ensure that the tool is used responsibly, with clear guidelines and regulations in place.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cThank you.\u201dKEATON: You\u2019re welcome! If you have any other questions, feel free to ask.<\/p>\n<div class=\"powerpress_player\" id=\"powerpress_player_3598\"><audio class=\"wp-audio-shortcode\" id=\"audio-115-1\" preload=\"none\" style=\"width: 100%;\" controls=\"controls\"><source type=\"audio\/mpeg\" src=\"https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3?_=1\" \/><a href=\"https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3\">https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3<\/a><\/audio><\/div><p class=\"powerpress_links powerpress_links_mp3\" style=\"margin-bottom: 1px !important;\">Podcast: <a href=\"https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3\" class=\"powerpress_link_pinw\" target=\"_blank\" title=\"Play in new window\" onclick=\"return powerpress_pinw('https:\/\/www.unsungscience.com\/?powerpress_pinw=115-podcast');\" rel=\"nofollow\">Play in new window<\/a> | <a href=\"https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3\" class=\"powerpress_link_d\" title=\"Download\" rel=\"nofollow\" download=\"unsungscience-20230120.mp3\">Download<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>In early 2023, ChatGPT blew up the internet. It\u2019s an AI app that can create any piece of writing you ask for. Poems, homework, lyrics, essays, outlines, recipes, interview questions, even code. All indistinguishable from something written by a person, all instantaneous and free.<span class=\"excerpt-more-link\"><a class=\"more-link\" href=\"https:\/\/www.unsungscience.com\/index.php\/2023\/01\/20\/chatgpt-and-the-end-of-writing\/\">More <svg class=\"svg-icon\" width=\"24\" height=\"24\" aria-hidden=\"true\" role=\"img\" focusable=\"false\" viewBox=\"0 0 24 24\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path fill-rule=\"evenodd\" clip-rule=\"evenodd\" d=\"M6.96954 10.2804L11.9999 15.3107L17.0302 10.2804L15.9695 9.21973L11.9999 13.1894L8.0302 9.21973L6.96954 10.2804Z\" fill=\"currentColor\"\/><\/svg><\/a><\/span><\/p>\n<div class=\"excerpt-audio-block\">\n<figure class=\"wp-block-audio\"><audio controls src=\"https:\/\/unsung.davidpogue.com\/wp-content\/uploads\/2023\/10\/unsungscience-20230120.mp3\"><\/audio><\/figure>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,1],"tags":[],"class_list":["post-115","post","type-post","status-publish","format-standard","hentry","category-podcast","category-uncategorized","entry"],"_links":{"self":[{"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/posts\/115","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/comments?post=115"}],"version-history":[{"count":3,"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/posts\/115\/revisions"}],"predecessor-version":[{"id":283,"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/posts\/115\/revisions\/283"}],"wp:attachment":[{"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/media?parent=115"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/categories?post=115"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.unsungscience.com\/index.php\/wp-json\/wp\/v2\/tags?post=115"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}