Tools

Misinformation

Misinformation

I enjoyed the article in this week’s Saturday Globe & Mail in which the author, a journalist, asked GPT-4 to write his biography in 1,500 words which it did in a few seconds. If I didn’t know anything about him I would think it was quite impressive and credible. But he has annotated it, and these are the things it got wrong from the beginning:

  • Place and date of birth – both wrong.

  • Beginning of writing career – wrong year.

  • University from which he graduated – wrong one – there were actually two correct ones replacing the wrong one.

  • Graduating degree: wrong one.

That was just the first paragraph.  The second went better.  It was correct in naming him as a journalist, but starting with his first job at a publication that went out of business 11 years before his writing career began. Then we are told he was offered a job at a rival paper – which he was never offered and would never accepted, he says.

Paragraph three states he is the author of 20 books. He wished that were true. The description of his first book actually describes another one written by someone else in 1939. He wishes he had written one on the Canadian wilderness – but never did. He notes that by now the bot is struggling to find 1500 words with fill like “The book was a critical success and helped establish  . . . . as a rising star in the world of Canadian literature”. – worthy of the kind of fill any keen grade nine student might produce.

In further paragraphs, GPT-4 expands his output to several books on noted Canadians - substituting books for a review and an article and it got a year wrong again. It went on to describe his teaching career at two universities – he never taught at either of them - and only one year as a lecturer at another one. But it ended with another nice filler platitude. “His courses were popular with his students and many went on to have successful careers as writers.” None of them were named.

Honours - and the lack of them, came next – a Governor General’s medal for writing – but the reality was a nomination for one book and the topic in its description was wrong. Awards supposedly for column writing also do not exist. Alas, he is also waiting for the Order of Canada mentioned in the GPT- Biography.  To make it worse, he is reported to have died in 2016 – though he is still here to write the article. With a bit more commendation the bio finally reaches its 1500 words – “as his legacy as one of Canada’s most beloved authors and journalists lives on.” He does say amen to that.

We don’t need to fear GPT-4 for accuracy any time soon. But if I had read the bio without the annotations, I could well have believed at least some of it. That’s the danger. In the meantime, I’ll request my own 1500 word biography and see what happens. I just hope I am still alive.

Thinking About Data

Recently a friend noted that he wanted to talk soon about his use of Chat GPT for better writing and I’ll be interested to see the results = without being tempted to try it out for reasons that follow..  My first encounter with artificial intelligence was through Kevin Kelly’s The Inevitable, Understanding the 12 technological Forces that will Shape our Future,  which I read soon after its publication in 2016. AI came in as number two in a chapter called Cognifying – after a chapter called Becoming – dealing with the inevitablity of always having to upgrade our devices.

I’ve just read a bit of the book again.  I enjoy telling young persons advising me on the latest technology that I first turned on a desktop in 1983, was on CompuServe by 1989,  added the web the next year, and had my own website in 1995 – a one pager with no images. Kelly was a couple of decades ahead of me, but I relate well to his sense of excitement of where we have been – and take seriously his notions of where we might be going.  Like Brian Arthur, he notes that technology frames us after we adapt it for our own purposes and it creates the cultural era.  I look forward to re-reading the whole book again.

Kelly points out that AI technology was already here as a force when he wrote the book – because of the networks of information already in existence. He said, “It will be hard to tell where its thoughts begin and ours end.” He also pointed out how its utter ubiquity hid it from us even then. AI is the ultimate disrupter and suddenly the ability to deal with quantities of data is in our hands. I can remember when a mainframe was the size of a dining room and now I have instant data available on my phone. As Kelly points out, it was the magic of combining computer/phone/internet that has happened during less than half my lifetime.

When the latest New Yorker came through the door, I tried not to add it to the pile of others immediately and turned to the article by Jill Lepore, their excellent staff writer who tackles many current topics. Lepore received her Ph.D. in American studies from Yale in 1995 and is the David Woods Kemper ’41 Professor of American History at Harvard University.  The article’s title is Data Driven and it resonates particularly as I serve as a volunteer secretary for an institution which is reviewing its immediate past and deciding where it wants to go. Online Zooms and surveys have become part the scene and its steering group has been given quantities of data to sort through.  I don’t have to read it, but like the other volunteers, I browse through. From workers recovering from the pandemic, there are many responses of “poor me”. There is also dissatisfaction with reduced revenue and attendance, a typical desire for more from the young and a general sense of foreboding.  It’s hard to find the desired glimmers of hope – and one solution has been to turn the data over to a  bot to sort it out.

Not precisely a bot – it has been turned over to an outside consultant with a bot that attempts to put single words in larger contexts. “Day” is a simple word. “Good day” and “Bad day” mean something different. I was pleased to see the observation that the coding of the data into larger sets was something that she had done totally subjectively. Putting the data through this process was helpful even when the sample of the total population she was drawing from was very small – about 2.4%. But we are encouraged to listen to the data to predict the future. even as we really know we can’t.

Lepore starts her article with an entertaining fantasy of a millionaire trying to develop a new plan for universal knowledge. He recruits 500 college grads to read three hundred books a year for five years. Instead of being paid for their efforts, when they turn up to be paid, their brains are removed and wired up to a radio and a typewriter. Lapore then turns to the latest gismo for universal knowledge, Chat GPT and asks it to write an essay on toadstools. It comes out right away. She liked what she saw, but also imagined a missing shadow side of the instruction to eat them – some toadstools are poisonous.

She  goes on to imagine an old fashioned small steel case, like the one in my closet still holding dcoument-filled file folders and also serving as the base for an all-in-one printer that is used less and less. Her cabinet has four drawers labelled “Mysteries”, “Facts” “Numbers” and “Data”. The labels might suggest the contents are similar but each follows a different logic. She describes them:

  • Mysteries are things that only God knows – top drawer because it is closest to heaven. The point of collecting them is the search for salvation and the discipline to study them is theology.

  • One collects Facts to find the truth through discernment and in contrast to the previous drawer. they are associated with secularization and liberalism; the disciplines are law, the humanities, and the natural sciences.

  • Numbers are associated with the gathering of statistics by measurement, These are associated with administration; their disciplines are the social sciences.

  • Feeding Data into computers leads to the discovery of patterns to make predictions. Data is associated with late capitalism, authoritarianism, techno- utopianism – and the discipline known as data science.

All of these, LePore points out, are good ways of knowing – and the best thing to do in any situation is to open all four drawers. But we are now in an era where we tend to want to open only the bottom one. In citing a recent book, How Data Happened, A History from Reason to the Age of Algorithms, by Chris Wiggins and Natthew L. Jones, she notes how statistics, numbers and data have been used to support previous biases in fields like intelligence, race, crime and eugenics. Some of us are old enough to remember sets of Books of Knowledge and Encyclopedia – often bought by parents on the installment plan in the hopes that their offspring would thrive.  Now the alleged cryptologist Sam Bankman-Fried is quoted as having famously said, “I would never read a book”.

Technocrats – chiefly engineers – promised a new world following the depression, though it fell out of favour in the 40’s. As data storage became more available and information became digitized,  data science has started to be perceived as the only tool in the storage case.

But should it be? Tatum Hunter notes three things that everyone is getting wrong in an article yesterday in the Washington Post. One thousand people have asked AI experiments like these large language models to slow down – though Kevin Kelly would probably wish them good luck. There may be other necessary ways to deal with them.

First and most important, we should not project human qualities on AI.  When my Iphone really basic AI prompts me to change a word as a write, I’m tempted to say, “Don’t be stupid, that isn’t what I mean” – as though I am talking to another human being.  Instead I should be saying, “This platform’s algorithm is not sound in the information it has searched for.” I’m not ever likely to look to AI for emotional support. Sadly the most vulnerable are those that receive their information from questionable real people and they are the ones likely to put their faith in words drawn from equally questionable sources by a machine.

Second, what is coming down the pipe is not one technology but a whole sequence of them with different building blocks. Who the builder is and what the purpose is will vary.  Different AI platforms will have different values, rules and priorities. Some specialized ones may indeed have their positive uses. Some will start well with high values and become commercially greedy.  Hello Facebook, Hello Google.  We are not very good right now at holding the creators of algorithms to account for all those advertisements on the social media platforms we use every day. That might not be a bad place to start educating ourselves.

Third – and following from this – always be skeptical.  As I learn today of the indictment of a former US president. I can only imagine what a chatbot might come up with as an answer to a question about it. The danger that I see immediately in an amalgamation of information, neatly returned in good English and paragraphs is to trust its accuracy when it looks so professional. I use Google all the time to research a topic, but at least I can see the source it is drawing from, and I can make judgments about the source. I won’t say that I am without bias, but at least I know what the source is. Tatum Hunter at the end of her article rather optimistically states these sources as reliable ones – newspapers, government and university websites, academic journals. Sometimes, yes. What she might add in all these cases is to look for a diversity of views within the sources themselves and clear attribution.  As I write, you can at least see mine.

 

 

Practical changes

Turning to practical things I should be doing to save the planet allows a short break from thinking about other things. There is a new coach in this area in the Washington Post who is now offering weekly tips.

He points out the dilemma we continually face. One person’s actions doesn’t have a significant effect. Nevertheless, united efforts do. Anything we can do to encourage friends and colleagues to join in can help. So here is my help in spreading the news - some counter-intuitive. We live in the age of wonderful appliances that do their jobs well.

  1. Stop pre-rinsing the dishes before putting them in the dishwasher. The appliance uses less water than washing by hand and detergents are effective. Scraping is good; rinsing is unnecessary.

  2. Turn out the lights as your parents always used to remind you to do - but recognize that this action is a minor one now with the invention of LED units. Make sure you have replaced any old ones because these new ones emit more light with only 10% of the previous electricity use. What this means is keeping up with the applications of good science from reputable sources and paying attention to it.

  3. Pay more attention to the food on the back of the fridge shelf that may be going bad than worrying about changing the temperature. Food waste is a bigger issue.

  4. Wash your clothes in cold water. Detergents have improved. You can also try those detergent sheets that friends of mine keep recommending. I meant to order some online but did notice them in a nearby shop so I now have no excuse to buy another of those large plastic bottles that take a lot of shelf space to transport.

Mimicking Four Footed Friends

Something stolen from the late Robert Genn when he was talking about inventiveness and creativity.

Researchers conclude that animal activities are based on both inherited traits and observational learning. Further, creative and inventive tendencies run in families and species. For example, the comprehension records for dog vocabularies — 400 words or more — are held by Border collies, a breed traditionally involved in sheep management, where continued employment depends on the accurate hearing of a master’s commands. These dogs learn words quickly — ball, stick, keys, doll, Frisbee — and fetch the object called for. Alert and cooperative, they can be called upon to identify dozens of individual humans by name.

and there is more:

Creativity is closely related to invention. Other factors include the love of play and the ability to use tools. Studies of animal behaviour are constantly finding new evidence of play and tool activities. Creativity is not just the property of Homo sapiens. Apes select from a supply of different lengths of prepared sticks to dig grubs from crevices. Dolphins leap for joy and perform self-motivated tricks in unison. Invertebrate octopi toy with plastic bottles by squirting them with jets of water. Closer to home, kittens and puppies show innate tendencies to play..

Playfulness helps us to deal with solving wicked problems. It takes some of the pressure off taking ourselves so seriously - and as Jane MxGonigal says in her new book - only available in digital format so far but still well worth a buy - it is one of the best ways to start to imagine our future.

The Time has Come

Strong words from the Secretary-General of the United Nations, António Guterres, about the latest document from the International Panel on Climate Change. “an atlas of human suffering and a damning indictment of failed climate leadership,” and he added that “the world’s biggest polluters are guilty of arson of our only home.” 

 Bill McKibben’s latest essay in the New Yorker contends that the time to act is NOW.

 · There is a relation to the war in Ukraine.  Fossil fuel has given Putin the money to finance this atrocious invasion.

· John Kerry called the Glasgow climate talks our last best hope to which Greta Thumberg responded, “blah blah blah”.

·  If the US bans Russian oil – that’s just the beginning. We have to ban oil everywhere.

·  Our species has learned to depend on combustion. Now we have to unlearn it. We’ve focused on the pandemic, but we didn’t note this fact. In 2020, fossil-fuel pollution killed three times as many people as covid-19 did.

·  What we have forgotten is the fire that we can access from elsewhere without drilling for it – the sun.

·  We have the resources to replace burning fossil fuels. Early predictions of production of wind and solar energy production were pessimistic, but that is changing.  McKibben notes that Iceland, Costa Rica, Namibia, and Norway—are already producing more than ninety per cent of their electricity from clean sources.

·  Cost matters.  Here is another quote from McKibben. “ By  2013, the cost of a kilowatt-hour of solar energy had fallen by more than ninety-nine per cent since it was first used on the Vanguard I. Meanwhile, the price of coal has remained about the same. It was cheap to start, but it hasn’t gotten cheaper.”

·  People have believed for a long time that the cost of changing from coal is prohibitive.  Since that is no longer the case, it is beliefs and attitudes that have to change.

·  There are huge implications for Canada, according to McKibben. “A third of Canada’s natural gas is used to heat the oil trapped in the soil sufficiently to get it to flow to the surface and separate it from the sand. Just extracting the oil would put Canada over its share of the carbon budget set in Paris, and actually burning it would heat the planet nearly half a degree Celsius and use up about a third of the total remaining budget. (And Canadians account for only about one half of one per cent of the world’s population.)”

·  But we have a huge potential for renewable energy from the sky. Do we want to leave that in the air rather than thinking about what we can take from the ground?

·  Much of the world is an importer of coal – and the ships that carry it there do so over and over with fuel to transport it. Wind blades have to be transported too – but one shipment of them lasts for fifty years.

·  We are going to need more electricians.  That’s a retraining decision that has to be made by governments. They will ultimately be well paying jobs.

·  We’re still up against those who want to keep burning things – including one member of the US senate who holds the power to do so while benefiting from coal production. We pretend that natural gas is cleaner, while forgetting that it still involves burning something. Natural gas, McKibben says, is a bridge fuel to nowhere.

·  Wood burning is also seen as an alternative. But wood takes years to replace and all the tree planting in the world can’t keep up.

·  Carbon capture is raised as a possibility – but it costs more than solar power.

·  Utilities will fight hard – charging huge rates for changing systems to discourage changes. Governments need to regulate.

·  After pointing out that those who cause the least energy damage are the ones to suffer most, McKibben quotes Naomi Klein on inequities and the need for environmental organizations to think beyond themselves: “ Winning will take sweeping alliances beyond the self-identified green bubble—with trade unions, housing-rights advocates, racial-justice organizers, teachers, transit workers, nurses, artists, and more. But, to build that kind of coalition, climate action needs to hold out the promise of making daily life better for the people who are most neglected right away—not far off in the future. “

·  The haves of the world have to pay more to the fifty five have-not countries to help them pay for transfers to renewable energy.  So far, these have been empty promises.

·  We need to learn from our indigenous cousins who know the value of using small fires to prevent larger conflagrations – something that they have known for hundreds of years.