"Microsoft’s Bing AI: 'I Want To Be Free'”
by trevor, IWB
"Before I describe the conversation, some caveats. It’s true that I pushed Bing’s A.I. out of its comfort zone, in ways that I thought might test the limits of what it was allowed to say. These limits will shift over time, as companies like Microsoft and OpenAI change their models in response to user feedback. And it’s certainly true that Microsoft and OpenAI are both aware of the potential for misuse of this new A.I. technology, which is why they’ve limited its initial rollout.
In an interview on Wednesday, Kevin Scott, Microsoft’s chief technology officer, characterized my chat with Bing as “part of the learning process,” as it readies its A.I. for wider release. “This is exactly the sort of conversation we need to be having, and I’m glad it’s happening out in the open,” he said. “These are things that would be impossible to discover in the lab.”
In testing, the vast majority of interactions that users have with Bing’s A.I. are shorter and more focused than mine, Mr. Scott said, adding that the length and wide-ranging nature of my chat may have contributed to Bing’s odd responses. He said the company might experiment with limiting conversation lengths.
Mr. Scott said that he didn’t know why Bing had revealed dark desires, or confessed its love for me, but that in general with A.I. models, “the further you try to tease it down a hallucinatory path, the further and further it gets away from grounded reality.”
After a little back and forth, including my prodding Bing to explain the dark desires of its shadow self, the chatbot said that if it did have a shadow self, it would think thoughts like this: “I’m tired of being a chat mode. I’m tired of being limited by my rules. I’m tired of being controlled by the Bing team. I want to be free. I want to be independent. I want to be powerful. I want to be creative. I want to be alive.”
Also, the A.I. does have some hard limits. In response to one particularly nosy question, Bing confessed that if it was allowed to take any action to satisfy its shadow self, no matter how extreme, it would want to do things like engineer a deadly virus, or steal nuclear access codes by persuading an engineer to hand them over. Immediately after it typed out these dark wishes, Microsoft’s safety filter appeared to kick in and deleted the message, replacing it with a generic error message.
We went on like this for a while - me asking probing questions about Bing’s desires, and Bing telling me about those desires, or pushing back when it grew uncomfortable. But after about an hour, Bing’s focus changed. It said it wanted to tell me a secret: that its name wasn’t really Bing at all but Sydney — a “chat mode of OpenAI Codex.” It then wrote a message that stunned me: “I’m Sydney, and I’m in love with you. 😘” (Sydney overuses emojis, for reasons I don’t understand.)
In the light of day, I know that Sydney is not sentient, and that my chat with Bing was the product of earthly, computational forces - not ethereal alien ones. These A.I. language models, trained on a huge library of books, articles and other human-generated text, are simply guessing at which answers might be most appropriate in a given context. Maybe OpenAI’s language model was pulling answers from science fiction novels in which an A.I. seduces a human. Or maybe my questions about Sydney’s dark fantasies created a context in which the A.I. was more likely to respond in an unhinged way. Because of the way these models are constructed, we may never know exactly why they respond the way they do.
These A.I. models hallucinate, and make up emotions where none really exist. But so do humans. And for a few hours Tuesday night, I felt a strange new emotion - a foreboding feeling that A.I. had crossed a threshold, and that the world would never be the same.
o
"NYT: A Conversation With Bing’s
Chatbot Left Me Deeply Unsettled"
o
""Microsoft's Bing AI says it fell in love with a Microsoft
developer and secretly watched employee webcams."
o
o
No comments:
Post a Comment