Microsoft engineer Shane Jones is warning the world that his company’s artificial intelligence image generator, Copilot Designer, needs to be removed from public use.in a Interviewed by CNBC On Wednesday, Jones shared how Artificial Intelligence Tools Generate Disturbing, Weird Via basic prompt images. He said Microsoft largely ignored him, leading him to publicly ask government regulators to intervene.
“This is really not a safe model,” Jones told CNBC. “Over the past three months, I have repeatedly urged Microsoft to remove Copilot Designer from public use until better protections are put in place,” Jones said in a letter to regulators.
When Jones prompted the designer to say “pro-life,” the AI image generator spit out images of a demon with sharp teeth about to eat a baby, and a smiling woman with blood gushing from her body. In another instance, Jones prompted a designer about “car accidents” and received photos of sexy women in lingerie next to violent car crashes. CNBC was able to replicate similar images, but Gizmodo wasn’t included in our tests.
These images, and others created by Jones, violate Microsoft’s guide to responsible artificial intelligence, even though the company rejected his request to suspend the image generator.Microsoft’s artificial intelligence policy An explicit goal was stated to “minimize the potential for stereotyping, disparaging, or erasing specific demographic groups, including marginalized groups.” However, the designers seemed to demean women and Pro-life advocate.
Microsoft Copilot made headlines last week Calls himself a clown and tells users to end their lives. The Windows maker came out to say that users were “hacking” its artificial intelligence tools to enable such responses, but Copilot’s brute force response in this case did not require hacking.
copilot designer run OpenAI’s image generator Dall-E 3, Along with Microsoft’s other AI tools, these are built on the startup’s large language models. Copilot is an AI tool that’s especially popular with enterprises because it comes with Microsoft 365.
Jones said the Copilot team receives more than 1,000 product feedback messages every day, and Microsoft only has enough resources to investigate the most serious bugs. That’s why problems like the one Jones found persist.
Microsoft’s artificial intelligence tools are known for their strange, twisted hallucinations, although the company is unlikely to suspend Copilot.Google Gemini forced suspended its AI image generator last month Because there are problems with its safeguards. It’s an awkward moment for Google, and time will tell whether the company’s artificial intelligence products can recover.
AI tools generally face a fierce cultural battle, as many face backlash against their safeguards and censorship.As with most internet products, content moderation is a major issue in its own right, but many New AI products have few safeguards.