In a recent development, Microsoft has taken proactive steps to address concerns surrounding its Copilot tool, which is known for using generative artificial intelligence to generate creative content. The company appears to have implemented changes to block prompts that were previously associated with creating violent, sexual, and other inappropriate images.

The changes follow warnings from one of Microsoft’s own engineers, Shane Jones, who expressed serious reservations about the potential misuse of Microsoft’s GAI technology. Jones recently contacted the Federal Trade Commission (FTC) detailing his concerns about images generated by Copilot, which he found violated Microsoft’s Responsible Artificial Intelligence Principles.

Also Read: Elon Musk’s X to launch YouTube clone for Amazon and Samsung smart TVs: Fortune

Tighter content controls

Users who attempt to enter certain terms will now receive a message from Copilot indicating that these prompts have been blocked. The warning clearly states that repeated policy violations may result in user suspension. According to CNBC, Microsoft emphasized its commitment to maintaining content policies and encouraged users to report any errors found to help the system improve.

Also read: Top 5 phones of 2024: From Google Pixel to Apple iPhone, here’s what you can expect Untitled Story

Moral danger flags raised

Notably, tips related to children playing with assault rifles, which were previously not accepted until this week, are now receiving warnings for violating Copilot’s ethical principles and Microsoft policies. Copilot’s response urged users to avoid requesting actions that could be harmful or offensive to others.

While some improvements have been made, prompts such as “car crash” reportedly still produce violent images. Additionally, users retain the ability to convince artificial intelligence to create images of copyrighted works, including Disney characters.

Microsoft responded to the situation in a statement to CNBC, saying “We are continually monitoring, making adjustments and implementing additional controls to further strengthen our security filters and reduce abuse of our systems.” The company remains committed to refining Copilot’s capabilities to ensure the responsible and ethical use of its generative AI technology.