SafetyTech | Leveraging cutting-edge technologies to create safe gaming environments for players.
The video game industry is at the forefront of inventing innovative technologies to create unique, engaging gameplay experiences and to expand what is possible in entertainment. But the industry isn’t just investing in technology for fun, it is also creating and using cutting-edge technologies with a goal of fostering positive, safe and inclusive online experiences for all players. These technologies are often enabled in the background of gaming environments, working to prevent harm before it happens. They allow the industry to proactively address inappropriate content and conduct without having to rely on players to report incidents. These technologies can work hand-in-hand with skilled human moderators who help monitor many gaming environments.
Communication-Filtering Technology can take many different forms, but the common purpose of this technology is to prevent harm before it happens by detecting inappropriate content and preventing other players from seeing it. All three console makers implement filters across game, social and/or account set-up experiences. Learn how Sony Interactive Entertainment uses communication-filtering technology.
Image-Hashing Technology helps combat child exploitation by creating digital signatures of known images of child exploitation, which are then used with filtering or matching tools to identify and detect such images on online platforms. The video game industry works with the National Center for Missing and Exploited Children (NCMEC) and law enforcement to ensure these images are properly investigated. Learn how Microsoft uses image-hashtag technology.
Other Technologies for Addressing Inappropriate Behavior include technologies that identify and prevent inappropriate content and conduct and technologies that provide players with options for how they engage with one another. Learn how Electronic Arts uses other technologies to address inappropriate behavior.
Activision Blizzard
The strength, creativity, and dedication of the talent at Activision Blizzard makes them who they are today. It’s therefore essential that they provide the leadership, innovation, and global resources to empower their employees to create amazing games. Using leading technologies is a critical part of that—especially as it pertains to ensuring the trust and safety of their player community.
Here’s a look at some highlights:
Activision’s RICOCHET Anti-Cheat initiative is a multi-faceted approach to combat cheating, featuring server-side tools that monitor analytics to identify cheating, enhanced investigation processes to stamp out cheaters, updates to strengthen account security, a kernel-level driver for PC, and more. RICOCHET Anti-Cheat is in use globally for Call of Duty: Modern Warfare III, Call of Duty: Modern Warfare II, Call of Duty: Vanguard, and Call of Duty: Warzone.
Activision has also partnered with Modulate to roll out ToxMod, an AI-powered voice chat moderation technology, to Call of Duty® in select markets. This technology detects toxic speech – including hate speech, discriminatory language, harassment, and more in real-time based on the Call of Duty Code of Conduct. Detected violations of the Code of Conduct are recorded and may require additional reviews to identify context before enforcement is determined in accordance with the Call of Duty Security and Enforcement Policy. ToxMod voice chat moderation is in beta and supports Call of Duty® Modern Warfare® II, Call of Duty® Modern Warfare® III, and Call of Duty: Warzone® English language analysis, with additional languages to be announced.
The addition of this technology bolsters Activision’s ongoing moderation efforts and systems, led by the Call of Duty anti-toxicity team. This work includes text-based filtering across 14 languages for in-game text (chat and usernames), as well as a robust in-game player reporting system.
Blizzard implemented a machine learning system to help verify player reports, resulting in a drastic decrease in disruptive chat and repeat offenses in several of its game channels. The system has also enabled them to issue penalties more quickly and has led to disruptive players leaving the channels more quickly. Alongside this technology, Blizzard utilizes dedicated communication channels and staff to facilitate player reporting.
