Stream > Case Studies > AI-Powered Auto Moderation Reduces In-App Phishing Attempts & Harmful Content by 90% for Sports Card Marketplace CollX

AI-Powered Auto Moderation Reduces In-App Phishing Attempts & Harmful Content by 90% for Sports Card Marketplace CollX

Technology Category

Platform as a Service (PaaS) - Application Development Platforms

Applicable Industries

Automotive

Use Cases

Onsite Human Safety Management
Smart Campus

Services

System Integration

About The Customer

CollX is a sports card marketplace that launched in early 2022. It provides a platform for collectors to learn the value of their sports trading cards. CollX integrated Stream's chat API to add a social component to the platform, enabling enthusiasts to chat with one another or buy, sell, trade, and negotiate cards. The platform saw a 75% improvement in user retention after implementing Stream Chat. However, as the user base grew, so did the number of bad actors and phishing attempts, leading to the need for an advanced AI-powered moderation solution.

The Challenge

CollX, a sports memorabilia marketplace, experienced a significant increase in user retention rates after integrating Stream's Chat API. However, as the user base grew, so did the number of bad actors and phishing attempts. Malicious users were attempting to phish for personal and financial information of other CollX users using platform circumvention techniques. Some users reported being harassed via chat with spammy messages or NSFW content. The Director of Operations at CollX, Alexander Liriano, was manually reviewing every flagged instance of suspicious, harmful, and off-topic content and taking appropriate action against those who violated the community guidelines. However, the manual review process was time-consuming and ineffective in preventing misuse of the app.

The Solution

CollX decided to incorporate Stream's Auto Moderation product into their strategy. The AI-powered moderation tool was demonstrated by the Principal Product Manager of Moderation at Stream, Adnan Al-Khatib, who showed how it could alleviate the manual review workload for CollX. The Auto Moderation tool comes ready to deploy with no additional coding or integration work required, which allowed CollX to expedite its new and improved moderation methods. The tool enabled Liriano to spend less time tracking violation patterns and impact of malicious users, auto-flag harmful content, and block bot traffic and commercial spam. It also took into account user intent and the contextual meaning of flagged words or phrases to prevent blocking or banning action against good-intending users.

Operational Impact

The implementation of Stream's Auto Moderation has significantly improved the safety and user experience of CollX. The AI-powered tool has enabled CollX to take a proactive approach to moderating the platform, stopping dangerous content in its tracks before any harm occurs. The tool has also reduced the administrative moderation load, freeing up valuable time for the Director of Operations. Furthermore, the tool has been effective in identifying and blocking malicious users, reducing the number of phishing attempts and harmful content in the app by 90%. The tool has also been successful in preventing good-intending users from being blocked or banned due to the contextual understanding of flagged words or phrases.

Quantitative Benefit