altReboot
  • Startup
  • Growth Hacking
  • Marketing
  • Automation
  • Blockchain Tech
  • Artificial Intelligence
  • Contact
    • Write For Us
No Result
View All Result
  • Startup
  • Growth Hacking
  • Marketing
  • Automation
  • Blockchain Tech
  • Artificial Intelligence
  • Contact
    • Write For Us
No Result
View All Result
altReboot
No Result
View All Result
Home Artificial Intelligence

How Facebook uses machine learning to detect fake accounts

Guest Author by Guest Author
March 4, 2020
in Artificial Intelligence
How Facebook uses machine learning to detect fake accounts
0
SHARES
2
VIEWS
Share on FacebookShare on Twitter

This post originally appeared on MIT Technology Review

In 2019, Facebook took down on average close to 2 billion fake accounts per quarter. Fraudsters use these fake accounts to spread spam, phishing links, or malware. It’s a lucrative business that can be devastating for any innocent users that it snares.

Facebook is now releasing details about the machine learning system that it uses to tackle this challenge. The tech giant distinguishes between two types of fake accounts. One type is “user-misclassified accounts,” personal profiles for businesses or pets that are meant to be Pages. These are relatively straightforward to deal with—they just get converted to Pages.  “Violating accounts,” on the other hand, are more serious. These are personal profiles that engage in scamming and spamming or otherwise violate the platform’s terms of service. Violating accounts need to be removed as quickly as possible without casting too wide a net and snagging real accounts as well.

Related articles

Public policies in the age of digital disruption

The Biden administration’s AI plans: what we might expect

January 22, 2021
Public policies in the age of digital disruption

AI could make healthcare fairer—by helping us believe what patients tell us

January 22, 2021

To do this, Facebook uses hand-coded rules and machine learning to block the creation of a fake account either before it is created or before it becomes active. In other words, before it can harm real users. The final stage is after a fake account has gone live. This is when detection gets a lot trickier and where the new machine-learning system, known as Deep Entity Classification (DEC), comes in.

Going deep

DEC learns to differentiate fake and real users based on their connection patterns across the network. It calls these “deep features,” and they include things like the average age or gender distribution of the user’s friends. Facebook uses over 20,000 deep features to characterize each account, providing a snapshot of how each profile behaves to make it difficult for attackers to game through changing tactics.

The system starts by using a large amount of low-precision machine-generated labels. These are generated through a mix of rules and other machine-learning models that estimate whether users are real or fake. Once that data is used to train a neural network, the model is then fine-tuned with a small batch of high-precision hand-labeled data, generated by people based around the world who have an understanding of local cultural norms.

Sign up for The Algorithm — artificial intelligence, demystified

The final classification system can identify one of four types of fake profiles: illegitimate accounts not representative of the person, compromised accounts of real users who have been taken over by attackers, spammers who repeatedly send revenue-generating messages, and scammers who manipulate users into divulging personal information. Since implementing DEC, Facebook says it has reduced the volume of fake accounts on the platform by 27%, from 5.2 to 3.8% of monthly active users.

The details of Facebook’s cleanup efforts come amid concerns about manipulation in the upcoming US presidential election, especially around deepfakes. In December, the New York Times reported a coordinated disinformation campaign using deepfakes to spin up fake accounts en masse with convincing profile pictures.

Safeguarding the election

The Facebook team said the timing of its release was only a coincidence. “This is about just spotting violations in general; it’s not specifically targeted at any kind of election topics,” says Daniel Bernhardt, the engineering manager of Facebook’s Community Integrity team. But the DEC would be complementary to the platform’s other efforts to clamp down on election tampering. Because the system relies on deep features to categorize each profile, it will be resilient to being fooled by deepfake profile images, for example.

Aviv Ovadya, who founded the nonprofit Thoughtful Technology Project and studies platform design and governance, says that Facebook’s effort to be more transparent with their cleanup procedures is commendable. “It can be really useful and powerful to carefully talk about architectural decisions—and the ways in which security systems work—that can be emulated by other companies,” he says. “Because companies like Facebook have significantly more resources to invest than smaller companies, it’s useful to have this knowledge sharing.”

But Facebook’s cleanup efforts also have a long way to go. With 2.5 billion monthly active users, 3.8% is still nearly 100 million fake accounts. Machine learning approaches will also only go so far: no matter how much data a model is trained on, it won’t ever catch every bad account with perfect precision. The platform will likely need to turn to other combinations of humans and machines to improve its detection and takedowns.

ShareTweet

Related Posts

Public policies in the age of digital disruption

The Biden administration’s AI plans: what we might expect

by Karen Hao
January 22, 2021
0

On Wednesday, the US waited with baited breath as president Trump handed the government reins over to president Biden. The...

Public policies in the age of digital disruption

AI could make healthcare fairer—by helping us believe what patients tell us

by Karen Hao
January 22, 2021
0

In the last few years, research has shown that deep learning can match expert-level performance in medical imaging tasks like...

Transforming the energy industry with AI

Transforming the energy industry with AI

by Jason Sparapani
January 21, 2021
0

For oil and gas companies, digital transformation is a priority—not only as a way to modernize the enterprise, but also...

Public policies in the age of digital disruption

AIs that read sentences can also spot virus mutations

by Will Heaven
January 14, 2021
0

Galileo once observed that nature is written in math. Biology might be written in words. Natural language processing (NLP) algorithms...

These five AI developments will shape 2021 and beyond

These five AI developments will shape 2021 and beyond

by Jason Sparapani
January 14, 2021
0

The year 2020 was profoundly challenging for citizens, companies, and governments around the world. As covid-19 spread, requiring far-reaching health...

Load More
  • Trending
  • Comments
  • Latest
7 Advanced SEO Strategies I’m Trying to Implement Before 2020

7 Advanced SEO Strategies I’m Trying to Implement Before 2020

September 10, 2019
What Do Successful Sales Look Like for the Rest of 2020?

13 Expert Tips to Increase Online Conversions in 2020

September 26, 2020
Creating SEO-friendly how-to content

Creating SEO-friendly how-to content

October 24, 2019
8 Simple Steps to Use Your Book to Grow Your Business

8 Simple Steps to Use Your Book to Grow Your Business

September 10, 2019
A Beginner’s Guide to Facebook Insights

A Beginner’s Guide to Facebook Insights

0

Which Social Media Sites Really Matter and Why

0
The 12 Ironclad Rules for Issuing Press Releases

The 12 Ironclad Rules for Issuing Press Releases

0
How to Get Started Building Links for SEO

How to Get Started Building Links for SEO

0
Finding the Good in Bad Times (AKA 2020)

Finding the Good in Bad Times (AKA 2020)

January 23, 2021

How to Start an Online Store

January 23, 2021
How to Prevent Facebook Hacks

How to Prevent Facebook Hacks

January 22, 2021
Why Entrepreneurs Need Writing Skills (and How to Improve Yours)

Why Entrepreneurs Need Writing Skills (and How to Improve Yours)

January 22, 2021
altReboot




altREBOOT is committed to sharing the game changing advancements that are revolutionizing how you do business. From startup to goliath, innovations in technology are changing the face of the business landscape. We are committed to exploring these and how to apply them to your business at any stage of development.





Categories

  • Artificial Intelligence
  • Blockchain Tech
  • Growth Hacking
  • Marketing
  • Startup
  • Uncategorized

Tags

blockchain branding guest post marketing mobile apps
  • Home
  • Topics
  • Write For Us
  • Privacy Policy
  • Contact

Powered By Treehouse 51

No Result
View All Result
  • Startup
  • Growth Hacking
  • Marketing
  • Automation
  • Blockchain Tech
  • Artificial Intelligence
  • Contact
    • Write For Us