{"id":114394,"date":"2018-11-28T22:29:02","date_gmt":"2018-11-28T22:29:02","guid":{"rendered":"http:\/\/sftarticles.wpenginepowered.com\/en\/?p=114394"},"modified":"2025-07-01T22:41:22","modified_gmt":"2025-07-02T05:41:22","slug":"facebook-offensive-content","status":"publish","type":"post","link":"https:\/\/cms-articles.softonic.io\/en\/facebook-offensive-content\/","title":{"rendered":"Inside Facebook&#8217;s battle against offensive content"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-114712\" src=\"https:\/\/articles-img.sftcdn.net\/sft\/articles\/auto-mapping-folder\/sites\/3\/2018\/11\/facebook-700.jpg\" alt=\"\" width=\"700\" height=\"560\" srcset=\"https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/facebook-700.jpg 700w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/facebook-700-300x240.jpg 300w\" sizes=\"auto, (max-width: 700px) 100vw, 700px\" \/><\/p>\n<p class=\"p1\">Facebook announced last month that it will begin implementing some new features aimed at helping users keep their feeds clear of <a href=\"https:\/\/newsroom.fb.com\/news\/2018\/10\/protecting-people-from-bullying\/\"><span class=\"s1\">bullying and harassment<\/span><\/a>.<\/p>\n<p class=\"p1\">One new addition is that users now have the option to ask for a second review of content that has been reported for harassment or bullying. In the past, this option was only available for those reportedly in violation of the platform\u2019s policies regarding sexual activity, hate speech, nudity, or graphic violence.<\/p>\n<p class=\"p1\"><strong>Now, alleged harassers can ask the moderators for a second review if they feel that their content was unfairly removed.<\/strong><\/p>\n<p class=\"p1\">The changes are welcome, and include things like the ability to quickly delete or hide multiple comments at a time and added protection for public figures.<\/p>\n<p class=\"p1\">Still, knowing that the reviewers must look at roughly 10 million pieces of mostly unsavory content, we wonder if the process is getting better at all.<\/p>\n<p>Here&#8217;s a bit more about where Facebook is at when it comes to improving the moderation process.<\/p>\n<h2 class=\"p1\">What we know about Facebook&#8217;s content review process<\/h2>\n<p class=\"p1\">In recent months, there has been a ton of coverage on the topic of Facebook&#8217;s content moderation. From a <a href=\"https:\/\/www.wnycstudios.org\/story\/post-no-evil\"><span class=\"s1\">RadioLab episode<\/span><\/a> that dove deep into the company\u2019s ever-changing and relatively mysterious policies to <a href=\"https:\/\/motherboard.vice.com\/en_us\/article\/xwk9zd\/how-facebook-content-moderation-works\"><span class=\"s1\">Motherboard\u2019s expansive look<\/span><\/a> at the challenges that come with trying to maintain community standards when that community happens to be larger than many countries.<\/p>\n<p class=\"p1\"><strong>There are 60 people on the Facebook team hired exclusively to write and revise the content moderation policy alone.<\/strong> The policy, in its current form, is a <a href=\"https:\/\/www.facebook.com\/communitystandards\/introduction\/\" target=\"_blank\" rel=\"noopener noreferrer\">sprawling 27 pages<\/a>, which aims to balance user safety with free speech.<\/p>\n<p class=\"p1\">Within that document, you&#8217;ll find a super-specific set of instructions for the company\u2019s team of moderators, and they\u2019re constantly shifting. For example, where nudity is generally a no-go on the site, there are some exceptions to the rule\u2014such as adult nudity in historic Holocaust photos and in some cases, images of certain art pieces.<\/p>\n<p class=\"p1\">Facebook also bans terrorist content, non-medical drug use, and <a href=\"https:\/\/www.theguardian.com\/news\/gallery\/2017\/may\/24\/hate-speech-and-anti-migrant-posts-facebooks-rules\" target=\"_blank\" rel=\"noopener noreferrer\">hate speech<\/a>, though content with similar intentions (i.e. offensive speech without the explicit use of a racial slur) can make it onto the platform. <strong>A\u00a0<a href=\"https:\/\/www.theguardian.com\/news\/2017\/may\/25\/facebook-moderator-underpaid-overburdened-extreme-content\" target=\"_blank\" rel=\"noopener noreferrer\">group of 7,500 moderators<\/a> sifts through flagged posts manually<\/strong>, earning roughly $15 per hour to view what is arguably the worst content on the planet.<\/p>\n<p>But, that might be changing soon.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-114462 size-large\" src=\"https:\/\/articles-img.sftcdn.net\/sft\/articles\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.16.54-PM-2-1024x617.png\" alt=\"facebook defines hate speech\" width=\"840\" height=\"506\" srcset=\"https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.16.54-PM-2-1024x617.png 1024w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.16.54-PM-2-300x181.png 300w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.16.54-PM-2-768x463.png 768w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.16.54-PM-2-1200x723.png 1200w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.16.54-PM-2.png 1218w\" sizes=\"auto, (max-width: 840px) 100vw, 840px\" \/><\/p>\n<h2 class=\"p1\">AI could step in to save the day<\/h2>\n<p class=\"p1\">After reports came out that\u00a0<a href=\"https:\/\/arstechnica.com\/tech-policy\/2018\/09\/ex-facebook-moderator-sues-facebook-over-exposure-to-disturbing-images\/\"><span class=\"s1\">content moderators were suffering from PTSD<\/span><\/a>, it\u2019s no surprise that one of Facebook\u2019s primary goals is moderating its content with AI.<\/p>\n<p class=\"p1\">While the effort is bound to put some moderators out of a job, the idea is that algorithms will shoulder the burden of filtering through the worst content \u2014 reportedly VERY disturbing at times \u2014 so humans don\u2019t have to deal with it.<\/p>\n<p class=\"p1\">The other benefit for Facebook is, they can once again cover their policies in a shroud of secrecy. Leaked documents, if you remember, have been the reason that any of Facebook\u2019s policies have seen the light of day. Swapping out live bodies for algorithms could mitigate any risk of loose lips sinking ships.<\/p>\n<p class=\"p1\">On the flip side, the AI does have some limits. For example, it can only block content that looks like something it has already seen. So new forms of violence from say, a terrorist group might still make it through the filter.<\/p>\n<h2 class=\"p1\">The black and white rules could be on the way out, too<\/h2>\n<p class=\"p1\">Facebook has long operated in very black and white terms when it comes to determining whether a piece of content violates its rules or not.<\/p>\n<p class=\"p1\">Last year, Facebook\u2019s 25 content moderation guidelines were revealed, among them that controversial protected group quiz\u2014 asking \u201cWho do we protect: black children or white men?\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-114460 size-large\" src=\"https:\/\/articles-img.sftcdn.net\/sft\/articles\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.14.29-PM-2-1024x701.png\" alt=\"Facebook content moderation question\" width=\"840\" height=\"575\" srcset=\"https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.14.29-PM-2-1024x701.png 1024w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.14.29-PM-2-300x205.png 300w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.14.29-PM-2-768x526.png 768w, https:\/\/articles-img.sftcdn.net\/auto-mapping-folder\/sites\/3\/2018\/11\/Screen-Shot-2018-11-25-at-3.14.29-PM-2.png 1192w\" sizes=\"auto, (max-width: 840px) 100vw, 840px\" \/><\/p>\n<p class=\"p1\">The question was blasted on ProPublica and sparked a great deal of outrage and has since been removed from training materials.<\/p>\n<p class=\"p1\">But the rules-based approach has been the source of many problems plaguing the company over the past few years. 2016\u2019s influx of <a href=\"http:\/\/en.softonic.com\/articles\/10-tricks-for-spotting-fake-news\/\" target=\"_blank\" rel=\"noopener noreferrer\">fake news<\/a>, for example, didn\u2019t contain any nudity or outright hate speech, even though the underlying intent was to generate clicks by way of inciting outrage.<\/p>\n<p class=\"p1\">CEO Mark Zuckerberg <a href=\"https:\/\/www.facebook.com\/notes\/mark-zuckerberg\/a-blueprint-for-content-governance-and-enforcement\/10156443129621634\/\" target=\"_blank\" rel=\"noopener noreferrer\">recently posted<\/a> that &#8220;content that doesn\u2019t explicitly violate the rules&#8221; may be reduced. Meaning, the company may curb reach on offensive posts that <em>don\u2019t quite<\/em> qualify as hate speech. But <strong>there is no definitive path forward or broad agreement on what is hate speech and what is not<\/strong>, especially given the wide range of cultural norms that come into play.<\/p>\n<p class=\"p1\">Today, we&#8217;re looking at issues like people being <a href=\"https:\/\/www.vanityfair.com\/news\/2018\/08\/facebooks-hate-speech-problem-may-be-bigger-than-it-realized\"><span class=\"s1\">driven to violence<\/span><\/a> after viewing content on Facebook. Or the platform\u2019s disturbing role in <a href=\"https:\/\/www.reuters.com\/investigates\/special-report\/myanmar-facebook-hate\/\"><span class=\"s1\">ethnic violence against the Rohingya community<\/span><\/a> in Myanmar. As such, it seems we&#8217;ll need to find a solution sooner rather than later.<\/p>\n<p class=\"p1\">Zuckerberg is floating the idea of an independent oversight group, a group that would operate as an outside panel of reviewers, much like a <a href=\"https:\/\/www.theverge.com\/2018\/4\/2\/17187974\/mark-zuckerberg-community-content-removal-appeal-vox-interview\" target=\"_blank\" rel=\"noopener noreferrer\">Supreme Court<\/a>. However, some critics feel that this might offload some of the platform&#8217;s responsibility.<\/p>\n<div class=\"sc-card-starred-link\">\r\n  <div class=\"sc-card-starred-link__body\">\r\n    <div class=\"sc-card-starred-link__row clearfix\">\r\n      <div class=\"sc-card-starred-link__col-logo\">\r\n        <img decoding=\"async\" class=\"sc-card-starred-link__img\" src=\"https:\/\/articles-img.sftcdn.net\/sft\/articles\/auto-mapping-folder\/sites\/3\/2018\/03\/delete-facebook-192.jpg\" width=\"100px\" height=\"100px\">\r\n      <\/div>\r\n      <div class=\"sc-card-starred-link__col-title\">\r\n        <p class=\"sc-card-starred-link__title\">6 social media apps that are better than Facebook<\/p>\r\n        <a class=\"sc-card-starred-link__button\" href=\"https:\/\/en.softonic.com\/articles\/6-social-media-apps-that-are-better-than-facebook\/\" target=\"_blank\" rel=\"noopener noreferrer sponsored\">Read Now \u25ba<\/a>\r\n      <\/div>\r\n    <\/div>\r\n    <a class=\"sc-card-starred-link__link\" href=\"https:\/\/en.softonic.com\/articles\/6-social-media-apps-that-are-better-than-facebook\/\" target=\"_blank\" rel=\"noopener noreferrer sponsored\"><\/a>\r\n  <\/div>\r\n<\/div>\n<h2 class=\"p1\">Wrapping up<\/h2>\n<p class=\"p1\">In the end, the challenge of moderating Facebook lies in the sheer scale of the platform, and the contextual interpretations spanning cultures across the globe.<\/p>\n<p class=\"p1\">And sure, Facebook has done a lot of work to make sure that the policies are enforced on a consistent level, while still allowing for free speech.<\/p>\n<p class=\"p1\">That said, Facebook seems to be hinging some hopes on curbing the reach of even some of the most clicked content. Perhaps if we stop rewarding trolls with so many clicks, people may be disinclined to stir up outrage in the first place.<\/p>\n<p>But chances are, Facebook&#8217;s content moderation efforts will be an ongoing dilemma.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Who decides what&#8217;s offensive? And how can Facebook filter all of it?<\/p>\n","protected":false},"author":9161,"featured_media":114715,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","wpcf-pageviews":0},"categories":[1015],"tags":[2353,1059],"usertag":[],"vertical":[],"content-category":[],"class_list":["post-114394","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-app-subdomain-redirectionfacebook","tag-facebook"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/114394","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/users\/9161"}],"replies":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/comments?post=114394"}],"version-history":[{"count":1,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/114394\/revisions"}],"predecessor-version":[{"id":326961,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/posts\/114394\/revisions\/326961"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/media\/114715"}],"wp:attachment":[{"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/media?parent=114394"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/categories?post=114394"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/tags?post=114394"},{"taxonomy":"usertag","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/usertag?post=114394"},{"taxonomy":"vertical","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/vertical?post=114394"},{"taxonomy":"content-category","embeddable":true,"href":"https:\/\/cms-articles.softonic.io\/en\/wp-json\/wp\/v2\/content-category?post=114394"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}