Shadow banning explained

Shadow banning, also called stealth banning, hellbanning, ghost banning, and comment ghosting, is the practice of blocking or partially blocking a user or the user's content from some areas of an online community in such a way that the ban is not readily apparent to the user, regardless of whether the action is taken by an individual or an algorithm. For example, shadow-banned comments posted to a blog or media website would be visible to the sender, but not to other users accessing the site.

The phrase "shadow banning" has a colloquial history and has undergone some usage evolution. It originally applied to a deceptive sort of account suspension on web forums, where a person would appear to be able to post while actually having all of their content hidden from other users. More recently, the term has come to apply to alternative measures, particularly visibility measures like delisting and downranking.[1]

By partly concealing, or making a user's contributions invisible or less prominent to other members of the service, the hope may be that in the absence of reactions to their comments, the problematic or otherwise out-of-favour user will become bored or frustrated and leave the site, and that spammers and trolls will be discouraged[2] to continue their unwanted behavior or create new accounts.

History

In the mid-1980s, BBS forums including Citadel BBS software had a "twit bit" for problematic users[3] [4] which, when enabled, would limit the user's access while still allowing them to read public discussions; however, any messages posted by that "twit" would not be visible to the other members of that group.[5]

The term "shadow ban" is believed to have originated with moderators on the website Something Awful in 2001, although the feature was only used briefly and sparsely.

Michael Pryor of Fog Creek Software described stealth banning for online forums in 2006, saying how such a system was in place in the project management system FogBugz, "to solve the problem of how do you get the person to go away and leave you alone". As well as preventing problem users from engaging in flame wars, the system also discouraged spammers, who if they returned to the site would be under the false impression that their spam was still in place.[6] The Verge describes it as "one of the oldest moderation tricks in the book", noting that early versions of vBulletin had a global ignore list known as "Tachy goes to Coventry",[7] as in the British expression "to send someone to Coventry", meaning to ignore them and pretend they do not exist.

A 2012 update to Hacker News introduced a system of "hellbanning" for spamming and abusive behavior.[8] [9]

Early on, Reddit implemented a similar feature, initially designed to address spam accounts.[10] In 2015, Reddit added an account suspension feature that was said to have replaced its sitewide shadowbans, though moderators can still shadowban users from their individual subreddits via their AutoModerator configuration.[11] A Reddit user was accidentally shadow banned for one year in 2019, subsequently they contacted support and their comments were restored.[12]

A study of tweets written in a one-year period during 2014 and 2015 found that over a quarter million tweets had been censored in Turkey via shadow banning.[13] Twitter was also found, in 2015, to have shadowbanned tweets containing leaked documents in the US.[14] [15]

Craigslist has also been known to "ghost" a user's individual ads, whereby the poster gets a confirmation email and may view the ad in their account, but the ad fails to show up in the appropriate category page.[16]

WeChat was found in 2016 to have banned, without notice, posts and messages that contain various combinations of at least 174 keywords, including "习包子" (Xi Bao Zi), "六四天安门" (June 4 Tiananmen), "藏青会" (Tibetan Youth Congress), and "ئاللاھ يولىدا" (in the way of Allah).[17] [18]

In 2017, the phenomenon was noticed on Instagram, with posts which included specific hashtags not showing up when those hashtags were used in searches.[19] [20] [21]

Controversies

Political controversies

"Shadow banning" became popularized in 2018 as a conspiracy theory when Twitter shadow-banned some Republicans.[22] In late July 2018, Vice News found that several supporters of the US Republican Party no longer appeared in the auto-populated drop-down search menu on Twitter, thus limiting their visibility when being searched for; Vice News alleged that this was a case of shadow-banning.[22] [23] After the story, some conservatives accused Twitter of enacting a shadowban on Republican accounts, a claim which Twitter denied.[24] However, some accounts that were not overtly political or conservative apparently had the same algorithm applied to them.[25] Numerous news outlets, including The New York Times, The Guardian, Buzzfeed News, Engadget and New York magazine, disputed the Vice News story.[26] [27] [28] [29] [30] In a blog post, Twitter said that the use of the phrase "shadow banning" was inaccurate, as the tweets were still visible by navigating to the home page of the relevant account.[31] In the blog post, Twitter claims it does not shadow ban by using "the old, narrow, and classical" definition of shadow banning.[32] Later, Twitter appeared to have adjusted its platform to no longer limit the visibility of some accounts.[33] In a research study that examined more than 2.5 million Twitter profiles, it was discovered that almost one in 40 had been shadowbanned by having their replies hidden or having their handles hidden in searches.[34] [35]

During the 2020 Twitter account hijackings, hackers successfully managed to obtain access to Twitter's internal moderation tools via both social engineering and paying off an insider who worked at Twitter.[36] Through this, images were leaked of an internal account summary page, which in turn revealed user "flags" set by the system that confirmed the existence of shadow bans on Twitter. Accounts were flagged with terms such as "Trends Blacklisted" and "Search Blacklisted" implying that the user was not able to publicly trend, or show up in public search results. After the situation was dealt with, Twitter faced accusations of censorship with claims that they were trying to hide the existence of shadow bans by removing tweets that contained images of the internal staff tools used, however Twitter claimed they were removed as they revealed sensitive user information.[37]

On December 8, 2022, the second thread of the Twitter Files—a series of Twitter threads based on internal Twitter, Inc. documents shared by owner Elon Musk with independent journalists Matt Taibbi and Bari Weiss—addressed a practice referred to as "visibility filtering" by previous Twitter management. The functionality included tools allowing accounts to be tagged as "Do not amplify", and under "blacklists" that reduce their prominence in search results and trending topics. It was also revealed that certain conservative accounts, such as the Libs of TikTok, had been given a warning stating that decisions regarding them should only be made by Twitter's Site Integrity Policy, Policy Escalation Support (SIP–PES) team—which consists primarily of high-ranking officials. The functions were given by Musk and other critics as examples of "shadow banning".[38] [39] [40]

Conspiracy theories

A form of conspiracy theory has become popular in which a social media content creator suggests that their content has been intentionally suppressed by a platform which claims not to engage in shadow banning.[41] Platforms frequently targeted by these accusations include Twitter, Facebook, YouTube and Instagram.

To explain why users may come to believe they are subject to "shadow bans" even when they are not, Elaine Moore of the Financial Times writes:

See also

Notes and References

  1. An End to Shadow Banning? Transparency rights in the Digital Services Act between content moderation and curation . 2022-12-11 . osf.io . 3 . 10.31219/osf.io/7jg45 . Leerssen . Paddy .
  2. News: Clive Thompson on the Taming of Comment Trolls . Thompson . Clive . 29 March 2009 . 6 July 2014 . Wired magazine . https://web.archive.org/web/20150805043857/http://archive.wired.com/techbiz/people/magazine/17-04/st_thompson . 2015-08-05.
  3. News: Cole . Samantha . 31 July 2018 . Where Did the Concept of 'Shadow Banning' Come From? . Motherboard . 1 August 2018.
  4. Web site: Suspension, Ban or Hellban? . Atwood . Jeff . 4 June 2011 . Coding Horror blog . 17 December 2011 . 30 December 2011 . https://web.archive.org/web/20111230182953/http://www.codinghorror.com/blog/2011/06/suspension-ban-or-hellban.html . dead .
  5. Web site: Manual installation of Citadel using source code and the command line client - Citadel.org . www.citadel.org . en . 20 December 2020.
  6. Book: Robert Walsh. Micro-ISV: From Vision to Reality . 12 January 2006 . Apress . 978-1-4302-0114-4 . 183 . So one of the things we did in FogBugz to solve the problem of how do you get the person to go away and leave you alone is, well, you take their post and make it invisible to everyone else, but they still see it. They won’t know they’ve been deleted. There’s no one fanning their flame. You can’t get into a flame war if no one responds to your criticism. So they get silenced and eventually just go away. We have several ways of telling if they come back, and it’s been proven to be extremely, extremely effective. Say a spammer posts to your board and then they come back to check if it’s still there, and they see it—to them it’s still there—but no one else sees it, so they’re not bothered by it..
  7. Web site: One of Twitter's new anti-abuse measures is the oldest trick in the forum moderation book . Bohn . Dieter . 16 February 2017 . The Verge . 17 February 2017.
  8. News: The Evolution of Hacker News . TechCrunch . 10 August 2014 . Leena Rao . 18 May 2013.
  9. News: Can the democratic power of a platform like Hacker News be applied to products? . 4 December 2013 . Pando . 1 August 2018 . en-gb.
  10. Web site: krispykrackers. On shadowbans. • r/self. Reddit. en.
  11. Web site: Shu. Catherine. November 11, 2015. Reddit Replaces Its Confusing Shadowban System With Account Suspensions. 16 September 2017. TechCrunch. en.
  12. News: Gerken . Tom . 2019-04-11 . The Redditor who accidentally spent a year talking to himself . en-GB . . 2023-03-13.
  13. Book: Tanash . Rima S. . Chen . Zhouhan . Thakur . Tanmay . Wallach . Dan S. . Subramanian . Devika . Proceedings of the 14th ACM Workshop on Privacy in the Electronic Society . Known Unknowns . 1 January 2015 . WPES '15. New York, NY, USA . ACM . 11–20 . 10.1145/2808138.2808147 . 9781450338202. 207229086 .
  14. News: Tweets are disappearing on Twitter. Why? . Ohlheiser . Abby . 30 October 2015 . The Washington Post . 29 April 2017 . en-US . 0190-8286.
  15. Web site: Pearson. Jordan. October 19, 2015. Is Twitter Censoring a Blockbuster Report on US Drone Assassinations?. 26 July 2017. Motherboard. en-us.
  16. Web site: Weedmark. David. How to Prevent Ghost Posting on Craigslist. Chron.com.
  17. News: Ruan. Lotus. Knockel. Jeffrey. Ng. Jason Q.. Crete-Nishihata. Masashi. 30 November 2016. One App, Two Systems: How WeChat uses one censorship policy in China and another internationally - The Citizen Lab. en-US. The Citizen Lab. 29 April 2017.
  18. Web site: Doctorow. Cory. December 2, 2016. China's We Chat "shadow-bans" messages with forbidden keywords, but only for China-based accounts. 29 April 2017. Boing Boing.
  19. News: Instagram's "shadowban," explained: How to tell if Instagram is secretly blacklisting your posts . Lorenz . Taylor. Taylor Lorenz. 7 June 2017 . . 4 November 2017 . en.
  20. News: Wong. Kristin. April 23, 2017. How to See If Your Instagram Posts Have Been Shadowbanned. en-US. Lifehacker. 4 November 2017.
  21. Web site: Photographers Claim Instagram is 'Shadow Banning' Their Accounts . 28 March 2017 . PetaPixel . 26 April 2017.
  22. Web site: Romano . Aja . 6 September 2018 . How hysteria over Twitter shadow-banning led to a bizarre congressional hearing . Vox.
  23. News: Thompson . Alex . 26 July 2018 . Twitter appears to have fixed "shadow ban" of prominent Republicans like the RNC chair and Trump Jr.'s spokesman . Vice News . 15 August 2018.
  24. News: Stack . Liam . 26 July 2018 . What Is a 'Shadow Ban,' and Is Twitter Doing It to Republican Accounts? . en . The New York Times .
  25. News: Eordogh . Fruzsina . 31 July 2018 . Why Republicans Weren't The Only Ones Shadow Banned On Twitter . en .
  26. Web site: Warzel . Charlie . July 26, 2018 . Twitter Isn't Shadow-Banning Republicans. Here's Why. . 13 February 2019 . BuzzFeed News . en.
  27. Web site: Feldman . Brian . 25 July 2018 . Twitter Is Not 'Shadow Banning' Republicans . 13 February 2019 . Intelligencer.
  28. News: Wilson . Jason . 27 July 2018 . What is 'shadow banning', and why did Trump tweet about it? . en-GB . The Guardian . 13 February 2019 . 0261-3077.
  29. Web site: Swapna Krishna . 26 July 2018 . Twitter says supposed 'shadow ban' of prominent Republicans is a bug . 13 February 2019 . Engadget . en.
  30. Web site: Laura Hazard Owen . 27 July 2018 . Twitter's not "shadow banning" Republicans, but get ready to hear that it is . 13 February 2019 . Nieman Lab.
  31. Web site: Setting the record straight on shadow banning . 8 September 2018 . Twitter.
  32. Web site: Shedding Light on Shadowbanning . 2022-12-11 . Center for Democracy and Technology . 26 April 2022 . 37 . en-US.
  33. Web site: Alex Thompson . 26 July 2018 . Twitter appears to have fixed search problems that lowered visibility of GOP lawmakers . 28 March 2019 . Vice . en.
  34. 2012.05101 . cs.SI . Erwan . Le Merrer . Benoit . Morgan . Setting the Record Straighter on Shadow Banning . 2020-12-09 . Trédan . Gilles.
  35. Web site: Nicholas . Gabriel . 2022-04-28 . Shadowbanning Is Big Tech's Big Problem . 2022-12-09 . The Atlantic . en.
  36. Web site: Cox . Joseph . Hackers Convinced Twitter Employee to Help Them Hijack Accounts . Vice.com . 15 July 2020 . Vice . 21 January 2024.
  37. Web site: Nathaniel . Popper . Kate . Conger . Hackers Tell the Story of the Twitter Attack From the Inside . The New York Times . 21 January 2024.
  38. News: Shapero . Julia . 8 December 2022 . Former NYT columnist Bari Weiss releases 'Twitter Files Part Two' . . 9 December 2022.
  39. Web site: Urquhart . Evan . 2022-12-09 . The Anti-Trans Hate Account That Bari Weiss Says Is Yet Another Right-Wing Voice Censored by Twitter . 2022-12-09 . Slate Magazine . en.
  40. Web site: 2022-12-09 . The Twitter Files, Part Two, Explained . 2022-12-09 . Gizmodo . en.
  41. News: Moore . Elaine . 13 March 2022 . The truth about 'shadowbanning' is more complicated than influencers think . Financial Times . 12 June 2022.