Internet manipulation explained

Internet manipulation is the co-optation of online digital technologies, including algorithms, social bots, and automated scripts, for commercial, social, military, or political purposes.[1] Internet and social media manipulation are the prime vehicles for spreading disinformation due to the importance of digital platforms for media consumption and everyday communication.[2] When employed for political purposes, internet manipulation may be used to steer public opinion,[3] polarise citizens,[4] circulate conspiracy theories,[5] and silence political dissidents. Internet manipulation can also be done for profit, for instance, to harm corporate or political adversaries and improve brand reputation.[6] Internet manipulation is sometimes also used to describe the selective enforcement of Internet censorship[7] [8] or selective violations of net neutrality.[9]

Issues

Algorithms, echo chambers and polarization

See main article: Media pluralism. Due to overabundance of online content, social networking platforms and search engines have leveraged algorithms to tailor and personalize users' feeds based on their individual preferences. However, algorithms also restrict exposure to different viewpoints and content, leading to the creation of echo chambers or filter bubbles.[21]

With the help of algorithms, filter bubbles influence users' choices and perception of reality by giving the impression that a particular point of view or representation is widely shared. Following the 2016 referendum of membership of the European Union in the United Kingdom and the United States presidential elections, this gained attention as many individuals confessed their surprise at results that seemed very distant from their expectations. The range of pluralism is influenced by the personalized individualization of the services and the way it diminishes choice.[22] Five manipulative verbal influences were found in media texts. There are self-expression, semantic speech strategies, persuasive strategies, swipe films and information manipulation. The vocabulary toolkit for speech manipulation includes euphemism, mood vocabulary, situational adjectives, slogans, verbal metaphors, etc.[23]

Research on echo chambers from Flaxman, Goel, and Rao,[24] Pariser,[25] and Grömping[26] suggest that use of social media and search engines tends to increase ideological distance among individuals.

Comparisons between online and off-line segregation have indicated how segregation tends to be higher in face-to-face interactions with neighbors, co-workers, or family members,[27] and reviews of existing research have indicated how available empirical evidence does not support the most pessimistic views about polarization.[28] A 2015 study suggested that individuals' own choices drive algorithmic filtering, limiting exposure to a range of content.[29] While algorithms may not be causing polarization, they could amplify it, representing a significant component of the new information landscape.[30]

Research and use by intelligence and military agencies

See also: Psychological warfare, State-sponsored Internet propaganda and CIA influence on public opinion. The Joint Threat Research Intelligence Group unit of the Government Communications Headquarters (GCHQ), the British intelligence agency[31] was revealed as part of the global surveillance disclosures in documents leaked by the former National Security Agency contractor Edward Snowden[32] and its mission scope includes using "dirty tricks" to "destroy, deny, degrade [and] disrupt" enemies.[32] [33] Core-tactics include injecting false material onto the Internet in order to destroy the reputation of targets and manipulating online discourse and activism for which methods such as posting material to the Internet and falsely attributing it to someone else, pretending to be a victim of the target individual whose reputation is intended to be destroyed and posting "negative information" on various forums may be used.[34]

Known as "Effects" operations, the work of JTRIG had become a "major part" of GCHQ's operations by 2010.[32] The unit's online propaganda efforts (named "Online Covert Action") utilize "mass messaging" and the "pushing [of] stories" via the medium of Twitter, Flickr, Facebook and YouTube.[32] Online "false flag" operations are also used by JTRIG against targets.[32] JTRIG have also changed photographs on social media sites, as well as emailing and texting colleagues and neighbours with "unsavory information" about the targeted individual.[32] In June 2015, NSA files published by Glenn Greenwald revealed new details about JTRIG's work at covertly manipulating online communities.[35] The disclosures also revealed the technique of "credential harvesting", in which journalists could be used to disseminate information and identify non-British journalists who, once manipulated, could give information to the intended target of a secret campaign, perhaps providing access during an interview.[32] It is unknown whether the journalists would be aware that they were being manipulated.[32]

Furthermore, Russia is frequently accused of financing "trolls" to post pro-Russian opinions across the Internet. The Internet Research Agency has become known for employing hundreds of Russians to post propaganda online under fake identities in order to create the illusion of massive support.[36] In 2016 Russia was accused of sophisticated propaganda campaigns to spread fake news with the goal of punishing Democrat Hillary Clinton and helping Republican Donald Trump during the 2016 presidential election as well as undermining faith in American democracy.

In a 2017 report[37] Facebook publicly stated that its site has been exploited by governments for the manipulation of public opinion in other countries – including during the presidential elections in the US and France.[38] [39] [40] It identified three main components involved in an information operations campaign: targeted data collection, content creation and false amplification and includes stealing and exposing information that is not public; spreading stories, false or real, to third parties through fake accounts; and fake accounts being coordinated to manipulate political discussion, such as amplifying some voices while repressing others.[41] [42]

In politics

See also: Russian interference in the 2016 United States elections. In 2016 Andrés Sepúlveda disclosed that he manipulated public opinion to rig elections in Latin America. According to him with a budget of $600,000 he led a team of hackers that stole campaign strategies, manipulated social media to create false waves of enthusiasm and derision, and installed spyware in opposition offices to help Enrique Peña Nieto, a right-of-center candidate, win the election.[43] [44]

In the run up to India's 2014 elections, both the Bharatiya Janata party (BJP) and the Congress party were accused of hiring "political trolls" to talk favourably about them on blogs and social media.[45]

The Chinese government is also believed to run a so-called "50-cent army" (a reference to how much they are said to be paid) and the "Internet Water Army" to reinforce favourable opinion towards it and the Chinese Communist Party (CCP) as well as to suppress dissent.[45] [46]

In December 2014 the Ukrainian information ministry was launched to counter Russian propaganda with one of its first tasks being the creation of social media accounts (also known as the i-Army) and amassing friends posing as residents of eastern Ukraine.[45] [47]

Twitter suspended a number of bot accounts that appeared to be spreading pro-Saudi Arabian tweets about the disappearance of Saudi dissident journalist Jamal Khashoggi.[48]

A report by Mediapart claimed that the UAE, through a secret services agent named Mohammed, was using a Switzerland-based firm Alp Services to run manipulation campaigns against Emirati opponents. Alp Services head, Mario Brero used fictitious accounts that were publishing fake articles under pseudonyms to attack Qatar and the Muslim Brotherhood networks in Europe. The UAE assigned Alp to publish at least 100 articles per year that were critical of Qatar.[49]

In business and marketing

See also: Social media marketing and Corporate warfare.

Trolling and other applications

Hackers, hired professionals and private citizens have all been reported to engage in internet manipulation using software, including Internet bots such as social bots, votebots and clickbots.[50] In April 2009, Internet trolls of 4chan voted Christopher Poole, founder of the site, as the world's most influential person of 2008 with 16,794,368 votes by an open Internet poll conducted by Time magazine.[51] The results were questioned even before the poll completed, as automated voting programs and manual ballot stuffing were used to influence the vote.[52] [53] [54] 4chan's interference with the vote seemed increasingly likely, when it was found that reading the first letter of the first 21 candidates in the poll spelled out a phrase containing two 4chan memes: "Marblecake. Also, The Game".[55]

Jokesters and politically oriented hacktivists may share sophisticated knowledge of how to manipulate the Web and social media.[56]

Countermeasures

See also: Fact checking and Web literacy. In Wired it was noted that nation-state rules such as compulsory registration and threats of punishment are not adequate measures to combat the problem of online bots.[57]

To guard against the issue of prior ratings influencing perception several websites such as Reddit have taken steps such as hiding the vote-count for a specified time.[16]

Some other potential measures under discussion are flagging posts for being likely satire or false.[58] For instance in December 2016 Facebook announced that disputed articles will be marked with the help of users and outside fact checkers.[59] The company seeks ways to identify 'information operations' and fake accounts and suspended 30,000 accounts before the presidential election in France in a strike against information operations.[38]

Inventor of the World Wide Web Tim Berners-Lee considers putting few companies in charge of deciding what is or is not true a risky proposition and states that openness can make the web more truthful. As an example he points to Wikipedia which, while not being perfect, allows anyone to edit with the key to its success being not just the technology but also the governance of the site. Namely, it has an army of countless volunteers and ways of determining what is or is not true.[60]

Furthermore, various kinds of software may be used to combat this problem such as fake checking software or voluntary browser extensions that store every website one reads or use the browsing history to deliver fake revelations to those who read a fake story after some kind of consensus was found on the falsehood of a story.

Furthermore, Daniel Suarez asks society to value critical analytic thinking and suggests education reforms such as the introduction of 'formal logic' as a discipline in schools and training in media literacy and objective evaluation.[58]

Government responses

According to a study of the Oxford Internet Institute, at least 43 countries around the globe have proposed or implemented regulations specifically designed to tackle different aspects of influence campaigns, including fake news, social media abuse, and election interference.[61]

Germany

In Germany, during the period preceding the elections in September 2017, all major political parties save AfD publicly announced that they would not use social bots in their campaigns. Additionally, they committed to strongly condemning such usage of online bots.

Moves towards regulation on social media have been made: three German states Hessen, Bavaria, and Saxony-Anhalt proposed in early 2017 a law that would mean social media users could face prosecution if they violate the terms and conditions of a platform. For example, the use of a pseudonym on Facebook, or the creation of fake account, would be punishable by up to one year's imprisonment.[62]

Italy

In early 2018, the Italian Communications Agency AGCOM published a set of guidelines on its website, targeting the elections in March that same year. The six main topics are:[63]

  1. Political Subjects's Equal Treatment
  2. Political Propaganda's Transparency
  3. Contents Illicit and Activities Whose Dissemination Is Forbidden (i.e. Polls)
  4. Social Media Accounts of Public Administrations
  5. Political Propaganda is Forbidden on Election Day and Day Before
  6. Recommendations for stronger fact-checking services

France

In November 2018, a law against the manipulation of information was passed in France. The law stipulates that during campaign periods:[64]

Malaysia

In April 2018, the Malaysian parliament passed the Anti-Fake News Act. It defined fake news as 'news, information, data and reports which is or are wholly or partly false.'[65] This applied to citizens or those working at a digital publication, and imprisonment of up to 6 years was possible. However, the law was repealed after heavy criticism in August 2018.[66]

Kenya

In May 2018, President Uhuru Kenyatta signed into law the Computer and Cybercrimes bill, that criminalised cybercrimes including cyberbullying and cyberespionage. If a person "intentionally publishes false, misleading or fictitious data or misinforms with intent that the data shall be considered or acted upon as authentic," they are subject to fines and up to two years imprisonment.[67]

Research

German chancellor Angela Merkel has issued the Bundestag to deal with the possibilities of political manipulation by social bots or fake news.[68]

External links

Notes and References

  1. Book: Computational Propaganda: Political Parties, Politicians, and Political Manipulation on Social Media. Woolley. Samuel. Howard. Philip N.. Oxford University Press. 2019. 978-0190931414.
  2. Diaz Ruiz . Carlos . 2023-10-30 . Disinformation on digital media platforms: A market-shaping approach . New Media & Society . en . 10.1177/14614448231207644 . 264816011 . 1461-4448. free .
  3. Web site: Marchal . Nahema . Neudert . Lisa-Maria . 2019 . Polarisation and the use of technology in political campaigns and communication . European Parliamentary Research Service.
  4. Kreiss . Daniel . McGregor . Shannon C . 2023-04-11 . A review and provocation: On polarization and platforms . New Media & Society . 26 . en . 556–579 . 10.1177/14614448231161880 . 258125103 . 1461-4448. free .
  5. Diaz Ruiz . Carlos . Nilsson . Tomas . 2023 . Disinformation and Echo Chambers: How Disinformation Circulates on Social Media Through Identity-Driven Controversies . Journal of Public Policy & Marketing . en . 42 . 1 . 18–35 . 10.1177/07439156221103852 . 248934562 . 0743-9156.
  6. Di Domenico . Giandomenico . Ding . Yu . 2023-10-23 . Between Brand attacks and broader narratives: how direct and indirect misinformation erode consumer trust . Current Opinion in Psychology . 54 . 101716 . 10.1016/j.copsyc.2023.101716 . 37952396 . 264474368 . 2352-250X. free .
  7. Book: Castells. Manuel. Networks of Outrage and Hope: Social Movements in the Internet Age. John Wiley & Sons. 9780745695792. 4 February 2017. en. 2015-06-04.
  8. News: Condemnation over Egypt's internet shutdown. Financial Times. 4 February 2017.
  9. Web site: Net neutrality wins in Europe – a victory for the internet as we know it. ZME Science. 4 February 2017. 31 August 2016.
  10. Thompson . Paul . 2004 . Cognitive hacking and intelligence and security informatics . dead. Defense and Security. Orlando, Florida, United States . Enabling Technologies for Simulation Science VIII . 5423 . 142–151 . 2004SPIE.5423..142T . 10.1117/12.554454 . 18907972 . https://web.archive.org/web/20170205095753/https://pdfs.semanticscholar.org/cb06/dc28f2fc4ceb5947607846603ed749ef99b5.pdf . 5 February 2017 . 4 February 2017 . Dawn A. . Alex F. . Trevisani . Sisti.
  11. Cognitive hacking: a battle for the mind . 2023-11-02 . Computer . 2002 . en-US . 10.1109/mc.2002.1023788 . Cybenko . G. . Giani . A. . Thompson . P. . 35 . 8 . 50–56 .
  12. Bastick. Zach. 2021. Would you notice if fake news changed your behavior? An experiment on the unconscious effects of disinformation. Computers in Human Behavior. 116. 106633. 106633. 10.1016/j.chb.2020.106633. free.
  13. Berger. Jonah. Milkman. Katherine L. Katy Milkman. April 2012. What Makes Online Content Viral?. Journal of Marketing Research. 49. 2. 192–205. 10.1509/jmr.10.0353. 29504532.
  14. Web site: Hoff. Carsten Klotz von. Manipulation 2.0 – Meinungsmache via Facebook. Der Freitag. 4 February 2017. de-DE. 6 April 2012.
  15. Book: Golda. Christopher P.. Informational Social Influence and the Internet: Manipulation in a Consumptive Society. 4 February 2017. en. 2015.
  16. Web site: Moderators: New subreddit feature – comment scores may be hidden for a defined time period after posting • /r/modnews. reddit. 29 April 2013 . 4 February 2017. en.
  17. Web site: Die Scheinwelt von Facebook & Co. (German-language documentary by the ZDF). 4 February 2017. de.
  18. Web site: Ich habe nur gezeigt, dass es die Bombe gibt. Das Magazin. 30 April 2017. 3 December 2016.
  19. News: Beuth. Patrick. US-Wahl: Big Data allein entscheidet keine Wahl. Die Zeit. 30 April 2017. 6 December 2016.
  20. Web site: The Data That Turned the World Upside Down. Motherboard. 30 April 2017. en-us. 2017-01-28.
  21. Sacasas. L. M.. 2020. The Analog City and the Digital City. The New Atlantis. 61. 3–18. 26898497. 1543-1215.
  22. Book: World Trends in Freedom of Expression and Media Development Global Report 2017/2018. UNESCO. 2018. 202.
  23. Kalinina. Anna V.. Yusupova. Elena E.. Voevoda. Elena V.. 2019-05-18. Means of Influence on Public Opinion in Political Context: Speech Manipulation in the Media. Media Watch. 10. 2. 10.15655/mw/2019/v10i2/49625. 182112133. 2249-8818.
  24. Flaxman, Seth, Sharad Goel, and Justin M. Rao. 2016. Filter bubbles, echo chambers, and online news consumption. Public Opinion Quarterly 80 (S1): 298–320.
  25. Pariser, Eli. 2011. The filter bubble: What the Internet is hiding from you. Penguin UK. Available at https://books.google.co.uk/?hl=en&lr=&oi=fnd&pg=PT3&dq=eli+pariser+filter&ots=g3PrCprRV2&sig=_FI8GISLrm3WNoMKMlqSTJNOFw Accessed 20 May 2017.
  26. 10.1177/1326365X14539185. Echo Chambers. Asia Pacific Media Educator. 24. 39–59. 2014. Grömping. Max. 154399136.
  27. Gentzkow, Matthew, and Jesse M. Shapiro. 2011. Ideological segregation online and offline. The Quarterly Journal of Economics 126 (4): 1799–1839.
  28. Zuiderveen Borgesius, Frederik J., Damian Trilling, Judith Moeller, Balázs Bodó, Claes H. de Vreese, and Natali Helberger. 2016. Should We Worry about Filter Bubbles? Available at https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2758126. Accessed 20 May 2017
  29. Bakshy . Eytan . Messing . Solomon . Adamic . Lada A. . 2015-06-05 . Exposure to ideologically diverse news and opinion on Facebook . Science . en . 348 . 6239 . 1130–1132 . 10.1126/science.aaa1160 . 25953820 . 2015Sci...348.1130B . 206632821 . 0036-8075. free .
  30. Hargittai. 2015. Why doesn't Science publish important methods info prominently? Crooked Timber. Available at http://crookedtimber.org/2015/05/07/why-doesnt-science-publish-important-methods-info-prominently/. Accessed 20 May 2017.
  31. News: Snowden leaks: GCHQ 'attacked Anonymous' hackers. BBC. 7 February 2014. 5 February 2014. BBC News.
  32. Web site: Snowden Docs: British Spies Used Sex and 'Dirty Tricks'. NBC News. 7 February 2014. 7 February 2014.
  33. Web site: How Covert Agents Infiltrate the Internet to Manipulate, Deceive, and Destroy Reputations. Glenn Greenwald. The Intercept. 2014-02-24. contains the DISRUPTION Operational Playbook slide presentation by GCHQ
  34. Web site: Greenwald. Glenn. How Covert Agents Infiltrate the Internet to Manipulate, Deceive, and Destroy Reputations. The Intercept. 4 February 2017. 2014-02-24.
  35. Greenwald, Glenn and Andrew Fishman. Controversial GCHQ Unit Engaged in Domestic Law Enforcement, Online Propaganda, Psychology Research. The Intercept. 2015-06-22.
  36. News: Chen. Adrian. The Agency. The New York Times. 30 April 2017. 2 June 2015.
  37. Web site: Information Operations and Facebook. 30 April 2017. 27 April 2017. 8 January 2022. https://web.archive.org/web/20220108122517/https://i2.res.24o.it/pdf2010/Editrice/ILSOLE24ORE/ILSOLE24ORE/Online/_Oggetti_Embedded/Documenti/2017/04/28/facebook-and-information-operations-v1.pdf. Il Sole 24 Ore.
  38. News: Solon. Olivia. Facebook admits: governments exploited us to spread propaganda. The Guardian. 30 April 2017. 27 April 2017.
  39. News: Konzern dokumentiert erstmals Probleme: Geheimdienste nutzen Facebook zur Desinformation. SPIEGEL ONLINE. 30 April 2017. 2017-04-28. Reinbold. Fabian.
  40. Web site: Report: Facebook will nicht mehr für Propaganda missbraucht werden. WIRED Germany. 30 April 2017. de. 28 April 2017.
  41. Web site: Facebook targets coordinated campaigns spreading fake news. CNET. 30 April 2017. en.
  42. Web site: Facebook, for the first time, acknowledges election manipulation. CBS News. 28 April 2017 . 30 April 2017. en.
  43. News: How to Hack an Election. Bloomberg.com . Bloomberg. 22 January 2017.
  44. News: Man claims he rigged elections in most Latin American countries over 8 years. The Independent. 22 January 2017. 2 April 2016.
  45. News: Shearlaw. Maeve. From Britain to Beijing: how governments manipulate the internet. The Guardian. 4 February 2017. 2 April 2015.
  46. Book: MacKinnon. Rebecca. Consent of the networked: the world-wide struggle for Internet freedom. 2012. Basic Books. New York. 978-0-465-02442-1. Consent of the Networked.
  47. Web site: Ukraine's new online army in media war with Russia. BBC. 4 February 2017.
  48. News: Twitter pulls down bot network that pushed pro-Saudi talking points about disappeared journalist . NBC News . 19 October 2018.
  49. Web site: Leaked data shows extent of UAE's meddling in France. 4 March 2023. MediaPart. 4 March 2023 .
  50. Gorwa . Robert . Guilbeault . Douglas . 2018-08-10 . Unpacking the Social Media Bot: A Typology to Guide Research and Policy: Unpacking the Social Media Bot . Policy & Internet . en . 1801.06863 . 10.1002/poi3.184 . 51877148.
  51. The World's Most Influential Person Is... . https://web.archive.org/web/20090428114850/http://www.time.com/time/arts/article/0,8599,1894028,00.html . dead . April 28, 2009 . TIME . April 27, 2009 . September 2, 2009.
  52. 4Chan Followers Hack Time's 'Influential' Poll . Heater . Brian . . April 27, 2009 . April 27, 2009 . https://web.archive.org/web/20090430151912/http://www.pcmag.com/article2/0%2C2817%2C2345987%2C00.asp . April 30, 2009 . live .
  53. News: 4Chan Takes Over The Time 100 . Schonfeld . Erick . Washington Post . April 21, 2009 . April 27, 2009 .
  54. Web site: moot wins, Time Inc. loses « Music Machinery . Musicmachinery.com . April 27, 2009 . September 2, 2009. https://web.archive.org/web/20090503031919/http://musicmachinery.com/2009/04/27/moot-wins-time-inc-loses/. May 3, 2009. live.
  55. Web site: Reddit Top Links . Marble Cake Also the Game [PIC] |publisher=Buzzfeed.com |access-date=September 2, 2009]. https://web.archive.org/web/20090415164347/http://www.buzzfeed.com/reddit/also-the-work-of-4chan-pic . April 15, 2009 .
  56. News: Maslin. Janet. 'We Are Anonymous' by Parmy Olson. The New York Times. 4 February 2017. 31 May 2012.
  57. Web site: Debatte um "Social Bots": Blinder Aktionismus gegen die eigene Hilflosigkeit. WIRED Germany. 4 February 2017. de. 23 January 2017.
  58. Web site: How technology is changing the way we think – Daniel Suarez, Jan Kalbitzer & Frank Rieger. YouTube. 30 April 2017. 7 December 2016.
  59. News: Jamieson. Amber. Solon. Olivia. Facebook to begin flagging fake news in response to mounting criticism. The Guardian. 4 February 2017. 15 December 2016.
  60. Finley. Klint. Tim Berners-Lee, Inventor of the Web, Plots a Radical Overhaul of His Creation. Wired. 4 April 2017. 2017-04-04.
  61. Bradshaw. Samantha. Neudert. Lisa-Maria. Howard. Philip N.. 2018. Government Responses to Malicious Use of Social Media. Nato Stratcom Coe. 978-9934-564-31-4. 20.
  62. Web site: Reuter . Markus . Hausfriedensbruch 4.0: Zutritt für Fake News und Bots strengstens verboten . Netzpolitik . 17 January 2017 . 24 October 2019.
  63. Web site: Bellezza . Marco . Frigerio . Filippo Frigerio . ITALY: First Attempt to (Self)Regulate the Online Political Propaganda . 6 February 2018 .
  64. Web site: Against information manipulation . Gouvernement.fr . 24 October 2019.
  65. News: Menon . Praveen . Malaysia outlaws 'fake news'; sets jail of up to six years . Reuters . 2 April 2018 . 24 October 2019.
  66. Web site: Yeung . Jessie . Malaysia repeals controversial fake news law . CNN . 17 August 2018 . 24 October 2019.
  67. Web site: Schwartz . Arielle . Kenya signs bill criminalising fake news . Mail & Guardian . 16 May 2018 . 24 October 2019.
  68. News: Bundestagsdebatte: Merkel schimpft über Internet-Trolle. Süddeutsche Zeitung. 4 February 2017. de. 1 November 2016. Sueddeutsche.de.