International Journal of Communication 20(2026) Post-Truth Spaces
Kamila Koronska
University of Amsterdam, The Netherlands
This study contributes to a larger research project aiding fact-checkers and verification specialists in their work. It develops a technique to locate and measure the influence of problematic source clusters on social media that serve as leads. We dub these source clusters “post-truth spaces.” We first situate the post-truth space next to other spaces online where problematic information holds sway, including the “alternative influence network,” “fake news” engagement spaces, “coordinated inauthentic behavior” campaigns, and “participatory propaganda” circulation. In the post-truth space mapping technique in focus here, we locate and discuss actors, websites, and social media pages grouped together based on their inter-referencing. Their provenance is studied through digital investigation techniques and their influence through a metric measuring their distance to mainstream (or other) spaces online. We conclude with a case study of one such space on Moldovan Facebook, demonstrating the mapping technique, provenance work, and influence measure, all of which may be applied practically.
Keywords: alternative influence network, fake news, coordinated inauthentic behavior, participatory propaganda, digital investigation
Richard Rogers: [email protected]
Kamila Koronska: [email protected]
Date submitted: 2024-02-04
Introduction: Situating Post-Truth Spaces
This research was conducted as part of a multi-institutional project aimed at aiding fact-checkers and verification specialists in their work. This larger project, vera.ai, financed by the European Commission, aims to develop methods to that end. These fall into two categories: those that produce leads—such as problematic sources or trending narratives that could be fact-checked—and those that detect fakes, including AI-generated or manipulated content. Of interest to fact-checkers in each instance is the extent to which sources and content attain considerable reach. Significant sources may also share such content and claim they are real. Our work falls into the first category (producing leads) and strives to measure their significance by proposing an influence metric.
Conceptually, the post-truth space may be situated among various spaces where “problematic information” holds sway, and information circulation, campaigning, and operations are undertaken (Jack, 2017). Among these are the “alternative influence network” (Lewis, 2018), “fake news” engagement spaces (Bounegru, Gray, Venturini, & Mauri, 2018; Silverman, 2016), “coordinated inauthentic behavior” campaigns (Giglietto, Righetti, Rossi, & Marino, 2020, p. 867), and “participatory propaganda” circulation (Starbird, DiResta, & DeButts, 2023; Tuters & Noordenbos, 2024; Wanless & Berk, 2020).
Alternative influence networks consist of extreme, often far-right political influencers who host each other on their YouTube channels (de Keulenaar, Tuters, Osborne-Carey, Jurg, & Kisjes, 2022; Lewis, 2020). Fake news engagement spaces are those where political or election-related posts rated as hyper-partisan receive more interactions than posts considered more mainstream (Rogers, 2021). In its commodified version, it may also refer to sets of hyper-partisan posts spread by upstart web outfits, manufactured to attract attention and earn revenue regardless of political alignment (Braun & Eklund, 2019; Herrman, 2016). Coordinated inauthentic behavior campaigns are driven by actors (and perhaps bots) who disseminate the same or related content in synchrony (de-Lima-Santos & Ceron, 2024). The aim is to make the content go viral or to reach a threshold of interactions and views that signals influence. Finally, participatory and ambient propaganda are more bottom-up than orchestrated, relying on various online actors, including everyday users, to spread the word. “Ampligandists” is one term used to capture this actor type (DiResta, 2021). Participatory propaganda implies a blurring of boundaries between propagandists and their audiences (Wanless & Berk, 2017). While such participation may appear organic, it could just as well be performed by actors hired for that purpose, such as front groups, digital advertising and analytics-driven campaigns, or other “disinformation-for-hire” practitioners (Grohmann & Corpus Ong, 2024).
In our work, post-truth spaces reflect the growing interest in studying “alternative facts,” the actors and sources that propagate them, and the sway they hold as part of a counterprogram for “asserting political dominance” and influence (McIntyre, 2018). As scholars have pointed out, the study of the post-truth phenomenon concerns not only the disinformation, alternative assertions, and spin of state media, politicians, and commentators but also how they are received (Wight, 2018); after all, its original definition emphasizes “circumstances in which objective facts are less influential in shaping public opinion than appeals to emotion and personal belief” (Oxford Dictionaries, 2016, n.p.). In this sense, fact-checkers and other verification specialists are also concerned with how to locate alternative facts that are particularly influential.
We situate our work methodologically. First, we describe how these five spaces of interest have been located and studied. Each of them is mapped or charted with different techniques—ranging from network and engagement analysis to content similarity measurements, which we enumerate. Alternative influence networks rely on YouTube co-host networks; fake news comparing the engagement of problematic sources with mainstream ones (often on Facebook); coordinated inauthentic behavior on the rapid sharing of the same content (often on Facebook or X/Twitter); and participatory propaganda on coordination, be it by seemingly everyday users or the digital influence industry. Post-truth space mapping relies on sets of sources that share the same content.
The mapping method surfaces problematic source clusters, which are then used by fact-checkers who are interested in workflows that produce sources they can follow (Graves & Amazeen, 2019); they continually curate source lists they can check for leads or stories of interest to fact-check. Fact-checkers also want to know whether these stories resonate—whether they earn significant engagement on social media, particularly on Facebook. The post-truth space mapping method addresses this by also measuring influence, as discussed below.
In what follows, we situate our concept and method of post-truth space mapping. We then present a case study of Moldova to demonstrate the post-truth space mapping technique and the influence metric for its application by fact-checkers and verification specialists. The demonstration also prepares the ground for employing the method in other countries and regions (initially Eastern Europe) where such spaces are likely active. In the broader Russia-Ukraine war discourse on Moldovan Facebook, we found a mix of problematic sources linked to a larger source set of borderline content that wielded substantial influence in the overall discourse.
Alternative Influence Networks
The term alternative influence network was coined to capture the growing influence of alternative, often extreme, internet celebrities on YouTube (Lewis, 2018). These YouTubers, or internet celebrities and influencers with well-performing YouTube channels, regularly post content, pursuing a “monetary and political agenda” (Soriano & Gaw, 2022, p. 782). Individually, they have the characteristics of successful YouTube performers, with high channel subscriber counts and video content that is monetized (Hua, Ribeiro, Ristenpart, West, & Naaman, 2022).
In tune with the platform’s culture, they employ influencer techniques, cultivating a relatable persona through visibility and relational labor (Abidin, 2016; Baym, 2018) and building a following or fan base (Marwick, 2013). Many often sell merchandise and other products, but their significance lies in the political ideology they espouse, marked by vocabulary associated with white supremacy, misogyny, anti-political correctness, and other reactionary discourse (Marwick & Lewis, 2017). They are described as “reactionary” because of their “general opposition to feminism, social justice, or left-wing politics” (Lewis, 2018, p. 8). They are labeled an alternative influence “network,” owing to their collective efforts, which include co-hosting streamed “debates,” also known as “blood sports,” and collaborating on other online content.
Methodologically, the network is mapped through co-occurrence analysis. These co-occurrences are typically appearance-based. That is, one extreme internet celebrity appears with another on his or her YouTube show. The work is largely manual: compiling a list of alternative influencers and their YouTube channels, then reviewing their videos to identify guest appearances. More specifically, one creates a table and converts it into a network file to visualize co-occurrence, showing how extreme Internet celebrities cluster together.
Another methodological technique to map alternative influence networks is to use YouTube’s API by entering influencer channel IDs to retrieve the channels they subscribe to and feature (Rogers, 2024). Subscriber and feature networks can indicate the strength of ties between influencers. Do they subscribe and/or feature each other more often than other types of channels? Comparing manual results with API data may be useful, given that cross-subscription and featuring are additional indicators of linkage. Another relevant measure is channel mentions: when a YouTuber tags another channel in a video (using @channel), the channel owner is alerted, potentially creating network effects that can be mapped.
Subsequent analyses of the original alternative influence network technique (Lewis, 2018) have given additional attention to YouTube’s recommendation system of “related videos” or those next up on the carousel (Dickinson & Cowin, 2022). In analyzing recommendation algorithms, a great deal of scholarly and journalistic attention has been paid to the so-called “rabbit hole,” which departs from the platform’s interest in extending viewer watch time (Nicas, 2018; Roose, 2019; Tufekci, 2018; Yesilada & Lewandowsky, 2022). This may be accomplished by delivering related videos that are more extreme or sensationalist (Alfano, Fard, Carter, Clutton, & Klein, 2021) or that serve misinformation when looking for information (Avaaz, 2020). More recent scholarship finds that extreme videos are not recommended to viewers of milder content, unless they actively search for them (Brown, Bisbee, Lai, Bonneau, Nagler, & Tucker, 2022). Only then do such videos appear as recommendations, whether in the user’s carousel or elsewhere online. Recent scholarship argues that users are likely already part of the alternative right ecology through YouTube channel subscriptions or by receiving YouTube video links from other sources (e.g., on 4chan) (Chen, Nyhan, Reifler, Robertson, & Wilson, 2023).
The new findings that implicate the user rather than the algorithm for journeying down the rabbit hole are often attributed in part to YouTube’s 2019 changes to its recommendation systems (Chen et al., 2023; Yesilada & Lewandowsky, 2022; YouTube, 2019a). These changes concern multiple efforts to demonetize and suppress harmful and “borderline” content, or material that comes close to violating platform rules (YouTube, 2019b).
Concerning material on social media, the term “borderline content” appears to have originated with YouTube, reported when the platform found a video featuring a Nazi-style saluting worthy of a takedown because it “bordered” on its hate speech policy (Meyer, 2018). Facebook adopted the term the same year, expanding it to cover “sensationalist and provocative content” as well as “click-bait and misinformation” (Constine, 2018, p. 2).
In the work described above, both crawlers and user simulations (or personas) have been used to capture recommendations and assess the extent to which YouTube pushes viewers down the rabbit hole. The YouTube API (at the time of writing) also offers related videos, though not the ones in the Up Next roll. Rather, their relationship lies in the fact that they have been “co-commented upon.”
Fake News Engagement Spaces
Fake news became a buzzword in 2016, referring especially to a type of content that drew considerable engagement on Facebook during the U.S. election campaign. It refers to fabricated and “hyper-partisan” news sources that collectively outperformed mainstream outlets in the months before the election (Silverman, 2016). Such content received high engagement (likes/reactions, shares, and comments) and typically leaned toward the political right. Hyper-partisan or “ideological web operators” (Herrman, 2016, p. 50) are particularly relevant because they garnered a disproportionate share of interactions compared with the other content types, such as “pink slime” websites that mimic news sites, but are impostors (Bengani, 2020).
In the scholarly literature, fake news has been defined in various ways. One review identified five uses of the term, ranging from satire and parody to news fabrication, manipulation, and propaganda (Tandoc, Lim, & Ling, 2018). Whereas the first two aim to entertain, the latter aim to deceive. Other expositions expanded these categories under the broader term “information disorders,” advocating for the term to be eschewed in favor of alternatives (Wardle, 2023; Wardle & Derakhshan, 2017). In this regard, other proposals have sought to change the terminology. For example, Facebook (now Meta) prefers “false news” over fake news. This redefinition (which excludes hyper-partisan or borderline content) has the advantage of shrinking the scale of the problem (Rogers, 2020).
One recurring theme in fake news production is profit. The original Facebook “fake news” story mentioned a cottage industry in North Macedonia that created websites such as TrumpVision365.com, USConservativeToday.com, DonaldTrumpNews.co, and USADailyPolitics.com, populating them with “outrageous” political content to attract clicks and Google ad revenue (Silverman, 2016; Silverman & Alexander, 2016). As many reported, it worked. An in-depth examination found that an online marketing course by a North Macedonian local, called the “Facebook Marketing University,” “launched most of the young fake news disseminators into their careers” (Hughes & Waismel-Manor, 2021, p. 21). It markets itself as follows: “maybe you have heard that a team of individuals from Macedonia somehow helped U.S. President Donald Trump win the 2016 US elections. It was my crew and my students from Macedonia” (Ceselkoski, 2018, p. 1). The course trained “hundreds of students” to build websites and Facebook pages that produced “sensational content” with “clickbait headlines” (Hughes & Waismel-Manor, 2021). These Facebook operators were in it for the money, and many of them experimented with health or other non-political content before discovering the pecuniary potential of election-related material. Through A/B testing, trial and error, and niche experiments, as suggested by the marketing course, they learned that pro-Trump (or especially anti-opponent) content was far more profitable than content on other candidates or topics.
Methodologically, both data journalists and fake news operators used the same software to analyze Facebook engagement: BuzzSumo, a marketing research tool (Ceselkoski, 2018; Silverman, 2016). To show that fake news outperformed mainstream news on Facebook, journalists ran election-related queries in BuzzSumo, retrieving lists of websites ranked by interaction score. They repeated this for three 3-month periods, tallying interaction counts for stories from mainstream news sites (based on a curated list) and from sites variously labeled “fake,” “false,” “untrustworthy,” or “hoax” (Silverman, 2016). The term “Fake news” persisted, but as Silverman later noted, it became an “empty slogan” after it was “manipulated” by politicians (initially Donald Trump) to delegitimize media organizations (Silverman, 2017).
The study of the significance of fake news on Facebook has shifted. In response to original fake news reporting and other studies highlighting the strong performance of hyper-partisan content, particularly from the right, discussion has centered on the difference between engagement and “reach,” a marketing term for content views (Roose, 2021). Because reach data were not public, Facebook argued that traffic to hyper-partisan websites was comparatively modest, downplaying the magnitude of the problem. In this way, Facebook redefined fake news, as mentioned above, and introduced a different metric for its quantification.
Campaign Spaces Organized through Coordinated Inauthentic Behavior
“Coordinated inauthentic behavior” (CIB) is a term coined by Facebook to describe “networks of accounts [that] mislead others about who they are, or what they’re doing” (Facebook, 2018, p. 1). Both the definition and the takedown actions the company has implemented against these activities should be seen in the context of not only its fake news problem but also the Russian influence campaign on its platforms during the 2016 U.S. election and beyond (DiResta et al., 2018; Nimmo & Agranovich, 2022). The question facing researchers working both inside and outside social media platforms, occasionally in collaboration, concerns distinguishing between legitimate and illegitimate online campaigning. Often, the distinction rests on artificial versus genuine users and automated or timed behaviors versus less orchestrated activity.
There are signals or indicators that are gauged to ascertain fake sources and accounts. For example, were the campaign pages and domains created or registered around the same time frame, and does the campaigning activity coincide with a 9am–5pm, Monday-Friday workday (Nimmo & Torrey, 2022)? Once these operations are discovered, Meta, for example, blocks the web domains from appearing on its platforms and removes the Facebook pages, groups, and accounts linking to them.
Distinctions between the authentic and inauthentic may be blurry, given that campaigns may be joined by “unwitting crowds” who participate in the activities and assume they are genuine (Wilson & Starbird, 2020). In studying coordinated inauthentic behavior, impact or influence can be measured in these terms: How many likes, reactions, or shares came from unwitting users’ accounts not associated with the campaign? Such measures show the spread or propagation beyond the operation itself.
Whether padded by the inauthentic accounts or by authentic users, the achieved metrics (perhaps combined with the campaign’s duration) are how influence is measured, at least in the first instance. In the 2016 Russian campaign on Facebook, propaganda posts were shared “hundreds of millions of times” (Timberg, 2017, p. 1) and were not detected until after the U.S. election. More recent campaigns propagating Iranian narratives against the United States, Israel, and Saudi Arabia—or Russian narratives about the war in Ukraine—have been far less effective, despite their persistence (Lim et al., 2019; Nimmo & Torrey, 2022).
Approaches to studying coordinated inauthentic behavior range from analyzing account and source features or signals to examining their networking activities, especially their interconnections and timely inter-referencing. Inauthenticity may also reside in the use of social bots or botnets for “engineered social tampering” (Ferrara, Varol, Davis, Menczer, & Flammini, 2016, p. 96). Bots may automatically retweet another account’s post, amplifying it; a botnet could perform the same on a larger scale. In all cases, the purpose is to make a post appear influential and push it beyond the operation’s bubble.
A signals approach, as applied to X/Twitter, for example, would examine features such as an (uncopied) profile photo, account creation date, and username length and composition, where a good photo, account maturity, and shorter usernames (without alphanumerical characters) indicate authenticity (Ferrara et al., 2016). A more comprehensive ‘signature’ approach would add tweeting and following characteristics, looking for patterns, such as high numbers of retweets or follows.
A network analysis may also examine follow-follower relationships, identifying accounts with star-shaped patterns or clusters of accounts that largely follow only one another. Coordination may be assessed through content-referencing, including the extent to which they retweet the same set of accounts’ tweets and/or the same URLs. One detection approach (for Twitter) looked for “retweeting,” “co-retweeting,” and “co-tweeting,” where the coordinating accounts shared the same content in three ways (Keller, Schoch, Stier, & Yang, 2019).
Typical influence campaigns, as noted above, are seeded with combinations of websites and social media accounts or pages. A network analysis would examine the extent to which a set of Facebook Pages references the same websites, as was found in the case of a Russian influence network reported by Meta (Nimmo & Torrey, 2022). The same approach may be taken for X/Twitter campaign detection. To study influence, particularly on Facebook, one would prefer to have the number of views that a post has received together with its engagement. These data points enable the application of a metric that gauges engagement by reach. CrowdTangle once provided the engagement metrics (without the reach); more recently, Meta’s Content Library also serves reach data.
Participatory Propaganda
Scholars contrast participatory propaganda with the mass media broadcast model associated with propaganda (Ellul, 1965; Wanless & Berk, 2020). It takes as the point of departure an active, networking audience as its locus of attention rather than a target audience to be manipulated by a set of operators (Benkler, Farris, & Roberts, 2018). There is a second difference, too. While it may still be considered a program, its origins are obscured or diffused, lacking a clear master source.
There are at least two types of participatory campaigning for gaining influence. In one version, the campaign’s participants are amplifiers or “ampligandists,” not just consuming the narratives but also spreading them (Starbird, Arif, & Wilson, 2019). The spread may be improvisational or unwitting (Starbird et al., 2023).
A second type seeks to exploit existing “culture wars” or sensitive societal issues (those already causing division) to further widen the divide. Niche, receptive audiences may be targeted to aid in dissemination (Udupa, 2023). Here, the Cambridge Analytica scandal is often referenced to demonstrate how online audience segmentation techniques can be used for strategic, divisive campaigning (Till, 2021). Certain issue publics (gathered through Facebook ad keyword searches) were targeted and engaged to join in the messaging (Venturini & Rogers, 2019).
It is important to state that participatory propaganda spaces are distinct from other space types discussed above in that they do not obscure or cloak activities to make them appear authentic, at least when operated by social media users who are identifiable. One could argue that their success could be measured by their distance from (or lack of co-mingling with) actors characteristic of the other space types: alternative network influencers, fake news manufacturers, and coordinators of inauthentic behavior. Indeed, these characteristics make them more difficult to study because they have fewer markers beyond those of everyday users (Lewandowsky, 2022). They may reference and share similar themes and materials; however, this is how the study of these spaces may be approached.
Studies concerning participatory propaganda thus concentrate on the narratives and cultural products they circulate and create, looking for thematic clusters and memetic participation in the form of image production or phrasal memes (Tuters & Hagen, 2020). How are Ukrainian war refugees discussed and depicted on social media? Can it be considered propagandistic? Are they predominantly circulated by users who are identifiable and not known to spread disinformation?
Alternatively, to study participatory propaganda, one could focus not on the content’s ordinariness, but on the actors behind it, seeking to shorten the distance between participants and the seeding parties and to uncover the origins. This approach assumes that participatory propaganda is likely not organic and that behind it lies the “digital influence industry” (Briant, 2023). Here, one looks for signs of astroturfing, micro-targeting, and similar digital influencing tactics, connecting them or, at least, the content to the seemingly organic participatory propagandists (Grohmann & Corpus Ong, 2024).
Mapping out the substantive connections between the “masters” and the participatory propagandists could conceivably be approached in the study of post-truth spaces, as we discuss. These spaces may comprise one or more of the actor types discussed so far and may include differing constellations of them. The approach also studies the distance between clusters, evaluating the extent to which these spaces overlap with others, including more mainstream ones. Are they distinctive or so similar that they cannot be disentangled? In the latter case, post-truth contents have diffused, an indicator of the campaign’s success.
Post-Truth Spaces Online
Post-truth spaces are defined here as clusters of densely interlinked web pages or public social media groups, pages, and accounts that are either difficult to verify or recognized by verification experts as sources of disinformation. These demarcated spaces in a network sense may also be populated by actors from the space typology outlined above—such as alternative political influencers, fake news manufacturers, inauthentic behavior coordinators and more bottom-up ampligandists.
At least two avenues for analyzing post-truth space are proposed here. The first involves examining actor constellations and the extent to which they include sources from distinct space types. Is the space primarily organized by well-known alternative political influencers, or does it feature sources whose provenance is difficult to verify? The second line of study concerns their overlap, proximity, or penetration into mainstream clusters. Are identifiable post-truth spaces marginal or more central? The intermingling of fringe and mainstream elements would indicate the influence or impact of a post-truth space.
Both approaches are applied in the Moldova case study, described below, where we test the mapping technique, use digital investigation methods, and propose an influence metric to measure impact. Additionally, we discuss the practical use of the post-truth space mapping method for fact-checkers.
Moldova: Case Study
The Russia-Ukraine war has been accompanied by influence operations orchestrated by many parties. Our scholarly focus is on Eastern Europe, particularly former Soviet republics and Eastern bloc countries, often with significant Russian-speaking populations, such as Moldova.
Described in peace and security policy circles as “divided between pro-European integration and Soviet nostalgia” (Dvornikova, 2020, p. 30), Moldova has been found to be a target of disinformation. Indeed, it faces “intense, aggressive and constant (. . .) propaganda by pro-Russian forces,” which comprises both external and domestic actors (Muravschi, 2024, p. 3). Media monitoring reports by local watchdog organizations indicate that, until a 2022 ban, Russian stations dominated Moldovan television in ratings, and that such content is now most prevalent on social media, particularly Facebook, Telegram, and TikTok (Revenco, 2024). Pro-Russian and anti-EU/NATO content are also propagated by minority pro-Kremlin political parties, including Shor (the party of the oligarch, Ilan Shor), which was banned.
At the time of the mapping, Moldova had been preparing for presidential elections, which also included a referendum that, if adopted, would put the country on the path toward integration in the European Union. Given the stakes, area experts highlighted increased Kremlin-orchestrated information operations that aligned with pro-Kremlin minority parties (Panainte & Culeac, 2024). Following the revocation of Russian TV station licenses and the banning of websites in 2022 and 2023 for spreading disinformation, information operations are now deployed through social media and the remaining pro-Kremlin media outlets in Moldova.
Whether these influence operations may be located is one question. Another is the extent of their co-mingling and intersections with more mainstream political discourse, including the majority, pro-European party and political movement. Are there post-truth spaces that stand alone, intersect with fringe domestic actors, or integrate into other more mainstream (or non-fringe) spaces? Influence becomes a measure of these proximities and intersections.
Post-Truth Space Mapping Method
Our analysis conducted against the backdrop of upcoming elections, pro-European integration campaigning, and pro-Russian and Kremlin-backed counter-campaigning, concerns the war on the doorsteps. It begins with a list of war-related keywords queried in CrowdTangle, the Facebook data source, which returned posts containing these keywords, along with accounts, pages, and groups that posted them (see Figure 1). We chose Facebook not only because of its significance as a source of Russian disinformation discussed by the local watchdog (Revenco, 2024) but also because it is by far the most used social media platform in the country (Statcounter, 2024).
Figure 1. Post-truth space mapping technique protocol.
Next, we tidy the data by shortening URLs so that each web page URL is reduced to its domain, while Facebook native links are resolved to a page or an individual public account. In Gephi, the network analysis and exploration software, we apply ForceAtlas2 and modularity algorithms to detect communities of sources (accounts, pages, or groups) sharing URLs (Jacomy, 2021; Jacomy, Venturini, Heymann, & Bastian, 2014). Applying visual network analysis, we adjust the spatialization settings to produce clusters (and holes) (Decuypere, 2020; Venturini, Jacomy, & Jensen, 2021).[2]
Figure 2. Russia-Ukraine war-related clusters from the Moldova Facebook, March 2023.
Through this approach, we map a Russia-Ukraine war space on Moldovan Facebook, identifying distinctive clusters. We dub three proximate clusters as “post-truth,” as they are dominated by nodes that are either difficult to verify, known disinformation purveyors, or aligned with the alternative space typology, as described above (see Figure 2).
Finally, we calculate an influence measure by assessing post-truth cluster penetration into other clusters. We calculate the interpenetration between these clusters and the others (through a particular betweenness centrality measure), leading to observations about the extent to which the clusters have an impact on the larger network.[3]
Post-Truth Space Mapping Findings
The top nodes in the post-truth constellation are primarily composed of Facebook entities that could be described as propagandists or ampligandists. These clusters are visibly positioned at the periphery of the graph, though at least one extends into the central area. We briefly discuss the top nodes in each post-truth cluster.
One is stiripesurse.ro, which the mainstream outlet Libertatea labels as “alternative media” (Păun, 2022). It has a history of publishing inaccurate information about the Russo-Ukrainian war. For example, after the Bucha massacre, it published an article that denied the crimes in Bucha, referring to the event as an alleged massacre. The site features a special section on the conflict, with articles that share similar positions.
Another is from the Romanian digital creator Liliana Mitrea (with more than 17,000 followers), who could be described as an ampligandist in that her activity consists of resharing posts from other users, creating scant original content. While covering various topics, she frequently includes political commentary, particularly on the East-West divide. One post that garnered shares was an “Open Letter to the U.S. Embassy,” comparing NATO interventions, such as those in Kosovo, with Russia’s actions in Ukraine. The letter also casts doubt on the Bucha massacre.
Another example of participatory propaganda in the post-truth constellation is the activity of Ionel Mojoiu. Like Liliana Mitrea, he is a digital creator, albeit with a smaller follower count (fewer than 10,000). Unlike Mitrea’s profile, we cannot deduce much about him—such as his appearance, where he lives, or whether he has any relatives. His national sentiments are far clearer; he is a member of several pro-Russian groups, including “Support of Great Russia,” “Friends of the Russian Nation,” and “Heart of Russia.” Mojoiu’s activity on Facebook primarily focuses on sharing political content, specifically commentary on military campaigns and conflicts, including the Russo-Ukrainian war. Most importantly, his account launders content from Russian news sites (tass.com, 1lurer.am, lenta.ru) without declaring the sources. At times, the account also spreads false narratives, such as an alleged lawsuit against former NATO chief Jens Stoltenberg.
Apart from the post-truth spaces, there are three other notable clusters. The largest one is what we call the borderline cluster with a mix of news sources, some problematic, others less so. Its largest node is Aktual24.ro, a tabloid-like news site that has been placed on the list of disinformation providers by the Romanian National Directorate of Cyber Security (Albu, 2022). This list includes the Russian state source, Sputnik, whose operations in Europe were suspended by the European Union in March 2022.
The sources from the Stiri pe surse post-truth cluster that penetrate the Aktual 24 borderline space emphasize how the war in Ukraine (and the shift away from Russian imports) has caused energy bills to rise, leading to financial distress for ordinary households. These and other domestic problems are linked to the conflict.
Another notable bridge from the post-truth space to the borderline cluster is a small community centered around the Facebook Group “Popor dezamagit” (“Disappointed People”), which was created by a page of the same name, whose owner did not complete the verification process according to the Facebook transparency panel.[4] Both the Page and the Group share a style characterized by tongue-in-cheek posts that portray a country in a dire state, where ordinary people are the primary losers, given the rising energy bills and other pressures associated with the war.
The post-truth clusters and the borderline one differ significantly from the others: the conservative/nationalist, pro-Ukraine, mainstream media, and military analysis spaces are either well-known sources or have markers that allow them to be identified or verified.
Verification Techniques and Cluster Influence Measures
Concerning verification methods, Facebook provides indicators that make pages or accounts difficult to verify. These include account name history showing previous affiliations, a “digital creator” name still set to default, and a verified status that is (long) pending. In the first instance, the account or page name has been changed, and earlier names are without identifying information. In the second indication, accounts may monetize opportunities, but the default digital creator name has not been replaced with the creator’s actual name. Finally, a third indicator is an incomplete verification status. That is, for the verified status to be approved, Meta has asked for additional verification information, but it has not been provided. The page or account remains online while that update is pending.
To measure the extent of the impact between different node groups, we developed a cluster (or community) betweenness metric, which we used as a proxy for influence (see Table 1). This allowed us to gauge the extent to which the information shared in post-truth spaces extended into other clusters. Higher betweenness signifies that a cluster is positioned between most non-post-truth communities, indicating greater centrality and influence. For our network, we found that all post-truth clusters have low betweenness, indicating low centrality and thus minimum impact within the overall network, though they supply bridges to the most significant (borderline) cluster.
Table 1. Betweenness Centrality Measures of Each Community in the Network, Together With its Top Node.
|
Community |
Betweenness |
|
Post-truth (Stiri pe surse) |
76.39 |
|
Post-truth (Liliana Mitrea) |
12.73 |
|
Post-truth (Ionlel Mojoiu) |
11.14 |
|
Conservatives (Newstrack.ro) |
1768.29 |
|
Borderline (Aktual.24.ro) |
2567.10 |
|
Finance/military analysis (Dcbusiness.ro) |
1611.55 |
|
Mainstream media (Libertatea.ro) |
1798.77 |
|
Pro-Ukraine (Uniti pentru ucraina) |
1661.34 |
The borderline cluster has the highest level of betweenness, suggesting that a significant amount of the conversation about the Ukraine war is not driven by spaces labeled as more mainstream media, but by nodes that straddle the post-truth spaces.
For fact-checkers and other verification specialists, this finding would be significant as a lead. According to the metric, the sources in the borderline content cluster have considerable sway and are linked (through shared content) to the post-truth space. Given the findings from the post-truth space mapping, these are sources that could be added to curated lists; their stories would be worth monitoring.
Conclusions: Post-Truth Spaces, Authenticity, and Influence
Conceptually, post-truth spaces are demarcated sets of interacting and inter-referencing actors working to advance programs to assert political influence. The post-truth descriptor was chosen because of the substance of the information intervention, be it termed alternative facts or problematic information.
The alternative influence network consists of Internet personalities on YouTube, often extreme, who have been described in the original mapping as reactionary toward U.S. liberal politics (Lewis, 2018). Fake news engagement spaces are those populated by political clickbait, often for money-making purposes. Coordinated inauthentic behavior campaigns consist of masked actors working together to make content appear popular online. Participatory propaganda blurs the master source of a campaign because it appears that everyday users are improvisationally creating and spreading the content of a particular program.
Each of these spaces may be demarcated. Alternative influence networks on YouTube are co-appearance or co-collaborative networks of influencers appearing on each other’s videos or co-authoring content. Fake news engagement spaces—identified through election-related or other thematic keyword queries—are characterized by competition between fake and mainstream news. Coordinated inauthentic behavior campaigns are detected by traces of actors working in concert over time to make online posts appear popular. Participatory propaganda, lastly, is problematic content created and spread by everyday users with no palpable master source.
Having situated the post-truth space among these other spaces, we conducted a case study to locate them on Moldovan Facebook in the context of the Russia-Ukraine war. The first demarcates a discursive space through related keyword queries. Subsequently, we undertook a network analysis where the sources (nodes) sharing the same URLs (edges) were mapped out using visual network analysis to separate the clusters. In the analysis, the post-truth space was characterized as such because it contains known disinformation spreaders, as well as those difficult to verify (through digital investigation techniques), and that represent a specific point of view. While these pages, groups, and accounts reference many of the same sources, their URLs are rarely shared outside their clusters, though there are bridges to a significant cluster found to contain (pro-Russian) borderline content. Indeed, when measuring the extent of the overlap with other clusters, which we describe as an influence metric, the post-truth spaces have limited degrees of intersection. The cluster containing borderline content, however, is the most influential in the entire network and is proximate to the post-truth spaces.
Sources in post-truth spaces are of interest for further analysis by fact-checkers and verification specialists, who may add them to their curated lists of sources to monitor or peruse for stories to be fact-checked. Future work should be oriented toward sharing these techniques for further evaluation and expanding case study treatment across Eastern Europe and beyond.
References
Abidin, C. (2016). Visibility labour: Engaging with influencers’ fashion brands and #OOTD advertorial campaigns on Instagram. Media International Australia, 161(1), 86–100. https://doi.org/10.1177/1329878X16665177
Albu, O. (2022, October 5). Jurnalistul Ovidiu Albu acuză guvernul că i-a închis site-ul aktual24.ro, în bază unei minciuni [Journalist Ovidiu Albu accuses the government of shutting down his site aktual24.ro based on a lie]. HotNews. Retrieved from https://hotnews.ro/jurnalistul-ovidiu-albu-acuza-guvernul-ca-i-a-nchis-site-ul-aktual24-ro-n-baza-unei-minciuni-ct-rusia-de-mare-sunt-mii-de-trolli-care-ma-njura-ca-scriu-rele-de-puti-141887
Alfano, M., Fard, A. E., Carter, J. A., Clutton, P., & Klein, C. (2021). Technologically scaffolded atypical cognition: The case of YouTube’s recommender system. Synthese, 199(1–2), 835–858. https://doi.org/10.1007/s11229-020-02724-x
Allbright, C. (2017, November 1). A Russian Facebook page organized a protest in Texas. Texas Tribune. Retrieved from https://www.texastribune.org/2017/11/01/russian-facebook-page-organized-protest-texas-different-russian-page-l/
Avaaz. (2020). Why is YouTube broadcasting climate misinformation to millions? [Report]. Avaaz. Retrieved from https://secure.avaaz.org/campaign/en/youtube_climate_misinformation/
Baym, N. K. (2018). Playing to the crowd. New York: New York University Press.
Bengani, P. (2020). As election looms, a network of mysterious “pink slime” local news outlets nearly triples in size. Columbia Journalism Review. Retrieved from https://www.cjr.org/tow_center_reports/pink-slime-journalism.php
Benkler, Y., Farris, R., & Roberts, H. (2018). Network propaganda. Oxford, UK: Oxford University Press. https://doi.org/10.1093/oso/9780190923624.001.0001
Bounegru, L., Gray, J., Venturini, T., & Mauri, M. (2018). A field guide to “fake news” and other information disorders. Amsterdam, the Netherlands: Public Data Lab. https://doi.org/10.2139/ssrn.3097666
Braun, J. A., & Eklund, J. L. (2019). Fake news, real money: Ad tech platforms, profit-driven hoaxes, and the business of journalism. Digital Journalism, 7(1), 1–21. https://doi.org/10.1080/21670811.2018.1556314
Briant, E. L. (2023). Researching influence operations: Dark arts. In C. Bjola & I. Manor (Eds.), The Oxford handbook of digital diplomacy (pp. 80–99). Oxford, UK: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780198859291.013.48
Brown, M. A., Bisbee, J., Lai, A., Bonneau, R., Nagler, J., & Tucker, J. A. (2022). Echo chambers, rabbit holes, and algorithmic bias: How YouTube recommends content to real users. SSRN. https://doi.org/10.2139/ssrn.4114905
Callison, W., & Slobodian, Q. (2021). Coronapolitics from the Reichstag to the Capitol. Boston Review, 12. Retrieved from https://www.bostonreview.net/articles/coronapolitics-from-the-reichstag-to-the-capitol/
Ceselkoski, M. (2018). The man who accidentally helped Donald Trump win the 2016 US elections. Retrieved from https://mirkoceselkoski.me
Chen, A. Y., Nyhan, B., Reifler, J., Robertson, R. E., & Wilson, C. (2023). Subscriptions and external links help drive resentful users to alternative and extremist YouTube channels. Science Advances, 9(35), eadd8080. https://doi.org/10.1126/sciadv.add8080
Constine, J. (2018, November 15). Facebook will change algorithm to demote “borderline content” that almost violates policies. TechCrunch. Retrieved from https://techcrunch.com/2018/11/15/facebook-borderline-content/
Cvetkovska, S. (2018, July 12). How a Macedonian town became an epicenter of fake news. Mail & Guardian. Retrieved from https://mg.co.za/article/2018-07-12-how-a-macedonian-town-became-an-epicentre-of-fake-news
Decuypere, M. (2020). Visual network analysis: A qualitative method for researching sociomaterial practice. Qualitative Research, 20(1), 73–90. https://doi.org/10.1177/1468794118816613
de Keulenaar, E., Tuters, M., Osborne-Carey, C., Jurg, D., & Kisjes, I. (2022). A free market in extreme speech: Scientific racism and bloodsports on YouTube. Digital Scholarship in the Humanities, 37(4), 949–971. https://doi.org/10.1093/llc/fqab076
de-Lima-Santos, M. F., & Ceron, W. (2024). Coordinated amplification, coordinated inauthentic behaviour, orchestrated campaigns: A systematic literature review of coordinated inauthentic content on online social networks. In T. Erbaysal-Filibeli & M. Öneren-Özbek (Eds.), Mapping lies in the global media sphere (pp. 165–184). London, UK: Routledge. https://doi.org/10.4324/9781003403203-14
Dickinson, R., & Cowin, T. (2022). The kids are alt-right: An introduction to PragerU and its role in radicalization in the United States. Patterns of Prejudice, 56(2–3), 95–122. https://doi.org/10.1080/0031322X.2023.2219167
DiResta, R. (2021, October 9). It’s not misinformation. It’s amplified propaganda. The Atlantic. Retrieved from https://www.theatlantic.com/ideas/archive/2021/10/disinformation-propaganda-amplification-ampliganda/620365/
DiResta, R., Shaffer, K., Ruppel, B., Sullivan, D., Matney, R., Fox, R., . . ., & Johnson, B. (2018). The tactics and tropes of the Internet Research Agency. Austin, TX: New Knowledge. Retrieved from https://digitalcommons.unl.edu/senatedocs/2/?ref
Dvornikova, P. (2020). Foreign influence and disinformation in Moldova. The Peace & Security Monitor: South East Europe & Black Sea Region, 9, 30–39.
Ellul, J. (1965). Propaganda: The formation of men’s attitudes. New York, NY: Vintage.
Facebook. (2018). Coordinated inauthentic behavior explained. Facebook Newsroom. Retrieved from https://about.fb.com/news/2018/12/inside-feed-coordinated-inauthentic-behavior/
Ferrara, E., Varol, O., Davis, C., Menczer, F., & Flammini, A. (2016). The rise of social bots. Communications of the ACM, 59(7), 96–104. https://doi.org/10.1145/2818717
Giglietto, F., Righetti, N., Rossi, L., & Marino, G. (2020). It takes a village to manipulate the media: Coordinated link sharing behavior during 2018 and 2019 Italian elections. Information, Communication & Society, 23(6), 867–891. https://doi.org/10.1080/1369118X.2020.1739732
Graves, L., & Amazeen, M. (2019). Fact-checking as idea and practice in journalism. Oxford, UK: Oxford University Press.
Grohmann, R., & Corpus Ong, J. (2024). Disinformation-for-hire as everyday digital labor: Introduction to the special issue. Social Media + Society, 10(1), 1–9. https://doi.org/10.1177/20563051231224723
Herrman, J. (2016, August 24). Inside Facebook’s (totally insane, unintentionally gigantic, hyperpartisan) political-media machine. The New York Times. Retrieved from https://www.nytimes.com/2016/08/24/magazine/inside-facebooks-totally-insane-unintentionally-gigantic-hyperpartisan-political-media-machine.html
Hua, Y., Ribeiro, M. H., Ristenpart, T., West, R., & Naaman, M. (2022). Characterizing alternative monetization strategies on YouTube. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW2), Article 283, 1–30. https://doi.org/10.1145/3555174
Hughes, H. C., & Waismel-Manor, I. (2021). The Macedonian fake news industry and the 2016 US election. PS: Political Science & Politics, 54(1), 19–23. https://doi.org/10.1017/S1049096520001297
Jack, C. (2017). Lexicon of lies: Terms for problematic information. New York, NY: Data & Society Research Institute.
Jacomy, M. (2021). Situating visual network analysis (Doctoral dissertation, Aalborg University, Denmark). Retrieved from https://vbn.aau.dk/en/publications/situating-visual-network-analysis
Jacomy, M., Venturini, T., Heymann, S., & Bastian, M. (2014). ForceAtlas2, a continuous graph layout algorithm for handy network visualization designed for the Gephi software. PLOS ONE, 9(6), e98679. https://doi.org/10.1371/journal.pone.0098679
Keller, F. B., Schoch, D., Stier, S., & Yang, J. (2019). Political astroturfing on Twitter: How to coordinate a disinformation campaign. Political Communication, 37(2), 256–280. https://doi.org/10.1080/10584609.2019.1661888
Lewandowsky, S. (2022). Fake news and participatory propaganda. In R. F. Pohl (Ed.), Cognitive illusions (pp. 324–340). New York, NY: Routledge.
Lewis, R. (2018). Alternative influence: Broadcasting the reactionary right on YouTube. New York, NY: Data & Society Research Institute.
Lewis, R. (2020). “This is what the news won’t show you”: YouTube creators and the reactionary politics of micro-celebrity. Television & New Media, 21(2), 201–217. https://doi.org/10.1177/1527476419879919
Lim, G., Maynier, E., Scott-Railton, J., Fittarelli, A., Moran, N., & Deibert, R. (2019). Burned after reading: Endless Mayfly’s ephemeral disinformation campaign. Citizen Lab. Retrieved from https://citizenlab.ca/2019/05/burned-after-reading-endless-mayflys-ephemeral-disinformation-campaign/
Marwick, A. E. (2013). Status update: Celebrity, publicity, and branding in the social media age. New Haven, CT: Yale University Press.
Marwick, A. E., & Lewis, R. (2017). Media manipulation and disinformation online. Data & Society. Retrieved from https://datasociety.net/library/media-manipulation-and-disinformation-online/
McIntyre, L. (2018). Post-truth. Cambridge, MA: MIT Press.
Meyer, R. (2018, March 20). YouTube removes the “Hail, Trump” video from search. The Atlantic. Retrieved from https://www.theatlantic.com/technology/archive/2018/03/youtube-removes-the-atlantics-hail-trump-video-from-search/555941/
Muravschi, E. (2024, January). Disinformation against EU & NATO in Moldova. WatchDog.md. Retrieved from https://watchdog.md/wp-content/uploads/2024/01/Disinformation-against-EU-and-NATO-in-Moldova-1.pdf
Nicas, J. (2018, February 7). How YouTube drives people to the internet’s darkest corners. Wall Street Journal. Retrieved from https://www.wsj.com/articles/how-youtube-drives-viewers-to-the-internets-darkest-corners-1518020478
Nimmo, B., & Agranovich, D. (2022, September 27). Removing coordinated inauthentic behavior from China and Russia. Facebook. Retrieved from https://about.fb.com/news/2022/09/removing-coordinated-inauthentic-behavior-from-china-and-russia/
Nimmo, B., & Torrey, M. (2022, September 27). Taking down coordinated inauthentic behavior from Russia and China. Facebook. Retrieved from https://about.fb.com/wp-content/uploads/2022/11/CIB-Report_-China-Russia-Sept-2022.pdf
Oxford Dictionaries. (2016). Post-truth. Retrieved from https://languages.oup.com/word-of-the-year/2016/
Panainte, P., & Culeac, P. (2024). Republic of Moldova 2024 presidential election and EU referendum: Pre-election assessment. German Marshall Fund. Retrieved from https://www.gmfus.org/news/republic-moldova-2024-presidential-election-and-eu-referendum-pre-election-risk-assessment
Păun, M. (2022, September 19). Rețeta de pe internet prin care extrema dreaptă și propaganda pro-rusă cresc pe spinarea facturilor românilor [The internet recipe through which the far right and pro-Russian propaganda grow on the backs of Romanian bills]. Libertatea. Retrieved from https://www.libertatea.ro/opinii/reteta-de-pe-internet-prin-care-extrema-dreapta-si-propaganda-pro-rusa-cresc-pe-spinarea-facturilor-romanilor-site-urile-implicate-4223967
Quandt, T. (2018). Dark participation. Media and Communication, 6(4), 36–48. https://doi.org/10.17645/mac.v6i4.1519
Revenco, G. (2024). Monitoring report on gender-based disinformation and manipulation (October 5–November 5, 2023). WatchDog.md. Retrieved from https://watchdog.md/wp-content/uploads/2024/01/Monitoring-Report-on-Gender-Based-Disinformation-and-Manipulation_5-Oct-5-Nov.2023_WDMD_compressed.pdf
Rogers, R. (2020). The scale of Facebook’s problem depends upon how “fake news” is classified. Harvard Kennedy School Misinformation Review, 1(6), 1–15. https://doi.org/10.37016/mr-2020-43
Rogers, R. (2021). Marginalizing the mainstream: How social media privilege political information. Frontiers in Big Data, 4, 689036. https://doi.org/10.3389/fdata.2021.689036
Rogers, R. (2024). Doing digital methods (2nd ed.). London, UK: Sage Publications.
Roose, K. (2019, June 8). The making of a YouTube radical. The New York Times. Retrieved from https://www.nytimes.com/interactive/2019/06/08/technology/youtube-radical.html
Roose, K. (2021, July 14). Inside Facebook’s data wars. The New York Times. Retrieved from https://www.nytimes.com/2021/07/14/technology/facebook-data.html
Ruijgrok, K. (2017). From the web to the streets: Internet and protests under authoritarian regimes. Democratization, 24(3), 498–520. https://doi.org/10.1080/13510347.2016.1223630
Silverman, C. (2016, November 16). This analysis shows how viral fake election news stories outperformed real news on Facebook. BuzzFeed News. Retrieved from https://www.buzzfeednews.com/article/craigsilverman/viral-fake-election-news-outperformed-real-news-on-facebook
Silverman, C. (2017, December 31). I helped popularize the term “fake news” and now I cringe every time I hear it. BuzzFeed News. Retrieved from https://www.buzzfeednews.com/article/craigsilverman/i-helped-popularize-the-term-fake-news-and-now-i-cringe
Silverman, C., & Alexander, L. (2016, November 3). How teens in the Balkans are duping Trump supporters with fake news. BuzzFeed News. https://www.buzzfeednews.com/article/craigsilverman/how-macedonia-became-a-global-hub-for-pro-trump-misinfo
Silverman, C., Feder, J. L., Cvetkovska, S., & Belford, A. (2018, July 18). Macedonia’s pro-Trump fake news industry had American links and is under investigation for possible Russia ties. BuzzFeed News. Retrieved from https://www.buzzfeednews.com/article/craigsilverman/inside-macedonia-pro-trump-fake-news-industry
Soriano, C. R. R., & Gaw, F. (2022). Platforms, alternative influence, and networked political brokerage on YouTube. Convergence, 28(3), 781–803. https://doi.org/10.1177/13548565211029769
Starbird, K., Arif, A., & Wilson, T. (2019). Disinformation as collaborative work: Surfacing the participatory nature of strategic information operations. Proceedings of the ACM on Human-Computer Interaction, 3(CSCW), Article 127, 1–26. https://doi.org/10.1145/3359229
Starbird, K., DiResta, R., & DeButts, M. (2023). Influence and improvisation: Participatory disinformation during the 2020 US election. Social Media+ Society, 9(2). https://doi.org/20563051231177943.
Statcounter. (2024). Social media stats Republic of Moldova Jan - Dec 2024, Statcounter. Retrieved from https://gs.statcounter.com/social-media-stats/all/moldova/2024
Subramanian, S. (2017). Inside the Macedonian fake-news complex. Wired. Retrieved from https://www.wired.com/2017/02/veles-macedonia-fake-news/
Tandoc, E. C., Jr., Lim, Z. W., & Ling, R. (2018). Defining “fake news”: A typology of scholarly definitions. Digital Journalism, 6(2), 137–153. https://doi.org/10.1080/21670811.2017.1360143
Till, C. (2021). Propaganda through “reflexive control” and the mediated construction of reality. New Media & Society, 23(6), 1362–1378. https://doi.org/10.1177/14614448209024
Timberg, C. (2017, October 5). Russian propaganda may have been shared hundreds of millions of times, new research says. Washington Post. Retrieved from https://www.washingtonpost.com/news/the-switch/wp/2017/10/05/russian-propaganda-may-have-been-shared-hundreds-of-millions-of-times-new-research-says/
Tufekci, Z. (2018). YouTube, the great radicalizer. New York Times. Retrieved from https://www.nytimes.com/2018/03/10/opinion/sunday/youtube-politics-radical.html
Tuters, M., & Hagen, S. (2020). (((They))) rule: Memetic antagonism and nebulous othering on 4chan. New Media & Society, 22(12), 2218–2237. https://doi.org/10.1177/1461444819888746
Tuters, M. D., & Noordenbos, B. (2024). Faking sense of war: OSINT as pro-Kremlin propaganda. In M. Mortensen & M. Pantti (Eds.), Media and the war in Ukraine (pp. 97–115). New York, NY: Peter Lang.
Tynan, D. (2016, August 24). How Facebook powers money machines for obscure political “news” sites. The Guardian. Retrieved from https://www.theguardian.com/technology/2016/aug/24/facebook-clickbait-political-news-sites-us-election-trump
Udupa, S. (2023). Extreme speech. In C. Strippel, S. Paasch-Colberg, M. Emmer, & J. Trebbe (Eds.), Challenges and perspectives of hate speech research (pp. 233–248). Berlin, Germany: Digital Communication Research. doi:10.48541/dcr.v12.14
Venturini, T., Jacomy, M., & Jensen, P. (2021). What do we see when we look at networks: Visual network analysis, relational ambiguity, and force-directed layouts. Big Data & Society, 8(1). https://doi.org/10.1177/20539517211018488
Venturini, T., & Rogers, R. (2019). “API-based research” or how can digital sociology and journalism studies learn from the Facebook and Cambridge Analytica data breach. Digital Journalism, 7(4), 532–540. https://doi.org/10.1080/21670811.2019.1591927
Wanless, A., & Berk, M. (2017). Participatory propaganda: The engagement of audiences in the spread of persuasive communications. In M. Mortensen & M. Pantti (Eds.), Social media and social order (pp. 111–136). Leiden, the Netherlands: De Gruyter.
Wanless, A., & Berk, M. (2020). The audience is the amplifier: Participatory propaganda. In P. Baines, N. O’Shaughnessy, & N. Snow (Eds.), The Sage handbook of propaganda (pp. 85–104). London, UK: Sage Publications.
Wardle, C. (2023). Misunderstanding misinformation. Issues in Science and Technology, 39(3), 38–40. https://doi.org/10.58875/ZAUD1691
Wardle, C., & Derakhshan, H. (2017). Information disorder: Toward an interdisciplinary framework for research and policymaking (Vol. 27). Strasbourg, Luxembourg: Council of Europe.
Wight, C. (2018). Post-truth, postmodernism and alternative facts. New Perspectives, 26(3), 17–29. https://doi.org/10.1177/2336825X1802600302
Wilson, T., & Starbird, K. (2020). Cross-platform disinformation campaigns: lessons learned and next steps. Harvard Kennedy School Misinformation Review, 1(1).
Yesilada, M., & Lewandowsky, S. (2022). Systematic review: YouTube recommendations and problematic content. Internet Policy Review, 11(1), 1–22. https://doi.org/10.14763/2022.1.1652
YouTube. (2019a). Our ongoing work to tackle hate. YouTube Blog. Retrieved from https://blog.youtube/news-and-events/our-ongoing-work-to-tackle-hate/
YouTube. (2019b). Continuing our work to improve recommendations on YouTube. YouTube Blog. Retrieved from https://blog.youtube/news-and-events/continuing-our-work-to-improve/
Copyright © 2026 (Richard Rogers and Kamila Koronska). Licensed under the Creative Commons Attribution Non-commercial No Derivatives (by-nc-nd). Available at https://ijoc.org.
https://doi.org/10.65476/1fw44702
[1] The authors received funding from the Horizon Europe project, vera.ai, under grant agreement no. 101070093.
[2] In Gephi we set the weighted in-degree ranking to a minimum of 5 (and maximum of 50), the ForceAtlas 2 gravity setting for spatialization tuning to 0.005 and the edge weight to 0.47 (hiding thinner edges). We also used Gephi’s modularity feature (Louvain method) for community detection.
[3] The influence metric is used to assess how crucial or central each community is within the overall network. For a detailed description of the methodology to derive the influence metric, please see the note at https://osf.io/aw4rk?view_only=5fe05fe1895a47589f7ad717af30234f.
[4] The page has since been deleted.