Pipelines and rabbit holes: Falling prey to algorithms

I was fully prepared to make my next blog post about Minecraft – I had a whole idea prepared and everything. But then, while having a conversation with my roommate, I found out about r/QAnonCasualties. A place where people with family or friends who have fallen down the rabbit hole of QAnon go to search for ways to rescue them. Apparently, my roommate had stumbled across it a few months ago and spent ages reading the stories and advice people shared. How do you get your grandparents off the wrong side of Facebook? How do you gently persuade your son to at least talk to you again? And then some crazier stories like a woman who was certain her sister caused her father’s death by not wearing a mask while the father was trying to recover from a respiratory disease.

So naturally, I wanted to see it for myself. My roommate didn’t recall the name of the subreddit, but a quick google search got me there in no time. Luckily, I chose the weekend after Thanksgiving to delve into it all and the page was brimming with stories of unfortunate encounters and advice of how to deal with slightly less reasonable family members. Jackpot! 

Screen recording of the subreddit r/QAnonCasualies

Although it would be extremely interesting to explore how exactly these people become so invested with QAnon and where exactly the brainwashing starts, I was more curious to see how the supposed success stories managed to cut of the brainwashing. I think we’ve had plenty of discussions in class about internet addiction and we’ve all got some basic knowledge on how brainwashing happens – but how can that pattern be broken? And why is it so difficult?

If I were a bit more scientific about this, I’d probably do some more research about how brainwashing works psychologically, but instead I’ll call what I’m doing ‘internet fieldwork’. 

Reprogramming the mind

There are a few approaches taken to deal with someone who’s fallen victim to Qanon:

  1. Argue and try to reason with them
  2. Abandon hope and try to remove them form your life
  3. Gently take away their links to the world of QAnon and ‘reprogram’ them

The general consensus on the subreddit regarding option number one is that it is futile, and you’ll only be causing more harm. If you argue against them, they argue back and it seems to only solidify their own beliefs in their mind. 

Although the second option seems a pity to resort to, members of the subreddit agree that you should not exhaust yourself and you should protect yourself from these friends or family who can become a danger to your or others around you. Of course, this is extremely hard to do when talking about your spouse, parent, or basically anyone who’s very close to you. And on a larger scale, it’s a shame to let it continue on. 

The final option is the one which interests me most – not only because I think it might be the most successful option, but because it really finds the root of the whole brainwashing thing and boils the whole issue down to one thing – algorithms. 

It might be a questionable tactic, but some people on the group suggest going on to your loved ones devices and accounts and altering their feed. Unlike and unsubscribe from certain posts on Facebook or channels on YouTube. Cut them off from the source that’s feeding them conspiracy theories. This, of course, is much easier to accomplish when dealing with an older age group who might not even know how their social media works.

Slowly but surely, people who attempted this discovered that within a month or so they felt that they had gotten back the ‘real’ version of their loved one. While before these people seemed to be entirely consumed by their newfound fanaticism, they had now returned to having other interests and topics of conversation.

The PewDiePipeline and other traps

I find it quite interesting that a couple of simple tweaks to your social media accounts can so quickly transform your behavior and how you are perceived by those around you. If I were to enter Instagram one day and block all the topics I usually run into, how different would I become? If I suddenly had an entirely new feed, would my opinions on certain things change and would I develop new characteristics? I know for a fact that my clothing choices are heavily influenced by my social media feed. My music taste as well. Maybe even my sense of humor? 

Perhaps I’m not being influenced in a way which is as extreme as QAnon followers, but I’m being influenced nonetheless. And this realization that there is so much of me which is made up from the media I’ve consumed online since I was quite young is a bit jarring. I knew it, in theory, but I’d never given it much thought. I could’ve easily followed a couple of different tumblr blogs when I was fourteen and maybe not been as invested in Star Wars or Taylor Swift (a spectacular combination, by the way), which could’ve maybe drastically changed my interests today. 

For example, I once read something which described the ‘PewDiePipeline’ as the algorithm which leads young kids from gaming and Minecraft channels to alt-right channels which promote conspiracy theories, racism and misogyny. If you give it a quick google search, there are a couple of stories or articles out there describing cases where people or people’s kids fell prey to a number of different beliefs (some links below). As someone who played Minecraft in sixth grade, I was probably a click away from the same pattern. And I don’t doubt for a second that I’m in a bit of a trap myself, that my beliefs are very much constructed by the innocent choices I made online years ago and continue to make today. 

And as luck would have it, my post made its way back to Minecraft after all!

Some links if you’re curious:

https://www.nytimes.com/interactive/2019/06/08/technology/youtube-radical.html