twitter – Data Horde https://datahorde.org Join the Horde! Mon, 08 May 2023 20:12:19 +0000 en-US hourly 1 https://wordpress.org/?v=6.4.3 https://datahorde.org/wp-content/uploads/2020/04/cropped-DataHorde_Logo_small-32x32.png twitter – Data Horde https://datahorde.org 32 32 Twitter to Begin Purging Inactive Accounts https://datahorde.org/twitter-to-begin-purging-inactive-accounts-10-12-22/ https://datahorde.org/twitter-to-begin-purging-inactive-accounts-10-12-22/#respond Sat, 10 Dec 2022 17:01:41 +0000 https://datahorde.org/?p=2864 Edit: May 8 2023, Elon Musk has announced that the account purge has come into effect, read on to learn more about what you can do if this affects you.

Archived Snapshot: https://archive.md/PYJ2E

Yesterday, Twitter CEO Elon Musk announced a purge on inactive accounts. Musk has cited the reasoning as “freeing [up] the name space” for users who might want a new handle. Musk then went on to assure Twitter that these “1.5 billion accounts” would be accounts which have not tweeted or logged-in for the last few years.

Archived Snapshot: https://archive.ph/9tEMm

This is very much, an expected move. You might recall from our blogpost a while ago that Musk had expressed interest in purging accounts early in November. It should also be noted that Twitter’s previous management had failed a similar policy change in 2019, to expire accounts which had not been logged into for 6 months. That policy change failed due to outrage and protest across the platform.

Archive Snapshot: https://archive.ph/hcKsV

Well then, should you be worried? Probably not for your own account. Some have expressed concern over the accounts of loved ones or deceased celebrities, which will more easily fit this criteria. If you have such concerns, we can recommend a useful utility from our friend JustAnotherArchivist, called snscrape. snscrape allows you to save public tweets from accounts on Twitter. It also works for a few other websites like Facebook and Reddit.

Simply install with: pip3 install snscrape

The code is available at https://github.com/JustAnotherArchivist/snscrape, but if you have Python 3 installed pip3 install snscrape is all you need to install it.

From your terminal or command prompt, the following command will save a local archive of Elon Musk’s tweets:

snscrape --jsonl twitter-user elonmusk > muskytweets.json

And if you want another account, just substitute the username and a file to save to:

snscrape --jsonl twitter-user RetroTechDreams > RTD_tweets.json

I might write a more detailed tutorial on snscrape if people are interested.

But for the time being, spread the word! Save what endangered accounts are valuable to you and be sure to tell all of your friends about snscrape.

]]>
https://datahorde.org/twitter-to-begin-purging-inactive-accounts-10-12-22/feed/ 0
Twitter in Trouble? Why you should Archive your Tweets https://datahorde.org/twitter-in-trouble-why-you-should-archive-your-tweets/ https://datahorde.org/twitter-in-trouble-why-you-should-archive-your-tweets/#comments Mon, 05 Dec 2022 17:04:49 +0000 https://datahorde.org/?p=2852 Twitter has seen some radical restructuring since Elon Musk’s acquisition over a month ago. Now is a good time as ever, that we talked about what options you have in archiving or preserving your Twitter content.


This new era of Twitter has been quite turbulent, to say the least. More than half of the workforce has been fired or has quit, and site functionality is becoming unstable, as reported by the Seattle Times. Mastodon has emerged as a serious Twitter alternative. In fact, some of those who have departed Twitter now have their own Mastodon instance over at macaw.social. Personally, I am excited about the rise of mastodon as an alternative as I have been posting Data Horde updates over at @[email protected] for about two years now.

So, why not leave Twitter behind and move on? Now, Twitter allows you to request a copy of your personal data: Tweets and all. But it’s probably hard to leave a site that you have been on for over a decade. Especially, when requesting your personal archive is not even working correctly. Many people have reported that archive requests are being ignored or processed with delay. On a test account, we at Data Horde found that it took over 3 days to receive a personal archive.

Tweeters complaining about being unable to export personal archives: view snapshot at archive.is

In 2022 this is a big deal, not only for archivists but also for legality. Article 13 of the GDPR mandates a responsibility to provide a copy of collected data to users (i.e. data subjects) upon request. Outside of Europe, California’s CCPA has a similar clause protecting the right to know.

There are repercussion for not respecting these rules. Recently another messaging app, Discord, was fined 800 000 Euros for failing to respect data retention periods and security of personal data by French Regulator CNIL. That was actually a reduced fine, given Discord’s conciliatory attitude. If Twitter does not up their game, they may meet a similar fate, if not a worser one.

Now that I have your attention, I would like to direct it to the help page on how to request a personal archive from Twitter: https://help.twitter.com/en/managing-your-account/how-to-download-your-twitter-archive . Even if a bit unstable, this is what you need to follow to save a copy of your Tweets.

The Twitter archive is big and burly but not perfect. Johan van der Knijff recently wrote a blogpost on some shortcomings, such as the t.co URL-shortener and some workarounds: https://www.bitsgalore.org/2022/11/20/how-to-preserve-your-personal-twitter-archive


Oh, and by the way. It gets worse: Elon Musk has also stated interest in purging inactive accounts and their Tweet history.

Archive Snapshot: https://archive.ph/hcKsV

This might not seem like a big deal, except to the one or two of our readers who periodically scrape politician accounts off of https://ballotpedia.org. Yet it is actually a serious turning point. Currently, Twitter does not purge inactive accounts, except in the event of death or incapacitation and by special request.

In 2019 there was an attempted Twitter policy change to expire accounts which had not been logged into for 6 months. This sparked outrage across the platform by those who saw this as unfair to the memory of inactive accounts. In particular, fans of deceased K-Pop artist Kim Jong-hyun, otherwise known as Jonghyun (김종현/종현) came to the defence of his legacy overturning the attempt altogether. Turning back on this decision would go against all of that heritage, people’s heritage, Twitter’s heritage, web heritage. Alas this the projected course of things, even if we cannot prevent it, it is perhaps our duty to protest why it is wrong.


What about the extreme scenario of a total collapse of Twitter? What does that mean for web history? Well, the good new is that people have been thinking on this for much longer than before this year.

Already in 2010 the Library of Congress announced that they would be copying the entire internal archive of Twitter, starting from March 2006.

Archive Snapshot: https://web.archive.org/web/20161208074132/https://twitter.com/librarycongress/statuses/12169442690

There are also many smaller grabs on the Internet Archive and archive.today, some of which you have seen linked above. Special mention goes to Archive Team‘s periodical Twitter Stream archive.

Last but not least, you can help! The Internet Archive is collecting Tweet dumps from people as we speak: https://archive.org/services/wayback-gsheets/archive-your-tweets Whether you just want extra insurance for your back-up, or to contribute to the wealth of the web you can help by using the above tool to upload your Tweets to the Internet Archive for generations to come.

]]>
https://datahorde.org/twitter-in-trouble-why-you-should-archive-your-tweets/feed/ 1