http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data Digital Humanities Questions & Answers » Topic: Harvest Historical Twitter Data en-US Sun, 24 Mar 2019 17:08:59 +0000 http://bbpress.org/?v=1.0.2 q http://digitalhumanities.org/answers/search.php http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2414 Sat, 24 Jun 2017 23:16:17 +0000 stustu12 2414@http://digitalhumanities.org/answers/ <p><em>Replying to @<a href='http://digitalhumanities.org/answers/profile/justinlittman'>justinlittman</a>'s <a href="http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2412">post</a>:</em></p> <p>Thanks Justin. DiscoverText (<a href="https://discovertext.com" rel="nofollow">https://discovertext.com</a>) is an option for day-forward Twitter via the Search API or using the Gnip PowerTrack. For historical Twitter, people need to use Sifter (<a href="https://sifter.texifter.com" rel="nofollow">https://sifter.texifter.com</a>) to generate up to three free estimates per day. If there is an estimate you like, there is a price to access the data using DiscoverText. </p> http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2412 Mon, 05 Jun 2017 13:19:26 +0000 justinlittman 2412@http://digitalhumanities.org/answers/ <p><em>Replying to @<a href='http://digitalhumanities.org/answers/profile/kdonovan11'>kdonovan11</a>'s <a href="http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2410">post</a>:</em></p> <p>The Twitter API supports retrieving the last 3,200 tweets from a user's timeline. A commandline tool like Twarc (<a href="https://github.com/docnow/twarc" rel="nofollow">https://github.com/docnow/twarc</a>) can be used to get the user's timeline from the API. If you're looking for web interface, Social Feed Manager (<a href="https://gwu-libraries.github.io/sfm-ui/)" rel="nofollow">https://gwu-libraries.github.io/sfm-ui/)</a>, which I work on, is another option.</p> <p>Options for getting historical tweets for a hashtag are much more limited. The Search API only indexes the last 7-9 days. The search on Twitter's website indexes further back in time, but the nature of what is indexed (and not indexed) is unknown.</p> <p>Data service providers such as DiscoverText (<a href="https://discovertext.com/" rel="nofollow">https://discovertext.com/</a>) allow for greater access to historical data, but obviously at a cost. </p> http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2411 Fri, 02 Jun 2017 08:00:33 +0000 kdonovan11 2411@http://digitalhumanities.org/answers/ <p><em>Replying to @<a href='http://digitalhumanities.org/answers/profile/kdonovan11'>kdonovan11</a>'s <a href="http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2410">post</a>:</em></p> <p>I see that it is possible to use Twitter's Advanced Search to search for a particular account's tweets during a given time period; however, that requires scrolling through it all on their site. What would be best is the ability to export them (links, images, and all). </p> http://digitalhumanities.org/answers/topic/harvest-historical-twitter-data#post-2410 Thu, 01 Jun 2017 19:25:33 +0000 kdonovan11 2410@http://digitalhumanities.org/answers/ <p>I would like to capture tweets from last year which centered on a particular social movement in Kenya. Many of them were sent or retweeted by @ConsumersKenya, so simply getting an archive of their tweets within a certain timeframe would be quite helpful. Being able to get those who used relevant hashtags during that period would also be fruitful.</p> <p>There seem to be plenty of services to archive ongoing tweets, but is there a good way to get historical tweets for certain dates? </p>