For my research, I want to use some data that can capture twitter users following each other . I want to represent this relationship in a big directed-graph. If you think about this graph it's probably very huge, I want to generate it and perhaps store it in adjacency-matrix format.
However when I tried to make use of Twitter's API, there are some useful methods like GET followers, GET friends I can use. But it has 150query/hour limit. At that rate, I would never finish crawling Twitter and generate a good enough direct-graph.
Is there a better way of doing this?
I remember that one of my friends contact this research group and they provide her a dataset.
http://twitter.mpi-sws.org/
Maybe you should try to find a dataset instead. Try this SO question, the answers provide a few datasets of them.
Twitter Data Archive
Tribalytics-raw provides twitter followers and/or friends raw graph data as a service.
To comply with Twitter API's terms of service, only twitter users Ids are provided. You can extract the users metadata by yourself using twitter's users/lookup API endpoint, which is not so heavily rate-limited.
Full disclosure: I am the founder of this tool, and I have read this before posting
Related
I want to make an app for gamers that uses statistics from the games they play. I want to link Riot/ubisoft/steam/epic games/ account to my app and use the user's game data (with permission of-course). Is there a way to access that information? I was not able to find much on my own. Steam has web apis that might be able to get that information but I don't understand how much information I can get from there as well.
You need to use one of their internal APIs. Ubisoft uses its own demux API. There are several examples on GitHub on how to do that. In my case ,I am grabbing data from tracker.gg and Ubisoft. Here's a repo for my API Server .
https://github.com/alexanderthegreat96/dth-division2-api
How can I get a feed of photos/videos from people I follow from the Instagram API? This seems like a pretty basic API feed that it appears to be missing. I see where I can get a list of the people I am following, but them am I supposed to make separate API calls for each of those user feeds and aggregate all of those together?
http://instagram.com/developer/endpoints/relationships/#get_users_follows
I'm wondering how a service like http://web.stagram.com/ does something like this. I'm assuming aggregation, but perhaps I am missing something in the API.
The /user/self/feed endpoint returns all videos and photos of the user associated with the given access token. See here: http://instagram.com/developer/endpoints/users/#get_users_feed
This is an example of using this endpoint: https://api.instagram.com/v1/users/self/feed?access_token=969629.f59def8.24f8add8d4d7475397ab09b361299665
The Instagram API does not support what you are attempting. You would need aggregate these yourself. Not sure if webstagram has special access or has to work around this as well.
In the facebook and twitter APIs, there's a way to get posts from all the people I follow, is there a way to do this with Google+? If there isn't, where can I suggest it?
The Google+ API currently does not provide a way to list people from your circles.
You can retrieve people in other ways. Try retrieving people by userId, through a search, or by activity using the people methods. With each userId you can retrieve posts using Activities: list.
Feature requests and issues can be reported and starred here: https://code.google.com/p/google-plus-platform/
Assume you have access to the Twitter firehose, either directly or through a Gnip/Datasift deal. You can analyze who users are following and the tweet streams. The end goal should be to have an ontology of interests, with weighted interests per user.
I am completely stuck even starting to work on this problem. Any guidance is appreciated.
This seems to be along the lines of what you are looking for
http://wthashtag.com/
I'm pretty certain that Twitter has a category listing for lists, at least, in their own API as well.
GL
I wonder would it be possible to build and app or website where twitter trends would be displayed on different, bit more useful way. Does Twitter API supports such queries and whether it might be possible to run analysis on our own servers, just use Twitter API to get data. If we could use data only from most influential users and create new Trend list I think we might come with much more useful Trends than we have now.
Check this out: Pulling data from Twitter