I am looking for a way or an API that is capable of crawling (hourly aggregation) the number of post submissions and/or comments in Reddit after July 2018. Unfortunately, PushShift.io got deprecated and the Reddit API itself can only go back 1000 posts. Does someone know any (free) way to crawl the required data?
I already searched the web, my previous versions became outdated
Related
I am attempting to get all of the tracks release on Spotify for a given year (e.g. all tracks release in 2018)? I've been looking through their APIs and various projects posted by others, but have not been able to find a solution for this one. One particular issue is the limit on 50 API calls, so as part of a solution, I am looking for a way that I could get the thousands of songs released in a year all at once.
I have tried looking at Spotify API documentation, Spotipy library documentation, and various projects related to this topic, but have not seen anyone tackle this particular issue.
As the title says, I'm trying to find a way to post these updates (see picture below) using google's API, I can't find anything about it. I have checked google's business API documentation and most of it's endpoints are deprecated.
At the top of the page there is a deprecation schedule: https://developers.google.com/my-business/content/sunset-dates
There you can find the new API-Endpoint. I'm also looking for a solution to update opening hours, but it's not that easy to find any information. Even bing is better documented.
It seems Twitter made lots of changes to API and Webapp so many methods that used to work in the past do not work anymore.
Which method does work as of today (April 2022) to scrape historical tweets from specific users at least the last 4+ years?
Selenium scraping: open https://www.twitter.com/ and scroll down until you have the history you need
not working, only 1 month data
https://pypi.org/project/GetOldTweets3/ - Twitter scraping of older tweets
seems to have stopped working? https://github.com/Mottl/GetOldTweets3/issues/98
Twitter API v2, Academic Research, full archive (free): https://developer.twitter.com/en/docs/twitter-api/getting-started/about-twitter-api
?
Twitter Premium API 1.1 full archive (paid): https://developer.twitter.com/en/docs/twitter-api/premium/search-api/overview
?
There is a python based library named twint. It's an un-official sdk for twitter public API. you won't require twitter developer account or any access token.
Twint can help you in getting previous tweets and with some advanced controls.
If you feel some rate restriction from twitter for a large number of tweets, try breaking your search into smaller chunks.
Like, 10-10-2021 to 17-10-2021 (bi-weekly)
I have a sample github repo for that. Link
Hopefully, this can help!
I built a module for my company's marketing team to fetch all the photos based on a hashtag. Such as #nofilter.
I was using the URL https://api.instagram.com/v1/tags/nofilter/media/recent with no problems until Instagram decided to change their API authentication to OAuth.
I followed the new guidelines but my client is still in sandbox mode and the API call doesn't return anything anymore. All it returns is:
{"pagination": {"deprecation_warning": "next_max_id and min_id are deprecated for this endpoint; use min_tag_id and max_tag_id instead"}, "meta": {"code": 200}, "data": []}
It seems like I need to submit my application to be reviewed before going live. But this doesn't seem possible, based on what i found from their submission guideline below. Is there any workaround for this?
====== UPDATE July 8th, 2016
I have found one of those 3rd parties that instagram mentioned, but the pricing is awful https://www.dialogfeed.com/pricing/
189 euros per month seem a bit steep
I had to deal with this. Their documentation is pretty unhelpful and doesn't seem to offer any solution for someone just wanting to collect relevant links, which should be no prob.
Fortunately, the script on an Instagram page provides easy access to their structured data. In my rails app I create a headless browser and just hit their url. I provided my solution as an answer to another question:
https://stackoverflow.com/a/38572893/4888422
I run a blog and use Google Plus as a promotion tool, posting on G+ every updates. As I have hundreds of followers, quite often my G+ posts have several comments: I would like to show them on my blog!
I know there are a few tools that give you back the latest xxx post given the G+ User ID, but what about the feed about a single G+ post?
Thank you.
Francesco
You can fetch that data using the documentation here: http://developers.google.com/+/api/latest/activities/get