I have spent many hours trying to find a way to capture articles on http://www.law360.com. I have been able to create the bulk URLs I want to scrape, etc.: that works fine.
I am just running into a brick wall with the login. Any suggestions?
Did you try creating an Authenticated Extractor?
Related
I am trying twitch bot like a stay hydrated bot but Twitch login system have an google captcha and my bot can't login twitch I tried manually login but even i choose pictures correctly google captcha say "it was wrong try again"
Well, i think you're going to have trouble making a robot do something you can't, i'm guaranteeing the fact you cannot get past a reCaptcha is most likely user error.
Twitch Developer Documentation
You're not going to get past Google Captcha with an automation script as they're designed to stop exactly that. Also it's a really crummy way of creating a view bot, im assuming you actually are trying to do that, because if you were actually trying to make a chatbox, you'd know that twitch have things built in to support things like this, so they don't have to try and get around a reCaptcha.
I am using the twitter api to get all direct messages
while testing I tried to delete a message from the twitter website and then tried to reload my app's direct message page (get via api) - the dm I deleted was still showing in my app but it wasn't on the account I was using on the website.
I'm not sure whats going on here, any help is appreciated
You usually should give a second after an update/delete operation on Twitter. If you do, I would say that something is going wrong with your code.
I need to crawl some data that sits behind a login page. To be able to scrap it I need a tool that is able to login and then crawl the pages behind it. Is it possible to do this behind import.io?
Short version: yes, it is.
Longer version:
There are at least two ways, both require you to sign up and download the desktop app (all free)
Extractor version (simpler):
Point the browser to the page where the login is. Login normally, then train your API to extract the data you need. The downside of using this method is that it will only work as long as you are logged in. If you want import.io to login for you you'll need the..
Authenticated version:
As above, but create an authenticated API. This will record for login procedure and execute it for you every time you execute the API
Since the chosen answer doesn't work anymore :( I recommend Cloudscrape. You will get a free trial with 20 hours of crawling and/or scraping if you sign up. For data behind a login you will need a scraper.
Handy tutorials
Tutorial for logging in with scraper.
Tutorial for pagination.
I want to post on google plus user's wall.
I was trying with inserting moments: https://developers.google.com/+/api/latest/moments/insert I posted with success but new post(moment) is visible only in application activities.
I was trying to insert googleDomain activity, but there was a lot of problems with scopes and domain restricting. https://developers.google.com/+/domains/api/activities/insert
Now I'm trying to work with Interactive post.
My questions:
- Is possible in this time to post on user's wall (like in fb api)?
- What is the best way to do that ?
Interactive posts can post directly to the stream, but keep in mind that it will require an explicit user action (ie - they need to click a button on the pop-up to make the post).
Seems like I should be able to log people out of my app using the graph api. Is that not possible?
Use case: wife logs in with facebook. Does some stuff. I want to log her out and log in as me so I can so some of my own stuff.
I figured that since I was using the graph api to login, I'd be able to logout as well. What am I missing here? This one should be obvious, right? Wasted a bunch of time looking for the answer.....
You can do logout thing also.just refer this www.developors.facebook.com and after login search for graph api samples.they have given some samples on graph.there you will get logout.