This may belong on Serverfault, but I don't think so.
I have a website with the archives of a local radio program that had some cult following in Australia, and may have a limited, but active, group of visitors
I have noticed in my logs, the referrer URL of 4 unique visits appear to come from a path beta.hustler.com/photos/images/ (and some more ...)
I'm sure no one at hustler would care about my dinky little Australian fansite, and don't know why a true referral URL would originate from Hustler, especially an image directory.
Would this just a new form of Spam, some proxied referral or something more nefarious?
Referrers are easy to spoof. They are trying to get the attention of webmasters by putting bogus referrers in their requests to your site, so that the referrer goes into the log, and you notice them.
Related
Recently I made my site to reroute the url, based on the language set in the visitors browser. So if a Swedish visitor came to the site, he was rerouted to mysite.com/sv, and an english visitor to mysite.com/en.
Soon after I released this, my Google rank just plummeted. So how did I go wrong here? Is there some common practice to auto-redirect of visitors based on their locale that doesn't hurt SEO, or do I need to set some kind of HTTP code for this to be approved by search engines?
The penalty you've acquired is for cloaking.
Short answer: Don't do redirects yourself - instead use hreflang codes and canonical links, then let the person's Google settings decide.
A Swedish person searching on google.com wants the English version, even if their browser is Swedish. Google does checks where it uses different user agents from different locations to test if you're serving the same content they see to everyone else. When this differs, your site gets flagged for attempting to hide it's true content - hence 'cloaking'.
More here: https://support.google.com/webmasters/answer/66355?hl=en
History/Context: I have a site, 'www.oldexample.com' built in 1998, HTML 4.01 transitional on Apache, cpanel server. Until last fall our main keywords got us to top 10. After mobile changes and Panda etc, Dropped to page 2 or 3 for all but one very specific keyword. The old site, 'www.oldexample.com' has many good back links and history in google and all main directories. I am rebuilding a test site now which is on 'mycompany.myshopify.com' as it addresses all my google errors issues on oldsite. I have set up my 'www.newexample.com' to redirect to the shopify site which is called up under 'www.newexample.com'.The myshopify.com URL does not show up at all.
Question: If I were to do cpanel 301 redirect of whole 'oldexample.com' to 'newexample.com' would I still benefit from the many links and history of oldsite?
When you say that the shopify URL doesn't show at all, do you mean it's not showing when you search for those keywords, or it's not indexed at all? If it's the latter, prompt Google to index it using Google Search Console. If it's the former, there are a number of things that could have affected this:
the authority of the new site - if you've just launched it, it naturally won't have the authority of the previous site and therefore is less likely to get visibility
you are correct that the backlinks would have played a major part in this. What you need to do is to redirect the old domain to the new one you want to appear in Google. For example, if you want to actually take people to newsite.shopify.com, you should redirect the old domain directly to that one. If you redirect the old one to newdomain.com, which you then redirect to newsite.shopify.com the result won't be the same. Link value is lost via redirects. Ideally, you should get in touch with as many 3rd party websites linking to your old domain and ask them to update the links to point to newsite.shopify.com
Even if you do that you might still not see those rankings because of various other factors. If you fancy posting the actual URLs and keywords in question, I can spare a few minutes to have a look.
I am designing a pretty big website that will target it's industry on a global level. The site is detecting IP address countries in order to serve content relative to the visitor's country. Basically alot of content will be restricted to visitors in a given country.
The concern I have is that Google doesn't seem to pay too much attention to IP based content, as I read here. They seem to think Google might implement better support for crawling IP based content but aren't sure when and the article is dated Nov 2011.
As a result, I have been considering ways to have Google crawl the site's IP content by country codes like us.site.com or site.com/us still detecting the visitor's country by IP and redirecting to the appropriate location. Im not sure if it's just because I am a little strange at times, but I seem to feel that the subdomain us.site.com seems tidier.
Considering that Google spider ALSO seems to ignore subdomains when there is considerable duplicate content (which may be the case because alot of the content is internationally available), what would you guys recommend?
Should I
Stop being so darn OCD about us.site.com and use site.com/us?
Use subdomains because perhaps while the spider ignores duplicate
content on sub-domains, it won't if there are more unique results?
What about lists of results on my site? Like a category page?
Take a gamble and stick to IP detection only, not using country
codes in the URL and hope for the best that Google will recognise
different content being served on different IP ranges
Thanks in advance
Ok, so i found this which is so far the best explanation I have found, any pointers please feel free to comment
I have a client who has brought a truck load of domains he wants me to redirect to his site.
A few of them are the same name with different top level domains (mysite.com, mysite.co.uk etc etc) but a lot of them are keyword related (mylocation-businessType.com etc etc).
I am wondering if either of these will be negative for SEO. I am thinking the top level domain changes will be fine, and expected by google, but the keywords might be views as a bit hacky?
What are the good people of stackoverflow's view on this?
If they are redirected properly then they'll have no effect at all. The only advantage will be if the name makes sense and a user might type it in. eg. identical names with and without hyphens.
For this situation all of the other answers are correct, you won't get any benefits in Pagerank, etc. and it wouldn't be useful except to pickup direct traffic to your domain names that you are then redirecting.
How would it affect your SEO though? That's a little trickier. Two ways of looking at it:
1.) Competitors could do this to you and it'd be completely out of your control. If redirecting a bunch of domains did any real harm to rankings it'd be a great way to do negative SEO, or "Google Bowling," and could be used to take down a site's rankings. That isn't the case though, so it probably wouldn't have too much of a negative effect.
UNLESS
2.) The nameservers for your redirected domains match the nameservers for your main domain. Pointing all domains to the same set of nameservers will help show that all domains are under the control of the same webmaster.
Even if you are using different nameservers and using 301 redirects as recommended, if the server with your redirects comes back to (at least) the same Class C IP address as your main site's server, a search engine would still be able to tie you together as likely being run by the same owner.
Either of these setups can identify you as the source of the redirects and devalue the ranking ability of your main site since there is a much higher likelihood the redirects are coming from you.
winwaed is correct. If you're doing a proper 301 redirect, the other domains are only valuable if people directly type them in. They won't rank, won't get any link juice, and won't get any inbound links. If you do seed inbound links, google will treat them as if they point to the target of your 301 redirect. It's a waste of time to just directly do that for SEO purposes.
The way to use each of those domains for SEO would be to build a bit of unique content on each one, get some inbound links, and then link out to your target page. Not really worth doing unless you really spend a lot of time at it, and google still tends to penalize obvious gaming of the system like that.
They won't contribute toward ranking, however keyword domains do get some amount of advantage for those terms. So, the way to use them is to build sites on all of them and funnel traffic to the main site.
Of course, they can also be used for extra backlinks, but you really want different C class IP addresses from the servers. For that reason you might want to go with SEO hosting.
Matt Cutts from Google explained it in this video:
http://www.youtube.com/watch?v=r1lVPrYoBkA
and here:
http://www.youtube.com/watch?v=a70ygsHgvMw
He also said if he was doing this, he would redirect each of sites to the target sites' different important pages. If the redirected domains had pageranks before, they will still flow pagerank (not exactly but a lower pagerank).
This will require a little setup. Trust me that this is for a good cause.
The Background
A friend of mine has run a non-profit public interest website for two years. The site is designed to counteract misinformation about a certain public person. Of course, over the last two years those of us who support what he is doing have relentlessly linked to the site in order to boost it in Google so that it appears very highly when you search for this public person's name. (In fact it is the #2 result, right below the public person's own site). He does not have the support of this public person, but what he is doing is in the public interest and good.
The friend had a stroke recently. Coincidentally, the domain name came up for renewal right when he was in the hospital and his wife missed the email about it. A domain squatter snapped up the domain, and put up content diametrically opposed to his intent. This squatter is now benefitting from his Google placement and page rank.
Fortunately there were other domains he owned which were aliased to point to this domain, i.e. they used a DNS mapping or HTTP 301 redirect (I'm not sure which) to send people to the right site. We reconfigured one of the alias domains to point directly to the original content.
We have publicized this new name for the site and the community has now created thousands of links to the new domain, and is fixing all the old links. We can see from the cache that Google has in fact crawled the original site at the new address, and has re-crawled the imposter site.
The Problem
Even though Google has crawled both sites, you can't get the site to appear in relevant searches under the new URL!
It appears to me that Google remembers the old redirect between the two names (probably because someone linked to the new domain back when it was an alias). It is treating the two sites as if they are the same site in all results. The results for the site name, and using the "link:" operator to find sites that link to this site, are entirely consistent with Google being convinced they are the same site.
Keep in mind that we do not have control of the content of the old domain, and we do not have the cooperation of the person that these sites relate to.
How can we convince the Googlebot that domain "a" and domain "b" are now two different sites and should be treated as such in results?
EDIT: Forward was probably DNS, not HTTP based.
Google will detect the decrease in links to the old domain and that will hurt it.
Include some new interesting content on the new domain. This will encourage Google to crawl this domain.
The 301 redirects will be forgotten, in time. Perhaps several months. Note that they redirected one set of URLs to another set, not from one domain to another. Get some links to some new pages within the site, not just the homepage, as these URLs will not be in the old redirected set.
Set up Google Webmaster Tools and submit an XML sitemap. Thoroughly check everything in Webmaster Tools about once per week.
Good luck.
Time heals all wounds...
Losing control of the domain is a big blow, and it will take time to recover. It sounds like you're following all the correct procedures (getting people to change links, using 301s, etc.)
Has the content of the original site changed since being put up again? If not, you should probably make some changes. If Google re-crawls the page and finds it substantially identical to the one previously indexed, it might consider it a copy and that's why it's using the original URL.
Also, I believe that Google has a resolution process for just such situations. I'm not sure what the form to fill out is or who to contact, but surely some other SO citizens could help.
Good luck!