How to download pictures from a URL list? - scrapy

I have a url list which contains 6129 urls and each of them is a product page and contains products picture(s). How can i go through all of them and download the pictures (one is enough from each page)?
Here is a product page:
https://homasita.hu/homasita-lampa-blade-x-ablaktorlo-gumi-par-ptfe-61cm-0119008-tk-t57138-c695
Thanks!

Related

How to find DotNetNuke pages that point to my dnn page

I have updated an existing user DNN page with some text. I can preview this page using the Page Management page. Since I didn't create this page I don't know which other pages/menus contain a link to this page. How can I find out which pages/menus link to this page?
Thanks
Who or what created the page?
What is the URL that you visit to edit the page? (Edit the URL here to use a phony name.)
Getting the exact number of links to a page is almost impossible without the use of a site crawler, as the page could be referenced in many ways.
Via HTML Content on a Page - This would be in the HTMLText table of the database
Via a Page-Link Menu Item - This would be in the Tabs table of the database
Via a URL-Link Menu Item - This would be in the Tabs table as well, just tied by the URL rather than the TabId
There is no report/link in the DNN Platform to list all usages.

Image sitemaps -- list same images on every page?

My website has very few images: 2 versions of the logo, a favicon, and a default user image. They are used on many pages. These images are also referenced from a /publicrelations page.
The website also has an animated image that is only in the background of the landing page, but I don't want this indexed.
When creating the image sitemap, should I
A: only do <url><loc>myurl.com/publicrelations</loc>infoAboutAllTheCommonImages</url>
B: do what is in "A" but for every page (i.e. <loc>urlToSomePage</loc>), even though every page will reference the same images
C: something else?
Thank you
The essence of including an image sitemap is for your image to be visible on the search engine results page. Question is- do you want your favicon and logo on the search results? If NO, forget about the sitemap.
If YES, there's no need to include the same image from every page. It's not relevant to the search results to have identical images. Just choose one.

How to avoid same content and keyword for multiple pages and focus on master page only

Hello Good morning all,
Hope all doing well, i am in a triangular situation for my multiple details pages, i want some idea how i can avoid google to not to crawl my details page and to crowl its container page which contains 90% same keyword, meta and url. For an example i have one page which is a master page of multiple categories here http://www.estatemarker.com/ahmedabad/industrial-properties.html it contains multiple categories when i open a category it let us to another page http://www.estatemarker.com/ahmedabad/industrial-warehouse.html which is subcategory now this subcategory has area vise listings of multiple pages this pages are same as this subcategory page but these contains listing of area only and this page has actual listing posted by brokers, now problem is i want to focus google on this page area vise page only but this page contains 50 more listing which opens a details page and details page contains 90% of same keyword and other SEO stuffs per the area vise page page. I need a guidance how i should avoid google to not to crawl this details page and area vise page instead.
Any help will be appreciated.
Thanks in advance
you can give canonical tag or can use
Robot.txt codes like
User-agent: *
Disallow: *?dir=*
Disallow: *&order=*
Disallow: *?price=*
to face such problems.
http://www.goinflow.com/duplicate-content-ecommerce-seo/

how to show brands images list in bigcommerce

Dears i am using big commerce to show brands images on index now it is showing only the brands names but i want to list the brands images instead of brands names how i will show that
%%brandFullname%% show names of the brands like it there is any other global variable which show brands images instead of brands names
my code is
default page:
%%Panel.HTMLHead%% <!-- Including the html head -->
%%Panel.Header%% <!-- Includeing the html Header -->
%%Banner.TopBanner%%
%%Panel.SideShopByBrandFull%%
%%Panel.SideCategoryList%%
%%Panel.HomeNewProducts%%
%%Panel.Footer%%
SideShopBybrandFull Code:
%%SNIPPET_SideShopByBrandFullList%%
SideshopByBrandFullList:
%%GLOBAL_BrandName%%
Any Help Appreciated
Regards
The only place Bigcommerce can pull brand images is on the brands page itself. If you'd like the brands shown on other pages of the site you will need to find a different way to do it, such as creating your own panel with the HTML inside of it, requesting content through AJAX, or other methods.

What should be the URL for Products page which is independent of Product Categories- Big Commerce?

I am customizing my Big commerce Store... I need a products page which is independent of product categories.
I am trying the below URL for products page but it says "Page cannot be found".
%%GLOBAL_ShopPathNormal%%/products.
I need the URL to redirect to product page. Please help.
%%GLOBAL_ShopPathNormal%% gives you the store url (non SSL version). The navigation is category based. What you are trying will not work. Maybe, you can hack this - Create a category called "products" and add all the products to it. Then, when you navigate to the URL (storeurl/products), it should list all the products.