This author's response time can be up to 1 business day.
just wanted to ask if the Scrapes plugin is fully compatible with Woocommerce. I’ve done some scraping from a car sales website and I wanted to get some individual details like transmission, colour, make, model and want these to be filterable in front-end so my process would be to Scrape those info directly into product attributes. the plugin is able to get the basic fields like title, prices, contents, featured image but does not have the ability to scrape directly into product attributes? is there a tutorial available for this kind of process?
As it written in our related F.A.Q article https://codecanyon.net/item/scrapes-web-scraper-plugin-for-wordpress/18918857/faqs/28554 grouped, variable and downloadable product types and product attributes are not fully supported currently. But it’s one of the topic that we are working on.
Thanks for your interest,
How can I parse the contents of the entire section of the site, if it navigates in three levels.
The first level is an alphabetical list (http://shot.qip.ru/00NqQk-4SwgAVQdD/)
The second level is a list of necessary articles with page navigation (http://shot.qip.ru/00NqQk-1SwgAVQdE/)
The third is the article I need.
Can I do a job for one parser, or do I need to do a new job for each letter?
If there is a listing page exists that lists all the links including A to Z, you can set this page as a source url, if not as you said you need to set a new job for each one by duplicating the tasks.
Is is possible that we can make encode product url.
But we wonder your use case, can you tell us a little bit more why you want to encode the source url?
Also you can share us the url and your use case, both from comments or via private message from http://codecanyon.net/user/octolooks#contact
Private message send.
Waiting for your reply.
This comment is currently being reviewed.
By the way please do not share your purchase code public. So we have flagged your comment.
Oh sorry, I did not realise that the support request went to comments. My bad.
No problem, Envato’s support menu is kind of deceptive sometimes, we are aware of the issue
Hello , PreSale Questions for this fantastic plugin :
1- Is it possible to set the post featured image without downloading on my server like WP Automatic Plugin which make it possible through Nelio External Featured Image Plugin
2- Is it possible to grap youtube videos from specific channel ?
Thanks in Advance
1)Yes you can, it is just a custom field _nelioefi_url and you can set it via our plugin
2)You can grab those videos but embed the code, our plugin does not download the video content in your media gallery if this is your case.
If you have further questions don’t hesitate to ask us.
How I can fetch the hyperlink of an image ? if possible then can I use regexp to exclude all text and grab only the ID ?
You can select that element via our visual selector in custom fields section, on attribute field you can enter the name of the attribute like src or may be data-src . After that you can use regex rules to extract the information you want.
If you share us the url and the screenshot of the part you want to scrape we can help you better.
thanks,, I am now able to get the links.. now where I write the regular expression ?
in the find and replace ? do you have an example ?
Replace: leave empty
This way all non digit characters will be removed.
Amazing.. now I feel the Power ..
one last thing.. in Ali Express example, can I grab the product colors and post them as options with images ?
We’re glad to hear that
Unfortunately we do not fully support options in WooCommerce as we described in our f.a.q section : https://codecanyon.net/item/scrapes-web-scraper-plugin-for-wordpress/18918857/faqs/28554
When i scrap a page, it pulls through like 20 posts, however gets stuck in the waiting or preparing loop afterwards and when i have unlimited selected it does not pull through unlimited only 20 or so?
Replied your pm. Thank you.
i am using scrapes on a youtube, following the steps in your youtube account and my featured doest not automatically load. and when i try to select i, it comes out black like nothing is there. is there something i can do or i am doing wrong.
I wanted to know when will Product attributes be supported in scrapes and also, every time I scrape a product image gallery the images are duplicated and displayed in the product gallery, why is scrape plugin doing that?
Thank you for your support
There is no absolute date about, we are looking a technical way to implement it. About the gallery images, if you can send us a temporary login information and the task ID from http://codecanyon.net/user/octolooks#contact we can check for details.
I have a problem.
If the “Total posts” field is set to “Unlim”, everything works without problems and parses the entire list of articles.
If you put a restriction – for example, 5 articles, then the article is not pars.
Where is the problem?
If you have selected skip next in uniqueness option, scrape task does not touch your existing articles, this might be your case. If you want only new articles, you can set your post limit to unlimited, check enable loop and set it to 5. In that case when 5 existing articles found scrape stops running but it gets the new articles.
I need to get all the resource articles.
I want to receive them by 3 articles every 2 hours.
What settings I may use?
The fact that they wrote above, still continues to copy all the content. Maybe I was wrong in the settings. Show an example please.
In your case, if new articles always appear at the first page you can set your serial scrape url like this : http://example.com/page/1
Set three posts for post limit, on uniqueness options set skip next, set interval to 2 hours. This way you will only look at the first three articles. Since they are listed in page 1, you will always get the fresh articles.
Hope this helps.
Articles are not updated. I need to get them all, 3 pieces at a time.
The articles are arranged in alphabetical order.
If you want all articles, why do you only want 3 articles in every 2 hours we couldn’t quite get the idea behind that. We have keep going from last left page option at the end but you have to skip a page at least. For example if there are 10 articles in a page, you have to set 10 posts and then choose that option. So in the second run time ( 2 hours late) it will start from the second page and so on.
Can you share us the url? May be we can understand better the structure then
Page link – https://goo.gl/zYBF6k
Hello we have started a serial scrape on our local environment. The post limit is set to unlimited, the url is : http://www.piluli.kharkov.ua/drugs/letter/1/
If your scraping stops after a while and scrape is stuck at running status probably your hosting may be applying a time limit for your php processes. Can you contact and confirm this issue?
I do not have problems to do parsing without limits.
But I need to parse several articles gradually.
We couldn’t understand why you need this kind of scraping but we have to ask that if we understand your need correctly.
You want to scrape like 1-3 articles in one run, and in the second run (2 hours later) you want 3-6 and so on? If this is your case there is no option in our plugin to scrape like this.
I am running a multi-site wordpress install – and i want my MAIN site to update with post from local sites that uses the same theme, plugins etc—Would this also fetch the images on the page that uses a gallery plugin like Justified Image Grid?
Our plugin supports multi-site and actually our demo site is also a multisite too. When you network activate the plugin you can you Scrapes on each sub site too.
If images are not lazy loaded in the plugin you mentioned, if you choose content area by including image area and choose download images yes you can download images too.
If you give us an example website url we can also check it too or you can try out our live demo..
I tried the demo – but couldnt figure it out quite right. if you go to yds.org – on the home page i want to pull post title and image – from a sub site similar to https://haridhamnj.org/2017-gallery/—so can you pull posts from https://haridhamnj.org/2017-gallery/ to yds.org ?
Correct – when i do the demo – i do not see anything. just a blank screen. What is the best way to resolve this?
Unfortunately not, it is not suitable for scraping as we described in our f.a.q section: https://codecanyon.net/item/scrapes-web-scraper-plugin-for-wordpress/18918857/faqs/28549
In that case Scrapes can get the images because they exist in the html.
Scrapes always ask license purchase code. The plugin always stuck on a certain loop and ask license suddenly. I Install it on WordPress multisite.
Can you share us your purchase code and a temp admin via http://codecanyon.net/user/octolooks#contact ? So we can check it
I have a delayed publication plug-in. When working with it, the scrapper begins to parse the article several times. – http://shot.qip.ru/00NqQk-2SwgAVQfA/ How this escape?
As far as we remember you have chosen title for uniqueness right? We check the posts with the title excep trash status. May be the other plugin is making a copy of new posts? When it is time it deletes that post etc. we can not be sure about that.
In order to understand that, if you have SQL access (like phpmyadmin) you can run this query and check if that post is created via our plugin or not:
select meta_value from wp_postmeta where meta_key = ‘_scrape_task_id’ and post_id = YOUR_POST_ID;
You can change YOUR_POST_ID field with the two post ids you want to check. If empty result is returned then it means it is not created by our plugin.
hello i purchase alrdy,
i want to ask
if i use on domain1.com . can i change that domain , if i want to use another domain ?
Yes of course, just send us a private message from http://codecanyon.net/user/octolookc#contact your purchase code when you want to move your record.
can i change it everytime i want?
Yes of course you can send us a message and we reply back when we are done.
can i add some word on scrape title ?
like on real title is “PLAYING FOOTBALL”
but i want add word like “JACK PLAYING FOOTBALL”
Yes you can by using enabling template options. If the source is playing footbal you can write on your template value JACK [scrape_title]
can you explain about cookies ? for login ?
on template calculate, can i use percentage ?
For cookie usage you can watch our Facebook tutorial video on our product page. Since login systems differ a lot we can not just say use this or that etc.
On template calculate function if you want to take 15% of something you can use it like this calc([scrape_value] * 0.15)
it is still running if i close my wordpress ?
Yes scrapes tasks are always running in the background.
Hi, I just bought your plugin.
I just need the title to appear on the date.
But in its pluign appears date and time.
How do I show up just like this: 29/03/2017
I’m from Brazil
Thank you for your purchase. Does the date appear on detail page too? If so can you share us the url so we can help you to format it for your needs by using find and replace rules.
I tried this:
//div[contains(concat (” ”, normalize-space(@class), ” “), ” titulo-liturgia “)]
But the CSS come togheter…
Liturgia Diária – [scrape_date]
I need like this:
Liturgia Diária – 29/03/2017
We guess this is your website?
Can you send us the target website?
We’ve looked that detail page but there is no explicit date area at the content as we see. DIA 29 – QUARTA-FEIRA we have translated this text from google translate , it means day 29 wednesday, but there is no month or year information. Sadly our date selector can not grab the information
If you see any other date related field, you can share us the screenshot so we can write xpath or regex rules to grab the date.
I need to scape a website where each post have files attached to it (files can be image, pdf, doc …)
Is it possible to do it with your plugin ?
Use, by you or one client, in a single end product which end users are not charged for. The total price includes the item price and a buyer fee.
View license details
Get it now and save up to $10.50
Unlimited downloads only
$29 p/m on Envato Elements
Download over 18,000 items now
Learn almost anything with
Envato Tuts+ for free
9000 free tutorials, 3000 paid courses
Designers matched perfectly to
you on Envato Studio
2000 artists ready to undertake your work