Code

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

By
Cart 2,443 sales

wpBots supports this item

Supported

This author's response time can be up to 1 business day.

1123 comments found.

We have a problem. Events are listed on multiple websites but we want events in one place. If we obtain URL’s of these website event pages, can we display them on an one website? If, so does such a feature require heavy loading or use of many resources on the hosting?

Hi, thanks for reaching out to us. Yes, you can fetch from multiple sites and display in your website. Server resources depend on how many items you are scraping at a time and how often, but medium server resources shall be fine.
Let us know if you have any questions. Regards!

I have some problems when copying woocommerce products, pls help me

Hi, thanks for contacting us. Please email us to support@wpbots.net regarding the issue so that we can look further into it. Also let us know the exact source url from where you are trying to scrape. Thanks!

Hi, thanks for contacting us. I could see there that you are trying to scrape from http://www.example.com/news/ ? Or you have renamed it while posting here?

Please let us know the exact source url from where you are trying to scrape so that we can check it.

Regards!

Hi, we checked it and unfortunately we cannot scrape from the given source site.

Hi, Can this plugin scrape only 200 posts or more from a single website gradually and automatically

Hi, thanks for contacting us. It can scrape more than that depending upon your server resources. You can also schedule to scrape the content automatically.
Let us know if you have any questions. Regards!

Hi,

I want to display only an iFrame with the post preview of the scraped post instead of the text. I want to use embed.ly for embedding the post preview. How is this possible with your plugin or do you have a better way to display the post preview?*

Thanks for help Oliver

Hi, please email us to support@wpbots.net regarding the issue/requirement so that we can look further into it. Also, show us using the screenshots what you want to achieve. Thanks!

I’m not sure what’s happening here, but the scraper stopped working. I see there’s no update to this script for over 1 year and Wordpress came out with at least 3 versions that I’m aware. I’ve tried to run this script twice and it crashed my DEDICATED server. Help!

Hi, thanks for contacting us and apologies for the inconvenience caused. Please email us to support@wpbots.net regarding the issue so that we can look further into it. Also let us know the exact source url from where you are trying to scrape.
Thanks!

IPN PURCHASED SUPPORTED

about 1 month ago

I’m not sure what’s happening here, but the scraper stopped working. I see there’s no update to this script for over 1 year and Wordpress came out with at least 3 versions that I’m aware. I’ve tried to run this script twice and it crashed my DEDICATED server. Help!

STILL <—waiting for a resolution and support for this issue. OVER 1 month! Is this what’s to be expected from purchasing this product? I’m also given the option to “RENEW” and seriously considering if this is worth the headaches I’m getting with both the product AND support! Others may want to CONSIDER as well!

Hello,

I have been trying your demo but I was not able to scrape attributes from a page like this : https://www.gsmarena.com/samsung_galaxy_a72-10469.php I could not figure out how to get a single attribute instead of the all block.

Could you also tell me if it is possible to automatically create woocommerce products from scraping, on a schedule ?

Thank you very much

Hi, thanks for contacting us. You can automatically create woocommerce products on a schedule, but currently, you can only import the product as simple products (not as variable products). Regards!

Your extremely slow, no solutions, where is MY refunds (please don’t scam us)

I will escalate if you stay like this!

Already refunded. Regards!

very bad, and just stopped me I got blocked on 3 sites, only got 100 out of 1000’s, and got fooled into paying 9$ additional for nothing also??? I want a refund of both payments so I won’t escalate the matter..

Hi, apologies for the inconvenience caused. Please contact us via email support@wpbots.net

Do let us know the source urls from where you want to scrape the content so that we can check it for you. Also mention the issues that you are facing while scraping.

We’ll help you resolve the issue on priority. If it still doesn’t work then we’ll be happy to make the refund.

Thanks for your understanding! Regards!

nothing, just talk no solution???!!

Already refunded. Regards!

If I buy this once, can I use it on multiple websites?

Hi, we’ve already replied to all the support tickets. Can you please let us know your email or your name in the support ticket? Regards!

mmoranjkic@gmail.com – I will send mail again

Hi, we have already replied to your support ticket. Let’s connect there. Thanks!

Do you have a video on how to scrape a shop and add it to woocommerce with variations?

Please help, almost got something working but cant get attribute working and categories…please help!

Hello where is the support when you need it?

Hi, thanks for reaching out to us. Sorry for the delay as its weekend. But with Scraper plugin you can only import as simple products, and not as variable products. Regards!

i want buy your product and im try your demo

see

Screenshot-66

can it be overcome?

Hi, thanks for contacting us. Unfortunately, you cannot scrape from this site as it seems to have bot prevention system. Regards!

https://thefly.com/news.php ... You scraped nothing… Anyway out?

I check your You can check Scraper Pro here – https://scraper.site/visual-editor/?purchase_code=demo-account... Same thing, NOTHING?

1. I tried many sites, just don’t know how your system work? 2. Where is your REGEX? 3. Where is the word replace, translate. etc? 4. How much is your Pro? I am using WP Automatic, which is okay except I couldn’t scrape the the column like the stock index row at fimnance.yahoo.com, and it spammed a lot shits in the postmeta database So, why don’t you put your plugin in wordpress so that I can see the results? And yeah, gimme some tutorial how to do the scrape(nad embed), regex, etc. Thanks

1, 2) https://support.wpbots.net/documentation/

3) you’ll need to click on transform button in each field and then you’ll see the options – https://www.screencast.com/t/e1KdYWVGO

4) scraper pro is $9 per month

Regards!

Tried extracting the Indices from Finance.Yahoo.com, all I got is the only “S&P 5003,811.15-18.19(-0.48%)” How to embed the the whole row on my website (perhaps as a widget)? I understand you have a Pro version? Is this the one http://www.wpscraper.com/... What’s the difference?

Hi, thanks for contacting us. What exactly do you want to scrape from finance.yahoo.com ? I tried to scrape from https://finance.yahoo.com/news/ and could scrape from it – https://www.screencast.com/t/ACrUIObDTtR

Let us know. Regards!

Did you see the column on top that display the market index like “S&P 5003,811.15-18.19(-0.48%)”... I want the whole row complete with all the different index displayed in real time (exactly like Finance,Yahoo)

Hi, that row cannot be scraped as the content is loaded via script there. It’s better if you fetch such market index from other sites?

Dear author, could you add a spinnerchief support?

Hi, thanks for contacting us. Currently we are not supporting spinnerchief. Regards!

your demo does not work with products scraping ( WP )

nothing works blank page result from 2 different websites

i mean the 3 buttons options none is working just loading

Hi, can you please let us know the exact source URLs so that we can check?
Please note that the site that have bot prevention system cannot be scraped.
And some sites that have Ajax loaded content needs scraper Pro – https://support.wpbots.net/documentation/scraping-ajax-sites-content/

Does the Instagram scraper still work? It doesnt work in the demo w/ @cbsnews

Currently, instagram pages are not scrapable.. We’ll need to check and create template for it.

Thats 100% UNTRUE as I wrote my own scraper that works flawlessly…I just wanted to test yours in case yours was more efficient than mine.

Please reply here once you modify your scraper so I may test. Thanks

Hi, good to know that your version works. Scraper WP plugin also used to scrape from insta pages previously, but recently there has been changes in the source HTML. We’ll need to make the changes accordingly in our code too and hope to fix it in the upcoming versions of the plugin. Thanks!

Hello,

I still haven’t been able to use your extension because it forces me to spend too much time configuring for different website urls :-(

I also realize that I can’t scrabble some website urls anymore. I have a white screen in the preview. Maybe the layout of the site has changed :-(?

Suggested feature that would finally allow me to use it: save the configuration of a site in a local library (and allow its modification) :-)

By creating a new task, we could easily use it without going through duplications (a bit random, I think?).

regards

It’s not that we don’t want to put in the roadmap. You can see that we already have template system. But the problem is that each and every site has different HTML structure and it’s almost impossible to create templates to match these numerous sites.
Thanks for your understanding!

HI, Ah, I don’t think we understand.
I don’t want to use a model that works on hundreds of different sites.
I will scrape hundreds of urls every year but on 20 or 30 sites maybe.
So I just need to load the template of a site (without wasting my time searching and duplicating) to scramble an article from that site.
More coherent and simple :-)

Yes, but you’ll need to create tasks for these manually.

I run the task on one website. same content is automatically publishing on other domains where this plugin is activated

Hi, did you email us to support@wpbots.net regarding it (along with the screenshots as mentioned previously)? If yes, then please let us know your support ticket ID. If not then please email us the details. Thanks!

I have already sent you two emails on this email id. You did not give any response and sent ticket id.

Hi, we did reply to it. Please check – https://www.screencast.com/t/3GwA27BtvL
Please check your Spam Email box too. I’ve replied to it again now. Regards!

Hi. This is “Pre-Purchase Questions”. I already try the demo and I like it. But I have several question : 1. When i tried this particular website “https://livescore.com/en/”, I found there is a content section that showed “loading”. Will it be able to be scraped properly? 2. Is it possible to scrape from this website as soon as the website updating the content? Thank you.

Hi, thanks for reaching out to us. I checked it and unfortunately we cannot scrape the live score from https://www.livescore.com/en/
Regards!

by
by
by
by
by
by

Tell us what you think!

We'd like to ask you a few questions to help improve CodeCanyon.

Sure, take me to the survey