Code

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

By
Cart 2,443 sales

wpBots supports this item

Supported

This author's response time can be up to 1 business day.

1123 comments found.

So I am facing this issue since I purchased this plugin. so I am using shortcode method to add scraped content to posts. for this I create multiple task, but after few days task stop working. and i need to reset the task and update manually each scraper_shortcode task again on each post where needed. and now suddenly my all task removed itself. there is no task. It also happend in past once, and all task appear again after few days. Plugin is really good, but with these problem its useless for me. in my 6 months support period I contacted 2 times but got reply only once.

Hi, thanks for contacting us. Have you created support ticket by the name “Mattia Guatta”? If so, we have replied to your support tickets. Let’s connect there. Regards!

No its not by this name. my email is na**llah718@gmail.com.

We’ve replied to it now. Let’s connect there. Thanks!

The license is not serving me. How can we reactivate it?

Hi, I have replied to your support ticket regarding this. Let’s connect there. Thanks!

no update since 2021 is this still supported or abandoned?

Hi, thanks for contacting us. It’s still supported and we are working on an update. Do let us know if any queries. Regards!

Just echoing what someone else said. I am interested but my site also uses PHP 8. Considering this was last updated last year how likely is it to see an update in the next few weeks?

Hi, thanks for reaching out to us. Yes, PHP 8 compatible version shall be released in a few weeks. Regards!

Our plugin has been updated for PHP 8.0 – please let us know in case of any issues!

I would also like to know if the plugin supports PHP 8.0, because my site has been updated to PHP 8.0 and the plugin does NOT work anymore?

Thanks a lot for the new PHP 8.0 version :-)

Looks like it’s not possible for me to update the module. Will I loose my settings if I delete the module and then install the new version?

Here is the error I get: Warning: Constant SCRAPER_PLUGIN_VERSION already defined in /var/web/site/public_html/wp-content/plugins/scraper/scraper.php on line 12 Warning: Constant SCRAPER_PLUGIN_NAME already defined in /var/web/site/public_html/wp-content/plugins/scraper/scraper.php on line 13 Warning: Constant SCRAPER_PLUGIN_URL already defined in /var/web/site/public_html/wp-content/plugins/scraper/scraper.php on line 14 Warning: Constant SCRAPER_PLUGIN_MAIN_FILE_PATH already defined in /var/web/site/public_html/wp-content/plugins/scraper/scraper.php on line 15 Warning: Constant SCRAPER_CONFIG_MENU_TEXT already defined in /var/web/site/public_html/wp-content/plugins/scraper/scraper.php on line 16 Warning: Constant SCRAPER_MAXIMUM_POST_COUNT already defined in /var/web/site/public_html/wp-content/plugins/scraper/scraper.php on line 18 Fatal error: Cannot redeclare SCRAPER_Plugin_init() (previously declared in /var/web/site/public_html/wp-content/plugins/aiscrapper-scraper-plugin-202c35738420/plugin.php:3070) in /var/web/site/public_html/wp-content/plugins/scraper/plugin.php on line 3095

Thanks! Are you having issue updating the plugin manually? In that case please delete the previous version manually from Plugins section and then install this latest version. All your previously created tasks shall remain as it is.
Apologies for the inconvenience caused.
Do let me know if any issue.
Regards!

Yes, I am trying to update the plugin manually. After deactivating the previous version, I was able to install and activate the new version. Afterwards I deleted the old version, so had both version installed and shown in the plugins at the same time. But looks like it works now :-)

Has this been updated to work with PHP 8+ yet? If not do you have a timeframe in mind for a PHP8.1 support update?

Hi, we are working on it. It might take some time (few weeks) for this release. Thanks!

Our plugin has been updated for PHP 8.0 – please let us know in case of any issues!

In some cases, when inserting the URL in the Page URL field, the page does not load, everything remains blank. This is due to? and how can we solve it?

Hi, it could be that the page uses Ajax to load the content, or could be that the site has bot prevention system in place. Can you please let us know the exact source url from where you are trying to scrape? Thanks!

I’m using your demo and trying to scrape all posts from a WP blog. The blog uses a “Load more posts” button to load 20 articles per clicks. The problem is that I can’t scroll through your demo, to choose this button as a selector. I’ve also tried to zoom out, but I have again to scroll for select “Load more” button. What can I do?

Hi, can you please let us know the exact source url from where you are trying to scrape so that we can check it?

I finally buyed it and find the solution. So, I tried to ran a new task from my site now. The first time collected about 50 articles (there are many more) and stopped scrapping new articles. Ιt looked like it was running but it wasn’t collecting any articles for a long time and the pause button didn’t work! I have to delete it via sql to stop it. After that I created a new task for the same site and set ~1 min. pause time. It collected 5 articles and the same happened again. It seem running but doesn’t scrap new articles and can’t pause it! What can I do? Thank you.

Hi, can you please email us to support@wpbots.net regarding the issue so that we can look further into it. Thanks!

need to change my license, I changed domain

Hi, can you please email us to support@wpbots.net regarding this? Also let us know the old and new websites and your purchase code there. Thanks!

Hi,

I bought your plugin and I am trying to scrape from this page: https://en.japantravel.com/search?sort=view&type=place&prefecture=tokyo&p=1 and all following pages (page until 27).

I have it set to scrape the title, the content (description), featured image, gallary images, phone nr, address and website.

However the gallery images, phone nr and website are not being scraped, this should be possible as this is plain text. Also its not going to to next pages.

Could you help me with figuring out whats going wrong? For the phone nr, website and address I an using custom fields because of my themplates, this used to work before with another website I had in the past with them same themplate but now its not working

Please help.

Hi, are you importing the content as WP Posts or some other custom post type?
For pagination, please use this XPath for Next Page – //ul[contains(@class,”pagination”)]//li[contains(@class,”next”)]//a
Regarding other points, we could tell after looking into the task. Please email us to support@wpbots.net regarding this so that we can look further into it
Thanks!

Hi,

Ive been waiting for a reply by e-mail for days after giving my wp login details. Havent heard anything from you since. Could you please help me with my request?

Hi, apologies for the delay. We’ve replied there now. Thanks!

Hi,

Does this scraper work on tripadvisor?

I just bought the scraper pro but still it seems like it cant scrape from tripadvisor. All i need to scrape is the title of the pages and information such as addresses, phone number and the images

Hi, thanks for reaching out to us. Unfortunately, as of now, you cannot scrape from tripadvisor as it seems to block the bots. Are there any other sites that you would want to scrape from? Regards!

Hi there – do you plan on adding an OpenAI integration to this plugin?

Hi there, this feature is not something currently contemplated in our roadmap. Very interesting feedback however, what did you have in mind?

So basically, just a prompt that can be given linked to OpenAi – so that the content can be summarised for example, after being crawled and before being posted

Gotcha, thanks for this feedback! We’re big fans of OpenAi and will take this into consideration – could be something we add down the road :)

I’m getting an error when I try to use the pinterest template, can you please check?

Hi, thanks for contacting us. Can you please let us know the exact source url from where you are trying to scrape so that we can check it?

I checked it and can scrape from the given URL – https://www.screencast.com/t/pVCysNyb

Please reach out to support@wpbots.net if you have any further queries. Thanks!

Can I assign a time for a previous scrape to update? That is to say, I have to bring information from several virtual stores, so the price on these sites tends to change very often. Is it possible to assign a certain time of how often and to scrape?

Hi, yes you can schedule the scraper tasks to run automatically at specific interval.

Hi. I tried to scrap data from https://justdial.com and it is giving Access Denied. I am using your demo. Your plugin can’t scrap data from justdial.com ??

Hi, it seems like the given url has bot prevention and hence cannot be scraped using Scraper plugin.

Damn man you never replied I emailed you, so many times that i wanted to know if this will work for me or not. But you never replied

Hi, thanks for contacting us and apologies for the inconvenience caused. We have not received any such email. Can you please email us at support@wpbots.net ? Regards!

Hello, is there a way to scrape the alt- oder title-tags of gallery images? Currently the filename is set as the title in the media library. Kind regards.

Hi, currently you cannot scrape alt / title tags of the image.

Hi, I’ve purchased and installed the plugin and I’m met with this critical error

Fatal error: Uncaught TypeError: array_filter(): Argument #1 ($array) must be of type array, string given in /opt/bitnami/wordpress/wp-includes/post.php:4155 Stack trace: #0 /opt/bitnami/wordpress/wp-includes/post.php(4155): array_filter() #1 /bitnami/wordpress/wp-content/plugins/scraper/plugin.php(1202): wp_insert_post() #2 /bitnami/wordpress/wp-content/plugins/scraper/plugin.php(1709): SCRAPER_Plugin->process_content() #3 /bitnami/wordpress/wp-content/plugins/scraper/plugin.php(2229): SCRAPER_Plugin->process_task() #4 /opt/bitnami/wordpress/wp-includes/class-wp-hook.php(308): SCRAPER_Plugin->wp_scraper_service() #5 /opt/bitnami/wordpress/wp-includes/class-wp-hook.php(332): WP_Hook->apply_filters() #6 /opt/bitnami/wordpress/wp-includes/plugin.php(517): WP_Hook->do_action() #7 /opt/bitnami/wordpress/wp-admin/admin-ajax.php(188): do_action() #8 {main} thrown in /opt/bitnami/wordpress/wp-includes/post.php on line 4155

Do guide me on how to fix this problem. I’ve also sent an email to support@wpbots.net

Hope to hear from you as soon as possible tq

Hi, apologies for the inconvenience caused. Please make sure that you are using PHP version below 8.0
If it’s still the issue then please reach out to us at support@wpbots.net

Hi,

it is possible to load hundreds of links from the same site and for the scraper to collect certain information in each one of them, e.g.

url of the photographs, price, description, SKU, Stock, Etc

If possible, up to how many links can I add to the batch list?

Is it possible that it is later scheduled to update the data previously collected?

Regards

Hi, thanks for reaching out to us. Yes, you can add multiple links in the scraper task. But it’s recommended not to add more than 30 links as it might cause server overload. And you can schedule the scraper task to run at specific interval so as to update the data.

Hi, I bought your plugin yesterday I have installed it and added the purchase code following the instructions but the plugin is not working, and checking the log console there is a 500 error related to this URL (I have removed the sensitive data): https://scraper.site/visual-editor/?purchase_code=xxxxxxxxx&hash=&email=xxxx@gmail.com&domain=https://xxx And when I access the demo link https://scraper.site/visual-editor/?purchase_code=demo-account the same error appears Could you please let me know what is wrong or if i need to do change something, thank you!!

Hi Emilio. It was a temporary issue, now it’s working again, can you please check?

by
by
by
by
by
by

Tell us what you think!

We'd like to ask you a few questions to help improve CodeCanyon.

Sure, take me to the survey