Code

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

By
Cart 2,443 sales

wpBots supports this item

Supported

This author's response time can be up to 1 business day.

1123 comments found.

I have the problem that the tasks stop working after a random number of executions. I have tried once with limit 0 and limit 9999 and with both of them the tasks stop working randomly. To fix this I have to pause the task, reset it and then restart it otherwise it doesn’t work. Are there any known cases or guesses?

Hi, thanks for contacting us. Is it the issue with scheduled tasks only? Can you please each out to us via support@wpbots.net regarding it so that we can look further into it? Regards!

Getting error when scrape html content from another wordpress site. preg_match(): Argument #2 ($subject) must be of type string, array given

Hi, thanks for contacting us and apologies for the inconvenience caused. Can you please let us know the exact source url from where you are trying to scrape so that we can check it?

Hi, I want to create a business listing directory. Can your plugin get integrated with a WordPress form (like a shortcode) where the user enters Google My Business profile URL link in the business listing form, then the fields in the form autopopulate with the data scraped by your plugin from Google My Business profile?

It can be any Google Map linked to a Google business profile for example this is the share shortlink from Google map for an eatery in Toronto https://goo.gl/maps/XSbM6T9f4NLzaZGx9

The purpose is that the business owner doesn’t need to enter, manually, all the business profile information into the directory listing profile on my website. For example, on my business directory website, when a business owner creates a new listing for the business, all he/she needs to do click on Create New Listing, Enter Google Map link of the business in the form, and your plugin scrape the preset data (the template created by me) and populates in the form, ready for business owner to do any editing if needed and then just easily publish it. Hope this explains it.

Hi, you can scrape from Google My Business profile – https://app.screencast.com/HsFmzrewUtc3E
But you’ll need Scraper Pro for it. You can check it in our demo page here – https://scraper.site/visual-editor/?purchase_code=demo-account

Please reach out to us via support@wpbots.net so that we can let you know more about Scraper Pro and other queries that you might have. Thanks!

Hi, I purchased your plugin by the end of april. Subscribed to your pro subscription for 9 dollars per month, and automatically was double charged by your company (2 charges of 9 dollars). I requested a refund for the malfunction and I got the refund for the plugin price (31 dollars) but never got your refund for the 18 dollars (9 dollars per month charged twice). Now I have checked my email and you have been charging me the same 2 charges of 9 dollars each every month, 3 months now. I have opened a ticket, please refund me and stop charging me. Thanks

Hi, thanks for contacting us and apologies for the inconvenience caused. We have already replied to your support ticket regarding this. Let’s connect there. Regards!

Hi there, thanks for reaching out – we have fully refunded you for the double charges it must have accidentally been entered with duplicate details when you subscribed. We sincerely apologize for any inconvenience this may have caused! Have a great day and feel free to respond to our email support ticket if you need anything else :)

Pre Sales Question: Can I scrape blogs articles without having the RSS Feed URL? Cuz even if i got it, not all articles exists there!

Hi, yes you can scrape directly from the URL or from RSS feed. Can you please let us know the exact source url from where you want to scrape so that we can check it for you?

Hello! Tell me, can your script do a Google translation of what is found and only then add it to the site?

Hi, thanks for contacting us. Yes, you can Google translate the content and then import. Regards!

Hello, this is a pre-sale question.

Before I buy the plugin I want to know if it will extract all the images in the gallery of each listing here: https://www.casamientos.com.ar/estancias/aldea-de-los-cocos--e103840

I tried the demo but couldn’t make it pull the image gallery.

Thanks, L

Hi, thanks for contacting us. I checked it and unfortunately cannot fetch all the gallery images from the given site. Regards!

Not even a few? With around 5 I think is more than enough. Any customization in order to achieve that? Thanks

Can you please reach out to us via support@wpbots.net regarding this so that we can look further into it? Thanks!

Does support headless sites generated with js? Also, we use cus5om content and post types. Can we use this with CCT and CPTs?

Hi, thanks for contacting us. Can you please let us know the exact source url from where you are trying to scrape so that we can check it? Yes, you can import the content as CPTs.

hello, my ticket is : 154283, i am waiting for your reply

Hi, is this your ticket – https://www.screencast.com/t/zkKUPy4gb ? If so, we’ve already replied to it. If this is not the one, then please email us your query directly to support@wpbots.net
Thanks & Regards!

Just wondering if you have a public repo for scraping recipes?

I need to be able to scrape (any) Australian job site, I’ve tried several sites that have no bot prevention and wasn’t able to pull a few pieces of data I wanted.

I’ve been searching for a site we can properly scrape.

Do you have any suggestions/recipes for scraping Australian jobs from any job site? Popular or not.

We’d greatly appreciate any help on this matter.

Hi, thanks for contacting us. Can you please let us know few source URLs from where you are trying to scrape so that we can check it?

I have a few questions: 1) Can the scraper download a file and attach to the post?(Easy digital downloads) 2) Can the scraper automatic with cron job work all day long to scrape from a website? 3) Can the scraper create the products automaticaly? 4) Is it possible to auto-translate the content of the scraped post? 5) Can i use on Easy digital downloads?

Hi, please find below my reply to your queries.

1) Can the scraper download a file and attach to the post?(Easy digital downloads) > You can scrape and import content to any custom post type.

2) Can the scraper automatic with cron job work all day long to scrape from a website? > Yes, you can schedule the task to run at specific interval automatically.

3) Can the scraper create the products automaticaly? > Yes, you can import as Woocommerce simple products.

4) Is it possible to auto-translate the content of the scraped post? > Yes

Can it create Easy Digital Downloads product?

When you mean import content, it will import the Downloaded data as an attachment to the Easy Digital Downloads product post?

And what about selecting a category for the posts?

Unfortunately, it can’t import downloaded data as an attachment in EDD product post. You can select in which category the posts shall be imported to. If you have any further queries then please reach out to us at support@wpbots.net
Regards!

Contacted you via your external support.

Purchased plugin, installed, added purchase code. “Purchase code invalid”.

Did not work “out of the box”.

Looking forward to your response, thanks.

Hi, we’ve already replied to the support ticket ( https://www.screencast.com/t/YDWr4SIJ9q ). You can reply there and we hope to resolve this issue for you. Thanks!

Hello, I am looking for a solution to be able to scrape property listings from most likely Zillow. Would I be able to take that data and format it into a custom post type with Crocoblock? Also would it be possible to update or remove listings that are sold?

I just did a search and found someone else asking almost the same question as me and looks like the plugin has an issue with scraping sites that have bot protection. So my next solution would be to scrape listings from competitor agents that display the same data through an api. I would prefer not to put any competitor urls.

Hi, thanks for contacting us. Unfortunately, you cannot scrape from Zillow as it has bot prevention system ( https://www.screencast.com/t/490WhnEQU ). Do let me know from which other sites you are looking to fetch the content? You can reach out to us via support@wpbots.net

Can i scrap website like this, Dynamic url relaced by base64 numbers of 1,2,3

www.example.com/Replace base64 and populate base64 numbers/c29tZSBiYXNlIDY0IGNvbnRlbnQ=

www.example.com/MQ==/c29tZSBiYXNlIDY0IGNvbnRlbnQ=

www.example.com/Mg==/c29tZSBiYXNlIDY0IGNvbnRlbnQ=

....

1 = MQ==

2 = Mg==

www.example.com/Next page via base64 number/c29tZSBiYXNlIDY0IGNvbnRlbnQ=

Hi, thanks for contacting us. Unfortunately, this is currently not possible.

is this posible to scrape website like shopee.com.my / lazada.com.my ?

Hi, I checked it and unfortunately could not scrape from these sites.

Is the current plugin working with wordpress 6.2? I see lot of complaints on not working. Just wanted to be sure before purchasing it.

Hi thanks for your comment. There was some issues previously, however, we have updated the plug-in and it is currently now compatible Wordpress 6.2. Make sure you download the latest update! Many thanks.

Can i setup a news website with autopilot mode using this plugin to fetch and post news from different rss feeds? I need full article to fetch. Not just the little things given on rss.

Hi, thanks for contacting us. Yes, you can. Can you please let us know the exact source url (or rss feed) from where you want to scrape so that we can check it?

Hi, Any plan of integrating OpenAI to this plugin? I see other scrape has this option

Hi, Thanks for reaching out to us. We have this in our ToDo list but it might take time to get it implemented. Regards!

Is there a possibility to fetch content from 2 different site for the same post?

Unfortunately, this is not possible as of now.

Hi

I am wondering if it is possible to merge scraped content with a pre-defined static content with the help of this plugin?

Suppose, we scrape 3 piece of content from a particular remote post.

Can we merge pre-defined static content and scraped content in a post content like this:

Static Content 1

Scraped Content 1

Static Content 2

Scraped Content 2

Static Content 3

Scraped Content 3

...

Regards,

Suman Banerjee

Hi, yes, you can merge it like that. Can you please reach out to us at support@wpbots.net regarding this so that we can provide you with more details?
Thanks & Regards!

No Tasks since yesterday….. all gone, please fix your server!

Hi, it’s because there’s some conflict between Scraper plugin and WP v6.2. We are working on to resolve this issue and it might take few days. Meanwhile, you can consider downgrading to Wordpress version 6.1.1 (you can use WP Downgrade plugin for this).
We would like to apologize for the inconvenience caused.
I’ll update you soon on this.
Thanks & Regards!

ok thx! Its working!

by
by
by
by
by
by

Tell us what you think!

We'd like to ask you a few questions to help improve CodeCanyon.

Sure, take me to the survey