Code

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

By
Cart 2,443 sales

wpBots supports this item

Supported

This author's response time can be up to 1 business day.

1123 comments found.

hello

can this plugin extract main tag content and repost it as wordpress post

https://ojs.unud.ac.id/index.php/soca/article/view/83467

Hi, I checked it and could scrape from the given site – https://www.screencast.com/t/4l0tJUPlLQYf
And yes, you can import the scraped content as Wordpress post.

hello im struggling to scrape my product images from redbubble they show in the post etc but when i choose the selector the image is showing 404 error. not sure how to get it working correclty can you help please?

im using this selector /html/body/div1/div/div1/main/div/div/div2/div/div1/div1/div1/div1/div2/div/div2/img on this site https://www.redbubble.com/i/iphone-case/Blue-Celtic-Cross-and-Dragon-by-leen12/30942077.E69SZ

Alright! Have a good day :)

any idea why its stopping at 14 posts? there is 1500 to scrape and 100 on each page but its only posting 14

If there are multiple pages then you’ll need to select the Next Page button/link in the Scraper ( https://www.screencast.com/t/CRAE2MgV9M ).

If it’s still the issue then please email us to support@wpbots.net so that we can look further into it. Thanks!

Not working

Hi, it might have been a temporary issue. It’s working fine now. If it’s still the issue then please email us to support@wpbots.net so that we can look further into it. Thanks!

Pre-sale question: Amazon stills blocking your servers?

Hi, thanks for contacting us. Amazon site is still not scrapable. Regards!

Pre-sale : 1 – Is compatible with WordPress 5.9.3 and 6.0 / PHP 8.1.5 ? 2- Is compatible with WordPress multisite mode ? 3- It support FIFU plugin (https://wordpress.org/plugins/featured-image-from-url/) ? 4- It support big number of campaigns (about 4000 campaigns) ? It will run them fine without any issues ?

Hi, thanks for contacting us.

1 Is compatible with WordPress 5.9.3 and 6.0 / PHP 8.1.5 ?
>> Yes

2 Is compatible with WordPress multisite mode ?
>> No

3 It support FIFU plugin (https://wordpress.org/plugins/featured-image-from-url/) ? >> Yes

4 It support big number of campaigns (about 4000 campaigns) ? It will run them fine without any issues ?
>> Scraping from 4000 different websites? And approximately how many items/posts per each campaign?

1- Great ! 2- Ok 3- This mean we can put only source image URL without upload it ? 4- Yes 4000 campaigns each campaign with one website and each complain import 1 post each minute.

3) yes
4) That’s gonna be huge and might need lots of server resources.

Please email us to support@wpbots.net so that we can discuss further. Thanks!

Pre-sales question Hello, I’m trying to fetch a site, show all content without problem, but products and next buttons are not show. Regards!

Hi, thanks for contacting us. Can you please let us know the exact source url from where you are trying to scrape so that we can check it? Thanks!

Private message has been sent. Thanks!

Thanks!

Hi, it’s working with udemy.com. I want to make something like these examples: https://webcourses.us/ and https://www.codecademypro.com/

Hi, thanks for contacting us. I check it and unfortunately you cannot scrape from udemy.com.

I need someone to contact me for some questions I have for a project i´m doing. I think your plugin will help us!!!

Hi, thanks for contacting us. Please email us to support@wpbots.net
Regards!

does this scraper import articles for my website and then i can spin? i need to populate my website with content articles

Hi, thanks for contacting us. Unfortunately, the spin functionality has been discontinued from Scraper plugin.

does your plugin support woo product variations? i can’t find that settings

Hi, currently, it does not support product variations. You can only import as simple products.
Regards!

Hey, i cant find the cookie in a woocommerce site. Can you please help me?

Hi, thanks for contacting us. I didn’t exactly get your issue, which cookie and how is it related to HMWP plugin?
Looking forward to your reply. Regards!

I can purchase a predefined Template? I want a template for my site

There is no such template. But still your requirement is not very clear. Can you please let us know what you are exactly trying to achieve? Thanks!

Is the Scraper PRO comes like extension with this plugin or I can to buy separately? And what is the cost for PRO?

Yes, Scraper PRO is like an extension (for scraping Ajax based websites). You need to buy it separately as monthly subscription. Regards!

My client wants to only scrape 3 sites. It seems like it would be advantageous to have the links to the sites we will be pulling the content from most frequently – that way we can look at the page code and find the start/end tags or indicators that we can use to separate the article content from the rest of the HTML.

Can I create templates that pull the content in between the tags on the page? So like between

And the content we pull will show up as a page or post?

Hi, thanks for contacting us. Unfortunately, this is not possible (create templates that pull the content in between the tags on the page) via Scraper plugin. Regards!

I bought this plugin. But I have some problem, I have sent ticket to support, please check

Hi, we have replied to your support ticket. Let’s connect there. Thanks!

Ok. Please check. I need your quick help. Thanks!

Yes, done.

the scrapper cannot keep scrapping info because Cloudflare blocked my website ip, so now it is completely useless :(

Hi, thanks for contacting us and apologies for the inconvenience caused.
Can you please let us know the exact source url from where you are trying to scrape so that we can check it?

Hello.

Does it work for sites made using technologies like React JS?

thanks

Hi, thanks for contacting us. Yes, it should work. Can you please let us know the exact source URL from where you are trying to scrape so that we can check it for you? Regards!

For the sites like this, you’ll need Scraper Pro.

You can check Scraper Pro here – https://scraper.site/visual-editor/?purchase_code=demo-account

More info regarding Scraper Pro – https://support.wpbots.net/documentation/scraping-ajax-sites-content/

Pre-buy question – this plugin will scrape embed video from other site its not working on demo so please tell me its possible or not

Hi, thanks for contacting us. Can you please let us know the exact source url from where you are trying to scrape so that we can check it? But usually embed videos cannot be scraped.

its a adult website here is url: 1.http://shrtlink.me/7P3Rwp 2.http://shrtlink.me/RWkt

2 website url if any work just let me know

Hi, unfortunately, you cannot scrape embedded videos from such sites.
Regards!

Hi. Pre-Sale Question: 1/ does the plugin work on all online sales French sites? (Amazon; Cdiscount; Fnac ..) 2/ no API needed? 3/ possibility of having a post field to know “available / unavailable” ?

Thank you.

Hi, thanks for reaching out to us.
1) Yes, it works on almost all sites except on those which have bot prevention system. You can check using our demo link https://scraper.site/visual-editor/?purchase_code=demo-account
2) No API needed
3) You can add any custom field to the fetched content. Pls check the documentation here – https://support.wpbots.net/documentation/

Regards!

Pre-Sale Question: What if I have the url is in a sitemap.gz file.?. How do I scrape the urls from that? Is that possible with this plugin?

Hi, thanks for reaching out to us. Unfortunately, it cannot scrape from the zip/archive file. It can only scrape from website URLs and feeds. Regards!

Hello, you write that the Plugin have more then 100 Template in the Library. Where i can find them. In the Plugin Template Library i can find only 20 Templates.

Thanks for your quick reply, i search for german directory scraper like yelp

If i buy extend support? can you setup the scraper within my ListingPro Theme?

Hi, yes, we can help you create a scraper task. But can you please let us know from which site you want to scrape the content? Regards!

by
by
by
by
by
by

Tell us what you think!

We'd like to ask you a few questions to help improve CodeCanyon.

Sure, take me to the survey