Code

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

Discussion on Scraper - Automatic Content Crawler Plugin for WordPress

By
Cart 2,443 sales

wpBots supports this item

Supported

This author's response time can be up to 1 business day.

1123 comments found.

Hi i need srape some travel sites i have 2 licences

this is the site https://www.nortravel.pt

ibut i cant do anything, can you help me please

Many Thanks! Manuel

Hello,

We’ve created a sample task for your request. Please clone it from templates library. It’s named “Task for manuelscp”.

You could use this task, modify it for your needs. Please don’t hesitate to ask if you need anything else.

Please let us know if there is any issue or problem you experience on visual editor.

Best regards

Hi, Awesome plugin. I wish to scrape Facebook page’s “about” > “See All” for items like the address, phone#, website link, e-mail, description etc into a custom post type, is this possible?

https://www.facebook.com/pg/[facebook-page-name]/about/?ref=page_internal

Regards

Hello,

Unfortunately it’s not possible. Facebook and some other popular websites uses different template engines to render their content. In those cases plugin doesn’t work properly.

On market, there are some plugins that especially focuses on Facebook scraping. You may prefer them for your request.

Please let me know if there is anything we could provide as a feature on plugin. Thank you for your comments.

Best regards

Hi, I want to scrape Wikipedia and I just want the contents that come from

and

,

, Could you tell me what should I do? Thanks.

Thank you for the reply, I have tried the“Wikipedia – Single Post Test”, but it doesn’t work for me. I mean I want the Wikipedia contents only come from p, h2, h3 tags.

Hello,

To get multiple p elements and combine them plugin requires and update. We’ve just made this update. Please download 1.0.39 version of plugin and install to your website. We’ve also updated your task for that request. You could clone it and use it.

The update will get all p elements from wikipedia content. I think you requested that. It will combine these p elements and create content with this way. That provides better and cleaner content.

Please let us know if you have any questions.

Best regards

Thank you

In demo, i tried to scrape product from etsy but not successful, is it it can only import product from aliexpress? Could it import product as external product in woo commerce? Regarding to the post content, is it able to add the button text ? Is it able to add tags after the scrape url (such as ?tag=affiliateID) ?

Hello,

Plugin can scrape from AliExpress or Etsy properly. But there might be an issue with serial scraper xpath or anything else.

Did you test it with Etsy sample from templates library or created another task for testing?

You could created a variable for product URL and add affiliate parameter to URL easily. Plugin supports modify functions for texts. You could use regex expressions or content section to modify your URL. If you have specific URL, I could create a sample task for you.

You could request your sample task with sending an email to support@imagets.com .

Please let us know if you have any questions.

Best regards

Hi,

Suddenly the plugin dosen’t delete the schedule task and without realizing brought back a schedule task that i make for testing purposes and replace all the content that i have in my home page.

That is a problem, please fix that.

I’ll be waiting for your answer, good night.

Hello,

We made some changes yesterday on sync server. It will get all tasks that you created on your purchase code. We did that to fix sync problems. Even if you move your domain, your tasks will be synced with your purchase code. I think this is good feature.

Also, I didn’t understand, it doesn’t delete scheduled tasks at the moment? I’ve just tested and all actions are operational.

Best regards

Hi,

With the changes you made to your servers it brought back an old task that I did to test the plugin when I bought it. Under the scheduled tab the name of this task is “scraper investing test”.

Before this task was completely removed, but with the recent changes appeared again and changed all the settings I previously had on the home page of my website.

Now i’m trying to remove this task again but i don’t have that option in the plugin.

Besides that, everything is working just fine and manually I set the home page as it was before.

Kind regards

Hello,

I’m sorry for this changes, it was defined to your localhost. I’ll also investigate delete issue. We’ve deleted this task for you.

I think it was active and cron-job automatically run the task. We’ll prevent this kind of issues for future. Thank you for your feedback, we apologize.

Best regards

Hello, Please I’m interested by your plugin but I have some questions : - I can’t see how we can use the scraped data, like storing them in database or post the collected data to an external URL, or get them through an API that we can request…etc - After creating the model, is it possible to make the URL variable (a parameter that we can change (taking the API example) Example : scrap -url=Myurl-toscrap -model=Mymodel - Can your plugin be a standalone product ? If not, can it be possible in the near future Thanks

Thanks for the clear response Any dates for the standalone version ? If I buy the plugin, can I change the source code to fit my requirements ?

Hello,

Sorry for late reply. We are planning to release standalone version in February. It will be in PHP scripts category.

And yes, you could change the source code to fit to your requirements. You could also request support and get help to modify source code from our support team.

Please let us know if you have any questions.

Best regards

Great ! I’ll buy the plugin to support you and hope you consider the features I asked for

does this plugin use google translator API or microsoft translator API to translate? if using Google Translator API the free version will be very limited, and the paid version is very expensive

Hello,

Plugin also supports Yandex API, they are almost same with Google’s translations. Yandex has free version. As you said Google Translator has no free version.

Because of their rules, we integrated official API of their.

Best regards

the scraper doesn’t add any data to the product list,i got bored of complaining

Hello,

I understand your concern. We can only help if you explain the problem. If there is a constant problem that still exist, please request refund : https://themeforest.net/refund_requests/new

With given refund you could try other products on the market.

Best regards

Unfortunately, it’s not possible. But if there is a website where google maps embedded, it can be possible to scrape from it’s attributes. But you can’t scrape map directly from google.com/maps

I’ve emailed to support@imagets.com for support please check :)

Hello,

We didn’t get your email, or we replied it already. If you didn’t get any response from support team, could you please send it again?

Best regards

Hello, You have a nice plugin. But, people are using it to steal my content. Please provide a solution to stop this, otherwise I will be needed to do reports and hire a programmer to find me a solution. Of course, if I will be put in this situation, I will make the solution public. Regards.

Hello,

We have black list for this kind of reports, if you could send your domain to support@imagets.com we will add your domain to database to prevent this issue.

Thank you for report.

Best regards

Hello, I don’t want to use this plugin, can you process a refund please. I’m sure you’re aware of the circumstances surrounding this decision.

Kind regards Dyran

Hello,

Please request refund from following link : https://themeforest.net/refund_requests/new

Best regards

I would like a refund please. This tool is not moving images from the source page its just pulling the image URL and not the actual images. I have been through the documentation many times and I am irritated because your product was suppose to make this process easy for me. I have spent 3 hours already on this! I am done. I am a seasoned developer and I dont want to mess with this plugin anymore.

Please refund as soon as possible.

Hello,

Please request refund from following link, we’ll approve it quickly : https://themeforest.net/refund_requests/new

Best regards

Hello, do you have a demo site where i can preview the content scraped? I need to see if it does what i need it to do before purchase.

Using the current demo with CodeCanyon doesn’t show me the scrapped content preview. It’s also showing me images from the next post and the post after as content number 1’s gallery image instead of separating them.

Kind regards, Dyran

Hello,

I’m sorry for demo, do you still need it? I see that you purchased product, do you need help on installation?

Please let me know if you have any questions. I’m sorry for late reply.

Best regards

Please send link to tutorial.

Kind regards, Dyran

Hello,

We don’t have a tutorial series but we have videos for different cases, please see this videos for your case :

Scraping a simple blog : https://www.youtube.com/watch?v=SJEtU7h9u_U

Our channel for other videos : https://www.youtube.com/channel/UCfHEOf3sf0mH0uGho-Ztbdw?view_as=subscriber Our documentation : https://scraper.site/documentation/

Best regards

i bought two liscence :( and till now am not able to scrap any data correctly.. the website am scrabing have a long posts.. i cannot scroll down (in the frame) in the post item tab please fix it to let us scroll

Hello,

Could you please share a task ID or website URL, so we could check, fix and let you know about it?

Best regards

many sites.. for example https://www.unlimit-tech.com/category/mobiles/ for example.. i cannot scroll down in post item and post contents

Hello,

I’ve checked website, and it looks like it isn’t visual editor’s problem. Source site has a plugin to hide scrollbar, they put their custom scrollbar on this website.

Anyway, to fix your problem, I’ve added a command tool. You could use it to disable scrollbar for websites. Websites may have different structures, but for this site, you could use this command :

document.getElementById('tie-container').className = '';

Copy this command, and paste it on visual editor command field (bottom of the editor), it will disable scroll plugin of this website.

Best regards

I request you a refund. Please approve. Thank You.

Refund approved.

Can it automatically pull the post? From any website ?

Hello,

We’ve created a sample task for fortniteinsider.com, you could clone it from templates library.

I’m not sure for several more sites, but you could easily setup any website with visual editor.

Please let us know if you have any questions.

Best regards

i didin’t understand this method “Design your own scraping method with visual editor, Scraper will automatically fetch and post 7/24 for you.” is this auto blogging ?

Yes, you need to define a model for auto-blogging. After that plugin will run this model and scrape content from source website with auto-pilot mode.

Hi, I need some help on this task 5daec99eb297c45dd76eba10573ec018 I want to capture and register the size and price attribute. consider that the price is assigned to the size attribute, additional do not know how to capture all the children of the size attribute. Thank you in advance for your assistance.

Hello,

I’m sorry but plugin’s current version doesn’t support product variations on WooCommerce. There is a different database structure on this functionality and we are still working on it to provide it with plugin’s next versions.

Best regards

Hi, I just bought a theme and plugin from envato market also. Now i am having trouble to scrape novel and upload directly to it https://themeforest.net/item/madara-wordpress-theme-for-manga/20849828 I am thinking can your plugin work for this theme and auto update to it?

Hello,

Since we don’t have this theme, I’m not familiar with their database structures. But if they use Wordpress’s core database structure, then plugin will work without any problem.

Please let me know if there is something I could do.

Best regards

I tried the demo but i its not grabbing classified data, Can you setup if i buy it ? And also can we schedule liek every 30 minutes we can grab data ?

Hello,

Can you share a sample URL, so we could check and get back to you about it? Sometimes, some websites uses same class names for different elements, visual editor is unable to detect this kind of structures. We are normally don’t help for all setup, but for issues you experience, we’ll be helping.

Schedule it for every 30 minutes is very easy. It can be defined on project settings with an option.

Best regards

by
by
by
by
by
by

Tell us what you think!

We'd like to ask you a few questions to help improve CodeCanyon.

Sure, take me to the survey