Code

Discussion on WP Content Crawler - Get content from almost any site, automatically!

Discussion on WP Content Crawler - Get content from almost any site, automatically!

Cart 3,662 sales

turgutsaricam supports this item

Supported

This author's response time can be up to 5 business days.

2655 comments found.

How can I get support from you? I’m trying to crawl this site: https://www.eonline.com/, but it hasn’t been completed yet. I don’t see the crawler inside the dashboard.

Hi,

If you do not see a site that is active in the dashboard, then your WordPress installation might have a problem. You might be able to find a solution here. The plugin’s support does not cover configuration of the settings for specific sites, unfortunately.

Merhaba uzun zamandır aradığımız bir eklenti olduğunu düşünüyorum. Ancak ürün çekim nasıl yapılıyor bunu bir türlü anlayamadım. Bu konuda nasıl destek oluyorsunuz acaba? satın örneğin https://answear.bg/ bu sitedeki ürünleri çekmek istediğimde bu işlem nasıl yapılır demo tarafında siteyi v.s. taramadı. yanıtını bekliyorum teşekkürler. Bu konuda özel bir geliştirmede yapılabilirse oda uygun bizim için

Merhaba,

Eklentinin nasıl çalıştığını anlamak için hızlı başlangıç videosunu izleyebilirsiniz. Ürün çekiminin nasıl yapıldığını anlatan videoyu izleyerek da ürünlerin başka sitelerden nasıl kaydedildiğini öğrenebilirsiniz. Eklentinin diğer videolarını burada ve burada bulabilirsiniz. Ek olarak, şurada birçok rehber mevcut.

Eklentinin otomatik olarak site ayarlarını yapma özelliği yalnızca temel bilgilerin alınmasını kapsar. Eğer hedef site JavaScript kullanıyorsa, JavaScript çalıştırma özelliği olan proxy kullanmanız gerekiyor. Ek olarak, ürün kaydetmekle ilgili ayarlar otomatik olarak yapılamıyor ne yazık ki. Eğer ayarları yapamıyorsanız, genel olarak ayarların nasıl yapıldığının tarifi dışında, eklentinin ayarları yapmak konusunda sunduğu bir destek ne yazık ki yok.

Hi there, unfortunately the plugin did not for the complex site we are working so we needed to do the work manually. Could you please refund the order?

Hi,

You can send a refund request through CodeCanyon. If your case is eligible for a refund, it will be refunded.

CAN YOU TRY WITH LINK …...... 406 Not Acceptable WP Content Crawler Variables These variables might be handy when crawling Name Value Page URL ....... Current date 2025-08-16 06:08:49 I CAN NOT CRAWLER POST INSIDE. THANKS

Hi,

If the target site does not return their content, the plugin cannot do anything about it, unfortunately. You might try to use a proxy and/or add/remove certain request headers and/or cookies after investigating the site.

Hello, is it possible to run this plugin on php 7.4.3? I don;t really want to upgrade all the core files and plugins.

Hi,

The last version that supports PHP 7.4 is v1.14.0. The current version, v1.15.0, requires at least PHP 8.1.

Ok, how to download 1.14.0 version? Thanks

You can send an email through the contact form on my profile page so that I can send you the file.

Hi, is it compatible with CPT and ACF?

Hi,

The plugin can save posts as custom post types. It also has features that enable saving custom post meta. However, it does not have a specific feature for the ACF plugin.

GasOmer

GasOmer Purchased

I scanned my website and found this

/home/domain.com/public_html/wp-content/plugins/wp-content-crawler/app/storage/cache/response/get/840f5f2313a90f6bd187e95f5c0e94d80b0174ec.txt

SMW-INJ-23254-html.spam.drwy-0 Infected

Hi,

That file stores a response retrieved from a request made by the plugin. The plugin makes requests to URLs you choose, by configuring the settings of the plugin. If the URL you made a request has content that is considered “infected”, the plugin cannot do anything about it. You can stop making requests to the websites that are considered “infected” to avoid such cases.

Hi, I bought your plugin, but I haven’t been able to set it up even after two weeks. Could I ask you to help me configure at least the first one, so I can duplicate it for other cases later? I’d give you access and show you which form the downloaded data needs to be saved to in order for it to display properly on my end. Unfortunately, I can’t manage it on my own. Thank you.

Hi,

The plugin’s support does not cover configuration of the settings, unfortunately. In the plugin’s CodeCanyon page, at the very top, under the section “Before you buy, make sure you do the following”, it states that you should use the demo before buying it, to avoid such situations.

Please disable the domain name currently registered: travel.ttrandigital.com Thank you

Hi,

Please send your purchase code via the contact form on my profile page so that I can remove the domain registered to it.

Dear turgutsaricam,

I hope this message finds you well. I have a few questions that I would appreciate your assistance with. I have used WP Content Crawler to successfully fetch content from the website https://vuonhoatuoi.vn/. Everything worked smoothly and no errors occurred. However, when I tried to use WP Content Crawler to fetch content from https://tramhoa.com/ (which is also a WordPress website), I encountered an issue. Most of the products could not be retrieved, and for some items, the result returned as “The post could not be saved.” Only a small number of products were successfully fetched. I have tested the process to check the results, and it appears that there are no errors during the test. To provide more details regarding the issue, I am including the specific URLs that WP Content Crawler was able to fetch successfully and those it could not. The following URL was fetched successfully >> https://tramhoa.com/ke-hoa-chuc-mung/tuong-lai-ruc-ro-kt030/ The following URL could not be fetched (“The post could not be saved.”) >> https://tramhoa.com/ke-hoa-chuc-mung/khai-truong-hong-phat-kt095/ I have compared the HTML structure of both pages. Both contain the main product content, product title, and price, and both have similar numbers of scripts and forms present. There do not appear to be significant structural differences between the two pages that would obviously cause the error. Could you please help me identify the cause of this issue and suggest possible solutions? Thank you very much for your support. Best regards,

Hi,

Could you please export your site settings to the demo of the plugin and check if the same issue occurs there as well? If it does, please send your site settings (the text of the “Import/Export Tab > Export Settings” setting) via the contact form on my profile page so that I can check what might be causing the issue. If it does not occur in the demo, since it means that the issue is not related to the plugin but to your WordPress installation and/or target website, then please send me your debug file as explained here.

Do you have a way to use the GPT-4.1 models? Currently, the performance and cost are very good.

Hi,

It is not currently possible, unfortunately. I plan to add it in the next version of the plugin. The date of the next release is currently not certain yet.

plakis

plakis Purchased

Hi, i want to crawl about 500 post from one Drupal site, there is no post date in source site, is it possible to setup, that crawl would start from oldest post to newest? I want the same order of post as source site

Hi,

If the target site has a URL that shows the list of posts from the oldest to the newest, you can use that URL as a category URL. Otherwise, since there is no post date, it is not possible to do so, unfortunately.

Hello is it possible to add additional post info that is used by the specific WP theme that used Advanced Custom Fields plugin? Haven’t found how

Hi, I bought your plugin, but it can only be used on 1 website. What should I do if I want to use it on unlimited websites?

ok friend, so where can i contact you to buy 3 licenses like that.

I have to buy 3 licenses then you give me 1 more license. Or I can buy 3 licenses at a discount

The licenses need to be bought from CodeCanyon. After you buy the licenses, you can send me the license keys through the contact form on my profile page, so that I can increase the domain limit of one of the licenses by one.

About your second question, I can only provide a discount as a free license, and I provide a free license for at least 3 licenses. So, you can get a free license for every 3 licenses you have.

Wptit Purchased

Can you suggest me setting that only allow plugin to crawl latest post or post done in last 24 hour, at present plugin is also crawling old post and posting them in website

Wptit Purchased

i have more then 4 licesnse but all keep on giving this error

Message: The license could not be checked with the server. Please try saving your license settings again in a few minutes. If the error persists, please contact the developer.

request you to give solution i also checkd server and dont foudn any issue

Hi,

The plugin’s license server is running without any issues. The issue on your site might be related to another third party software or your server. The other plugins/theme on your site might be blocking the plugin from connecting to the license server. If you have a cache plugin enabled, that plugin might be the issue. If you disabled all the other plugins and converted your theme to one of the official WordPress themes, and the issue still persists, your server might be blocking requests made to wpcontentcrawler.com, which might be because of some firewall rules. In that case, you need to contact your server’s support.

Wptit Purchased

The license key entered for Content Crawler is not valid or it could not be checked. Please verify your license until 09/05/2025 07:17 to continue using Content Crawler.

Message: The license could not be checked with the server. Please try saving your license settings again in a few minutes. If the error persists, please contact the developer.

Number of attempts left until the features are disabled: 1

Wptit Purchased

Hi, Your plugin is conflicting with a lot of plugins and theme , can you find solution for this ? it works fine when we use default theme and then it topped working when we started adding some plugins

hi I just purchase your Crawler but i have problem with the key, it is not valid.

Hi,

I replied to your email. Please do not send the same message from multiple communication channels.

hello, I must apologize but this application is too hard for my team to use, and I just built an application to do what I thought this did. Can I return this plugin?

Hi,

You can send a refund request. Please note that I normally do not refund in such cases, since the plugin has a demo that can be used without buying the plugin.

Hello,

I’m using the latest version of the wp-content-crawler plugin with PHP 8.1 or higher.

However, I’m encountering the following fatal error:

PHP Fatal error: Declaration of Illuminate\Container\Container::get(string $id) must be compatible with Psr\Container\ContainerInterface::get($id) in /wp-content/plugins/wp-content-crawler/app/vendor/illuminate/container/Container.php on line 739

Could you please advise if there is a fix or if an update is planned to resolve this compatibility issue?

Thank you.

About the featured image, it might be related to the target site’s design. For example, the CSS selectors you use to select the featured image might not work in all the post pages of the target site. So, you need to thoroughly test your settings first.

About the filter, if the plugin expects 2 arguments, the filter must be called with two arguments. If another plugin/theme triggers a filter that expects a specific number of arguments with fewer arguments, the issue is caused by that plugin/theme. You can contact their support.

After checking each plugin one by one, I found that the issue was caused by the caching plugin WP Rocket. When I deactivated WP Rocket, everything worked correctly with the original code. Thank you very much for your support.

I am glad the issue is resolved. Thanks for letting me know.

Hi, have bought your plugin on the back of your answer.
Have installed on local wamp server for testing.
Struggling to achieve your method to prepend WC affiliate product url’s and couldn’t find an appropriate guide.
Any chance you could provide screenshots of how to do this?
Regards

The plugin’s support does not cover the configuration of the settings, unfortunately. If you did not see a change, you might not have saved the settings or your find-replace rules might be wrong or you might have forgotten to check the “regex” checkbox. You can learn more about the find-replace settings here. You might want to start with a simple change and confirm the change is made. After that, you can build upon that to get to the result you want.

As previously stated, have copied your settings but didn’t get the same results, including the things you think we may have missed.
My pre-sales question covered what we are trying to achieve, your example doesn’t show this!
If support doesn’t cover the use of the plugin then I’m not sure what support is actually for. There is no guide showing what we are doing and we don’t know how to use your plugin. That’s why we asked if it was possible before purchase.
We have only bought this plugin to do what we asked pre-sales, if you can’t advise or the plugin doesn’t actually do it then it’s of no use to us.

ps. Can you set up an example in your demo for us to view?

Sorry for the misunderstanding then. You can send a refund request.

by
by
by
by
by
by

Tell us what you think!

We'd like to ask you a few questions to help improve CodeCanyon.

Sure, take me to the survey