Discussion on WP Content Crawler - Get content from almost any site, automatically!

turgutsaricam

turgutsaricam supports this item

Supported

This author's response time can be up to 5 business days.

518 comments found.

hey looking to buy this but I can’t find the class for cateogries in the demo. https://hentailove.tv/search, I need all the genres in the search bar, but I can’t find the correct css selector

Hi,

If you cannot find the CSS selector for category URLs, then you can manually enter them to the category map setting. You do not have to write CSS selectors for category URLs.

ok I did that, but I can’t find Category Post URL Selectors

The plugin’s support does not cover configuration of the settings. Therefore, you need to be able to find category post URL selectors.

Hi turgutsaricam,

“Site A” block my server IP, so how can I use proxy? Does have any video for this solution? Please give me some tutorials?

And proxy work Test?

I’m going to https://free-proxy-list.net/

In proxy textarea, i’m write:

https://138.197.131.109:3128

Right?

Or

138.197.131.109:3128

Right?

But it only give me Error :(

Yes, you need to write each proxy URL to a new line in the setting labeled as Proxy. You can test your proxies by providing a site URL to the “URL for proxy testing” setting and then clicking the test button next to the setting labeled as Proxy. If the test gives you an error, it means the proxy does not work. When you provide a working proxy, the test shows a positive result.

tarayıcısı bazı sayfaları acmıyor neden olabılır dostum

Kaynak kodunu bilmeden maalesef bir şey söyleyemem. Tek söyleyebileceğim img elementlerinin src özniteliklerinde doğru URL’lerin olduğundan emin olmanız gerektiği.

turgut hocam gunaydın, kaynak kodu şu şelikde https://ibb.co/cVThwc

ilk src tamamdır fakat dıger urllerde srcset duruyor

Kaynak kodunu tarayıcıdan aldığınız için JS ile değiştirilip değiştirilmediğini bilemiyorum. Bu haliyle, srcset özniteliğini sildikten sonra bir problem olmadan kaydetmesi gerekir. HTML ile ilgili konular destek kapsamına maalesef girmiyor. HTML ile ilgili daha çok bilgi için internetteki anlatımları inceleyebilirsiniz.

Hello, is it possible to crawl or scrape table values?

Hi,

How do you want to save the table values? If you want to show the table as a table, you can easily do that. If you want to save certain data from the table, you can save them as post meta values to your database. However, you need to be able to write CSS selectors for the data you want.

Is it possible to get the table values from an external website and use their values to display them on my own table real-time?

No, unfortunately it is not possible to show any data from an external site in real-time.

was testing the plugin and when listing a site with 1000 categories the plugin does not save all, it saves about 500 categories. Is this correct? You can save all categories

I do not understand what you mean. You need to enter category URLs to the category map setting. Otherwise, the plugin cannot know the URLs of the categories. Where were you testing the plugin? Could you send me the URL of the settings? Please elaborate on the error you have faced a little bit more. What do you mean by “does not save all”?

I added about 1000 categories in “Category Map” and when saved half of them disappear

It is an issue related to the server, specifically maximum POST size, not the plugin.

edizayn

edizayn Purchased

Merhabalar Eklentinizi satın almıştım bir temama yükledim ve ositede hiç kullanmadım haber sitem olması sebebi ile oradan kaldırıp haber siteme yükledi ama şimdi lisans hatası almaktayım yardımcı olursanız sevinirim Teşekkürler

Merhaba,

Eski sitenizdeki eklentiyi pasif hale getirip yeni sitenizdeki eklentinin lisans ayarlarını yeniden kaydederseniz problem düzelecektir. Yeni yüklediğiniz sitedeki temanız Newspaper’sa, bu tema CRON işlerinin çalışmasını engelliyor. Dolayısıyla, temanızı ve diğer tüm eklentileri pasif hale getirip eklentinin genel ayarlarını yeniden kaydedip tekrar denerseniz büyük ihtimalle problem düzelecektir.

Eğer diğer domaininizden eklentiyi pasif hale getiremiyorsanız, lisans kodunuzu bana profilimde bulunan iletişim formunu kullanarak gönderirseniz eski domaininizi silebilirim.

turgut bey merhabalar,2 site eklendıgınde içerikleri çekmek için bir siteniin bitmesinimi bekliyor,yoksa 2 siteyide aynı anda çekermi

Merhaba,

Her siteden sırayla çeker. Örneğin, 3 tane site aktifse ve ayarlar dakikada bir yazı kaydedilecek şekilde yapıldıysa, 1. dakikada 1. siteyi, 2. dakikada 2. siteyi, 3. dakikada 3. siteyi, 4. dakikada 1, 5-2, 6-3, 7-1, 8-2, 9-3 şeklinde alır.

hello and thank you for a great plugin.

I have a question though. Lets say I have a page on MY website with a table. And I want this table to be updated regularly (once per day for example) with the content from the other table (on the other website).

In short, I need to regularly COPY the table (in text format) from other website to the SINGLE page on my website.

I tested the plugin, it really works, but HOW do I use it on EXISTING page/post?

Hi,

I’m glad you like the plugin. The plugin has a recrawling feature, which is basically updating the posts. However, you cannot use it on existing pages/posts. The posts need to be saved by the plugin so that they can be updated.

If you want to regularly update posts, you can enable recrawling option in the site settings. You can also select a time interval for recrawling. If you want to update a certain part of a post, e.g. in case a post has several tables in it but you want to update a single one, the plugin cannot do that. The plugin updates the posts as a whole.

ok, thank you

Merhaba Turgut, Bu eklentiyi aldığımızda tek bir site için kullanabiliyoruz diye biliyorum. Tek bir alan adımız için yani. Peki sonradan farklı bir sitede kullanma şansımız var mı?

Merhaba,

Evet, söylediğiniz gibi tek alan adında aktif olarak kullanabilirsiniz. Başka alan adında kullanmak için, ilk alan adınızdaki eklentiyi pasif hale getirmeniz gerekiyor. Ardından, aynı lisansı kullanarak diğer alan adınızda eklentiyi aktif hale getirebilirsiniz. Yani eklentiyi sadece bir sitede aktif olarak kullandığınız sürece istediğiniz kadar domain değiştirebilirsiniz.

Signgoo

Signgoo Purchased

Hello, I have bought your Plugin for my domain “www.manymize.com/newsletter”. Now I have the following notification in the dashboard:

“Your Content Crawler license has expired. Please get a new license until 16/04/2018 14:53 to continue using Content Crawler. Message: The license could not be checked with the server. Please try saving your license settings again in a few minutes. If the error persists, please contact the developer. Complete the setup now.”

Can you please verify why I´m getting this notification.

Hi,

The license server works without any issues. Your IP might have been banned if you saved your license settings too many times or gave an invalid license. Please wait about 30 minutes and save your license settings again. If the error message is still shown after that, please send your server’s IP using the contact form on my profile page.

Hi! I’m very interested in your plugin because I need to copy various products from other store. I try to configure it with the demo version but I can’t… I would’t want to buy it and then don’t know how to configure it. Basically I need: 1) Copy the product name to my AFC custom field 2) Rename the feature image taking the products name and separating their words with underscores. 3) Save the product as a pending post. 4) Recrawl products every certain time and add to pending post only those that have not been added before.

Thanks.

turgut hocam merhabalar,acaba android uygulama yapmak için yazılımınız varmı?veya tavsıye adıcegınız bır uygulama varmı saygılar

Merhaba,

Hayır, maalesef her ikisi de yok.

Hi! I’m interested in your plugin to copy various products from other stores but I have doubts because I try to configure it with your demo and I can’t do it. I need the next features:

1) Take the name product as a ACF text custom field (I’m using acf)

2) Take the main image and include it as a feature post image and in a image custom field.

3) Save product crawled as a pending post

Is possible to do it with your plugin? Thanks

“img” is not an element attribute. It is an element. If you want to get URLs of the images, you should write “src” for the attribute field. HTML-related questions are out of plugin’s coverage. If you do not know about HTML, you can search for the tutorials on the Internet.

The shortcodes defined in WordPress will be shown without any problems. If you are using the Tester page to see if those shortcodes work or not, they won’t work there. You should save a post and check it on the front-end page.

I did not understand your last question, unfortunately. Could you clarify it?

Yes, I used the src attribute but don´t load the image, accordint to the tester, the plugin is loading the image from the external url site url and I think he must load the image fron my gallery.

The shortcode works with the tester, but then don’t work if I create a draft post, I need to add something more on content so the shortcode be displaying.

The last question is about if is possible to rename the images that the plugin copy from the external site. For example if the image have and unfriendly name, if is possible to use the tittle post to rename, 03846585932.jpg to red_summer_shirts.jpg for example. Thanks!

The image might have srcset attribute. Other than this, I cannot say anything since I do not know about the code you have. Again, this is related to your HTML knowledge.

I do not know what shortcode you use. If you are using a shortcode defined in the plugin’s settings, it does not work outside of the plugin’s own templates. WordPress-wide defined shortcodes should work everywhere.

No, it is not possible to rename the images.

turgut selam dostum resimlerin jpg uzantısının hemen bitiminde bu tip kodlar var, 5951_01.jpg.pagespeed.ic.dgGmJa-nuR.webp -—- 5951_wfwf.jpg.pagespeed.ic.dgGmJa-nuR.webp --— 53353551_01.jpg.pagespeed.ic.dgGmJa-nuR.webp ---- jpgden sonrasını nasıl kaldırabılırım saygılar

Merhaba,

Eklentinin bul ve değiştir özelliklerini kullanarak kaldırabilirsiniz. Düzenli ifadeler kullanmanız gerekiyor. İnternette düzenli ifadelerin nasıl kullanıldığı konusunda birçok anlatım bulabilirsiniz.

Question1.: After Installation at my Domain, will I be able to clone other websites into Wordpress websites with almost similar look?

Question.2: Will I be able to clone multiple websites into Wordpress with your single License or I will have to buy multiple licenses?

Hi,

The plugin does not retrieve target site’s themes. The plugin gets only the content. Your theme is responsible from the look. Therefore, it depends on your theme.

You can actively use the plugin on a single domain. You can retrieve content from unlimited sites with only 1 license. If you want to use the plugin on another domain, you should either deactivate the plugin on the previous one, or buy a new license in case you want the plugin on both sites to be active.

hey for money would you find all the css selectors for a site?

Hi,

No, I do not do freelance work right now.

kaanyavuz

kaanyavuz Purchased

This comment is currently being reviewed.

Merhaba,

Eğer geçersiz bir lisans girdiyseniz veya lisans seçeneklerini çok fazla kez kaydettiyseniz IP adresiniz sunucu tarafından banlanmış olabilir. Profil sayfamdaki iletişim formunu kullanarak sunucunuzun IP adresini ve lisans kodunuzu gönderin lütfen. Lisans kodunuzu herkese açık ortamlarda paylaşmayın. Başkaları kodunuzu alıp kullanabilir, dolayısıyla bu durum lisansınızı kullanmanıza da engel olabilir.

Plugin does not receive license. My webiste is: saostarvn.com Please help me! Thanks Support

I need your FTP login credentials as well. Please send both admin and FTP login credentials through the contact form on my profile page. Please do not share your credentials publicly.

Please give me link your contact form I did not find the contact form on this the web Thanks u!

by
by
by
by
by
by