92 comments found.
Hi Szabi,
Is it possible to scrape VRBO reviews?
Example can be found here – https://www.vrbo.com/en-gb/p1069577?noDates=true&uni_id=1322352
Hello,
Thank you for contacting me.
I checked and yes, scraping content from the site you linked is possible using the Crawlomatic plugin.
Please check below plugin settings I used to scrape content from this site:
Scraper Start (Seed) URL: https://www.vrbo.com/en-gb/p1069577?noDates=true&uni_id=1322352Content Query Type: Class Class
Content Query String: about-the-property u-freetext-fix
Featured Image Query Type: XPath
Featured Image Query String: //*[@class=’photo-grid__photo’]
Please check this tutorial video for setting up the plugin: https://www.youtube.com/watch?v=F6vhRJgCR_M&list=PLEiGTaa0iBIgcqNzVBaoTCS4ws47vNMuQ&index=1
Regards, Szabi – CodeRevolution.
Hi Szabi,
thanks for trying to do the scrape.
Unfortunately we are looking to scrape ONLY the “reviews” on this page, as previously mentioned.
Your scrape does not include reviews, is it possible?
Sorry for missing this.
I checked and reviews are dynamically loaded using JavaScript. Because of this, scraping them is possible only if you install a headless browser on your server (Puppeteer or PhantomJS) and configure the Crawlomatic plugin to use it. If this is not possible, you can also sign up for HeadlessBrowserAPI – which is a cloud service which renders dynamic content on pages and allows it to be scraped.
I use the below settings and scraped the first 5 reviews of each listing:
Content Scraping Method To Use: Puppeteer
Headless Browser Wait Before Rendering Pages (ms): 3000
Content Query Type: ID
Content Query String: reviews
Please check the below tutorial videos for details:
https://www.youtube.com/watch?v=g99IlDkt_SY https://www.youtube.com/watch?v=TXAdvsVCuy8 https://www.youtube.com/watch?v=rj-LOI-sc14 https://www.youtube.com/watch?v=205EinBQAoo&list=PLEiGTaa0iBIjDrfexapWc3M28iHwJI5tT&index=2Regards.
Hi Szabi,
thanks for coming back so quickly, your support is 1st class!
Regarding the need for Javascript, I thought this might be the case so I signed up to Apify, but can’t figure how to use it with your plugin.
Is this possible?
No, unfortunately Apify is not supported in Crawlomatic.
The supported alternative is HeadlessBrowserAPI: https://www.youtube.com/watch?v=205EinBQAoo&list=PLEiGTaa0iBIjDrfexapWc3M28iHwJI5tT&index=2
Regards.
Apify maybe worth considering adding to Crawlomatic. They offer a free version for low usage, which could help others too adding more versatility.
Thanks.
OK, sure, I noted your suggestion.
Hi Szabi,
I’m a little confused about the integration of Crawlomatic with an headless API.
Does it only work with your API or will it work with other headless browser API’s?
I have an API key from PhantomJsCloud but not sure how to use it with Crawlomatic.
Any advice would be appreciated.
Hello,
Currently Crawlomatic supports the following methods to parse JavaScript generated content:
1. You can install phantomjs or puppeteer on your server and set up the plugin to use any of them
2. You can use HeadlessBrowserAPI – for the moment this is the only supported cloud based solution for this. I haven’t added other similar solutions to the plugin yet, however, noted also this idea, will check on PhantomJsCloud.
Regards.
Thanks for your speedy reply Szabi.
Your HeadlessBrowserAPI would be great, but overkill for my needs. I only want to scrape my own advert on VRBO once a month to pick up any reviews I might have had, keeping it in sync with my site.
In this case I recommend installing Puppeteer on your server and setting up the Crawlomatic plugin to use it. This is a nice free alternative solution.
Set up Crawlomatic with a headless browser (Puppeteer): https://www.youtube.com/watch?v=g99IlDkt_SY
How to install Puppeteer: https://www.youtube.com/watch?v=KNOIJA4pTQo
I hope this helps.
Regards.
Don’t have VPS!
I suggest moving your site to a VPS, it grants full control over it and also does not necessary come with a huge price increase. For example, on Digital Ocean you can start with a 10$/month droplet and scale it up based on your needs.
Hi Szabi,
Forget previous comment, PhantomJS was quite easy to install on my server.
Now showing “INFO: PhantomJS OK” in Crawlomatic settings, but when try to use “visual selector” am getting error “PhantomJS has crashed. Please read the bug reporting guide at and file a bug report.”
Also tried entering a “class” that doesn’t produce any results and shows in log “No content found matching the query you set”.
Any ideas?
ps. Just tried again using the settings you used above, this time it ran ok, but gave a blank page!
PhantomJS is an older headless browser and might crash if used with newer websites. I recommed using Puppeteer if possible.
Regards.
Hi Are your plugin compatible with WordPress multisite? Do I need lincense for each of the subsites or does one lincense cover all my subsites in multisite?
Hello,
Thank you for contacting me.
Yes, all the plugins I created and which are included in the Mega Bundle are compatible with WordPress multisite.
Regards, Szabi – CodeRevolution.
I need clarifications on the lincense for subsites. Will each of subsites require activations?
Hello,
Thank you for contacting me.
If you plan to use the plugins on a network installed WordPress and activate the plugins on subsites, they will not require a different license, will work with the same license activated on the main site.
Regards.
Accepted in Google Adsense
Hello,
Congrats, now you can start using the plugins to drive traffic to your site.
Regards, Szabi – CodeRevolution.
Hello dear I have 3 WordPress sites Will this work on 3 different sites
Hello,
Thank you for contacting me.
Yes, the plugins included in this bundle can be distributed on multiple sites, however, please note that a single license of the bundle can activate only a plugin on one site. So, you will be able to move the plugins freely between your sites, but their license will be able to be activated only on a single site at a time.
If you have more questions, please let me know.
Regards, Szabi – CodeRevolution.
Looking to Know if i can post to external websites , example i have 5 domains made by PHP code & Other By WP , so i want to use post blog/articles to other websites (external website i own ) ,can i do that with your ?
Hello,
Thank you for contacting me.
My plugins work only on WordPress, because of this, they will be able to post only to the sites which are hosted on WordPress. However, the plugins I created can also scrape sites which are not using WordPress as a CMS and post the scraped data on your WordPress sites. I also have a plugin which can post to Blogspot sites, Medium sites or Tumblr blogs (but currently, plain PHP sites, which were custom built, are not supported for auto posting).
So, basically, you can post articles or data coming from any website, but only to WordPress, Blogspot, Medium or Tumblr hosted sites (where you can install the plugins).
Regards, Szabi – CodeRevolution.
Dear Author do you have any import plugin for banggood affiliate store? Thank you
Hello,
First of all, thank you for your purchase.
Currently I don’t have a plugin for the BangGood affiliate store, however, I noted your suggestion to my plugin ideas list, will try to do a plugin for the BangGood store in the future.
Regards, Szabi – CodeRevolution.
Hello,
Are Wikipedia articles (and other RSS articles) updated every time the original articles changes? So that articles will be always identical to the original articles?
Regards.
Hello,
Thank you for your question.
Currently the Wikiomatic plugin is able to import content from Wikipedia and not update content that is already imported.
However, the Echo RSS plugin (for importing content from RSS feeds) is able to also update content it already updated.
Regards, Szabi – CodeRevolution.
Thank you, Szabi.
Nice week 
Same to you too!
You wrote “the Echo RSS plugin (for importing content from RSS feeds) is able to also update content it already updated”.
Can it still update content if it is used with others of your plugins (such as Autoblog Iframe Extension, Code Revolution Config Import/Export Helper Plugin, etc.)?
Regards.
Yes, it is also able to update content if it is used together with the plugins you mentioned: Autoblog Iframe Extension, Code Revolution Config Import/Export Helper Plugin.
hi, please help. i cannot scrape https://cookpad.com/id please see this: http://postimg.cc/bS0mQKqT
Hello,
Please use this plugin config to get content from this site:
Scraper Start (Seed) URL -> https://cookpad.com/id
Do Not Scrape Seed URL -> checked
Seed Page Crawling Query Type -> Class
Seed Page Crawling Query String -> media__body
Content Query Type -> Class
Content Query String -> paywalled
Set Custom Curl User Agent -> Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.146 Safari/537.36
Regards, Szabi – CodeRevolution.
great job, looks like you worked really hard on creating “items” for the best effort to created. i just subscribe your mailing blog and your Youtube channel, i would love if u offering discount, please DM me and i’m going to place an order. thx
Hello,
Thank you for your subscribing.
I try to do my best with the plugins I create and also make them as useful as possible.
I plan on making a Christmas discount for some of my plugins, maybe also to this bundle. Will announce updates on my newsletter.
Cheers, Szabi – CodeRevolution.
NO BLACK FRIDAY DEALS!!!!
Hello,
For the Mega Bundle i will make a limited period Black Friday deal on Monday. I will announce details on my newsletter.
Sorry, but i cannot afford to put this bundle on the full discount period. Please check back on Monday. Thank you for your patience.
Regards, Szabi – CodeRevolution.
Good job, you seems pay so many effort on all-your-items, I’m going to place an order. Please DM me if any discount you offering now!
Hello,
Thank you for contacting me and also for you appreciation for my work.
Discounts will come next week, I will make a Cyber Monday/Black Friday discount season. Please subscribe to my newsletter on the right side of my blog, here: https://coderevolution.ro/blog/
I will announce discounts to my subscribers.
Regards, Szabi – CodeRevolution.
t points links at the bottom of the MEGA list are switched: Quoramatic – Questions and Answers Post Generator Plugin for WordPress URL to RSS – Custom Curated RSS Feeds, RSS From Any Site
Thank you for pointing this out, I fixed the links now.
Hi Mr Szabi thank you for all fast messages so already i sent to your email my wp login and i really tried many many times to fix it but something is wrong on plugin I used best keys so please go there to wp dashboard and try to import posts than you will see how is the posts data showing you thank you
take a look here https://gocooking.org/blog/
Hello,
Please resend login info, I tried, but I cannot log in any more.
My email is kisded@yahoo.com
Regards.
okay sir
email sent To You Sir Check please
please check again i sent to you new email>
Hi
Its seems that NO content is being posted only post title?
Sorry, I just posted this in the Newsomatic Automatic Post Generator thread.
Thanks
Hello,
This sounds like a plugin configuration issue.
Can you send me, please, temporary admin login credentials to your WordPress install, so I can check this issue out? Send it, please, to my email address: kisded@yahoo.com.
Regards, Szabi – CodeRevolution.
Hi Szabi how are you so i bought the plugin and i tried many time to set up but not working as i wish already i watched the video step by step so please i need your help to start work at this software p here my email atefkhadr99@yahoo.com i hope to hear from you very soon Atef
Hello,
Please send me an email with more details about which plugin you purchased, your purchase code for it from CodeCanyon and details about the issues you encountered while configuring it, so I can help. My email is kisded@yahoo.com
Regards, Szabi – CodeRevolution.
yes sure just please check your email inox in 5min and i will send you my wp login too thanks
Dear Author information sent to your email plz check inbox and nock me when you log in at wp account thank you
Thank you, I check and let you know by email.
Regards.
okay sir thank you too and see u there
sorry the plugin of Discussion on CJomatic – Commission Junction Affiliate Money Generator Plugin for WordPress NO IMAGES NO DESCAPTION NO NON NON NO…. PLEASE I WILL SEND U CANCELLATION AND REFUND ME THANKS
Hello,
I checked your site and it seems that Commission Junction database does not contain rich information for the ‘HomeAway’ query that you wish to do.
I suggest that you make queries in the plugin that will return rich posts, example: searching for “laptop” will provide posts with images and larger content.
For more details, please contact me at kisded@yahoo.com
Regards.
Hi, Is this include Web and Android and IOS i am interested purchase this application in extended price but can i resell and i have all Property rights
Hello,
Thank you for contacting me.
This bundle includes WordPress plugins, does not include Android or iOS apps. Also, the ‘Extended License’ for the bundle will grant you the ability to build services around these plugins (but not redistribute the plugins directly to clients), and will not grant you direct resell rights and all property rights.
Please check more details on this, here: https://coderevolution.ro/knowledge-base/faq/what-am-i-allowed-to-do-if-i-purchased-an-extended-license-for-your-plugins-bundles/
Regards, Szabi – CodeRevolution.
Hello, great stuff here, I m eyeing on this mega deal, but I have been checking out your plugins like newsomatic and contentomatic and other plugins can’t seem to be able to translate from English to Traditional Chinese, only Simplified Chinese?
Hello,
Thank you for contacting me.
The latest updates for all plugins will be able to translate also to Traditional Chinese. This was added recently in plugin updates.
Regards, Szabi – CodeRevolution.
Hi Szabi, any plans of making a Tiktok auto post generator ? Thanks !
Hello,
Yes, this idea is on my todo list, however, they do not have an official API, so the development is much harder than usual, because reverse engineering is needed…
Regards.
Hi, can I buy your Extended License and the sell your plugins to my customers in my website?
If yes, can I control the license with my customers, so that they can only use 1 plugin for 1 domain?
Hello,
Thank you for contacting me.
No, unfortunately this is not permitted with the ‘Extended License’. With this license, you can create a service using my plugins (like a SaaS product), where you will be able to allow payed users to log in and use services created by my plugins. Reselling the plugins directly is not permitted using any of available licenses.
For more details, please check this link: https://coderevolution.ro/knowledge-base/faq/what-am-i-allowed-to-do-if-i-purchased-an-extended-license-for-your-plugins-bundles/
Thank you for your understanding.
Regards, Szabi – CodeRevolution.
I saw a question from athemeplease: “Hi! Can I with Extended make a website and integrate MEGA or some of the plugins in the package and sell to clients like an agency…? Thanks”
And your answer: “Yes, using the Extended License, selling plugins that are added to a website is possible and allowed.
What is not allowed is selling the plugins exactly like here on CodeCanyon – on their own. If you add them to a service or a website, it is ok.”
What’s the difference with my question?
Selling a website with the plugins on it is allowed, because the main difference is that the clients are not getting the installable zip file of the plugins, just the ready made site, fully set up.
This is the main thing that is not allowed: redistributing the plugin files – if you sell websites or services that make use of the plugin, and the customers will not be able to download the plugins, this is accepted.
I hope managed to explain this well, if you have more questions, please let me know.
Regards, Szabi – CodeRevolution.
Hi, I bought the Mega package before. I just downloaded the latest file and your latest plugins are not there.
Where could I download the latest plugins ? Thanks !
Sorry ! My mistake. The files are actually there.
Hello,
I am happy that you found the files.
Regards, Szabi – CodeRevolution.
