43 comments found.
i did it!!! hahaha!!! i went to your youtube LOL man you are a freaking genius! i have to figure out what to buy next 
I am glad to hear this!
Regards, Szabi – CodeRevolution.
i want to hide my feeds. how do i do that? i want them in a protected directory
Hello,
Sorry, but this is currently not possible using the plugin.
You will need a customized version of the plugin for this or a ‘helper’ plugin which will hide feeds.
Regards, Szabi – CodeRevolution.
where is a helper plugin? sending you a email
No, the helper plugin does not exist yet. It needs to be created custom for your needs, to offer the protected feeds functionality for you.
Regards.
how much? send it on my email please
I will check if this is possible and will get back to you by email.
Regards.
is it possible to bulk add urls? i can scrape the urls… just too many urls https://www.scrambledchefs.com/50-best-appetizers-that-are-bite-sized-flavor-bombs/
Hello,
Currently bulk adding URLs is not possible, however, I noted this feature idea, will think on it for future updates of the plugin.
A quick alternative I can think on now is to use this other plugin I created: https://codecanyon.net/item/coderevolution-configuration-importexport-helper-plugin-for-wordpress/20541061
It can save rules to file (which is textual and editable). You can edit the file and apply the rules back to the site, to upload the changes you made.
Regards, Szabi – CodeRevolution.
Presales question
Hi, I’ve tried to set up some crawlers in your demo version for websites that have the content on cards, like https://www.mckinsey.com/featured-insights/business-resilience or https://blogs.lse.ac.uk/businessreview/recent-posts/?category=Managementbut I can’t manage to get the input query for seed pages. Is there an issue fetching this type of content ?
Regards
Hello,
Thank you for contacting me.
Please try using the following settings for the above websites:
Scraper Start (Seed) URL https://www.mckinsey.com/featured-insights/business-resilienceDo Not Scrape Start URL: checked
Seed Page Crawling Query Type: Class
Seed Page Crawling Query String: item-title-link
Content Query Type: Class
Content Query String: article-body-wrapper
Scraper Start (Seed) URL https://www.mckinsey.com/featured-insights/business-resilienceDo Not Scrape Start URL: checked
Seed Page Crawling Query Type: Class
Seed Page Crawling Query String: cta-card
Content Query Type: Class
Content Query String: pf-content
Regards, Szabi – CodeRevolution.
Thank you for your answer, it was very usefull! Is there a special setting to recogninze different date formats? I’ve only managed to fetch dates like “24.09.2021”, but not “September 21, 2021”
Thanks
Currently the plugin cannot modify the date format is scrapes, it can display the scraped data only in the format it was scraped. Example: if you scrape 24.09.2021, the plugin can display it in the same format.
Regards.
Thank you for your help!
Glad to help!
Hey. It is me again. What is the difference between these two plugins? RSS Transmute – Copy, Translate, Spin, Merge RSS Feeds and Discussion on URL to RSS – Custom Curated RSS Feeds, RSS From Any Site? Do you offer any trial?
Hello,
Thank you for your question.
For details about the differences between the plugins, please check this video: https://www.youtube.com/watch?v=nCrp5GzMYZ4
Regarding trials, I can offer demos for each plugin, where you will be able to test them, they are linked in each plugin’s description, under the ‘Try Before Buy’ image.
Regards, Szabi – CodeRevolution.
this link is not crawl https://news.lankasri.com/news/india
Hello,
Thank you for contacting me.
Please use the following settings to create an RSS feed from this source website:
Scraper Start (Seed) URL:
https://news.lankasri.com/news/india
Do Not Scrape Start URL: checked
Seed Page Crawling Query Type: XPath
Seed Page Crawling Query String: //*[@class='article-item']
Content Query Type: XPath
Content Query String: //*[@class='ds-content']
Regards, Szabi – CodeRevolution.
Getting error when i running the Rule https://imgur.com/DNtIpy1
Please send me the URL of the demo site where you try the plugin and I check it.
Regards.
It seems that from my demo server this site also requires a User Agent to be sent with the request.
Besides the settings mentioned from above, please add also the following to make scraping work:
Set Custom Curl User Agent:
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Safari/537.36
Regards.
yeah now working fine… nice work
I am glad to help.
Regards.
Please can I use this plugin without wordpress on a different hosting?
Hello,
Thank you for contacting me.
Sorry, but at the moment, only a WordPress variant is available for this plugin. I noted this and will consider implementing also a standalone version of this plugin.
Regards, Szabi – CodeRevolution.
hey szabi – presale question: BigCommerce websites do not have RSS functionality, but have a functioning “blog” page. No RSS readers have been able to pickup the articles properly, do you know if your plugin works for blog content built on BigCommerce framework?
Hello,
Thank you for contacting me.
Please send me your website URL and I will give it a try, to check if the plugin works with it. You can send it to my email kisded@yahoo.com
Regards, Szabi – CodeRevolution.
Hi Szabi,
When setting the option >> Web Crawl to Feeds >> Max # Feed Items
If set to 100 and scheduled to run every 24 hours; does that mean every 24 hours it will import 100 new posts or does it mean the first 100 posts that were imported will be updated?
I am asking because after some time, Echo RSS Feed Post Generator stops creating new posts. I have Echo set to generate 1 new post per hour per rule.
Should I raise the number of Max # Feed Items per 24 hours in the Custom Curated RSS Feeds plugin or is my RSS Feeds file possibly courted?
Thanks, Jason
Hello,
The Custom Curated RSS Feeds plugin will scrape the articles from the pages you set in its settings, based on the Max # Feed Items count. You should increase this value, so more items will be included in the created RSS feeds. Also, feed data will be updated (not new posts imported, but latest posts will be scraped and updated).
Afterwards, the Echo RSS plugin will have more data in the RSS feeds, that it will be able to import.
Regards, Szabi – CodeRevolution.
Thanks Szabi, How would I set up pagination query correctly in my rules?
I tried the following but it did not work for me.
Seed Page Pagination Query Type: = class
Seed Page Pagination Query String = next
Regards, Jason
Please send me the URL you are currently scraping and i check on this.
Regards.
I sent the URLs to your support desk since the links are NSFW.
Thanks, Jason
Ok, thank you, i check on this and let you know.
Hello, I bought your other RSS plugin:
https://codecanyon.net/item/echo-rss-feed-post-generator-plugin-for-wordpress/19486974What’s the difference between that plugin and this one:
“Custom Curated RSS Feeds, RSS From Any Site ” ?
Are they both the same? I believe the one I bought also allows me to import pages from other websites. I did it a few times.
Hello,
Thank you for your purchase.
The Echo RSS plugin will import posts from RSS feeds to your site, while this plugin will scrape other websites and create custom RSS feeds using this data, on your site.
Please check details about the differences, here: https://www.youtube.com/watch?v=nCrp5GzMYZ4
Regards, Szabi – CodeRevolution.
Hello,
How to display (list) a combine feed on a page or a post? Any shortcode to use or what?
Hello,
Thank you for your question.
To display lists of feeds, you can combine this plugin with another plugin I created which is able to list feeds – Echo RSS Feed plugin, please check it here: https://codecanyon.net/item/echo-rss-feed-post-generator-plugin-for-wordpress/19486974
Please check this tutorial video for this feature: https://www.youtube.com/watch?v=d6Nr0EyqGSc
Regards, Szabi – CodeRevolution.
I would need to combine few feeds and display them as one feed on a page sorting by date. Which plugin can achieve that?
I saw your videos, you show how to add more than one feed in RSS to Post Rules. But it is not clear if your plugin can combine it as one feed that can be sorted, ordered and displayed on a page. Please advise.
Hello,
This is the plugin which can combine multiple RSS feeds, please check it here: https://codecanyon.net/item/rss-transmute-copy-translate-spin-merge-rss-feeds/27898626
Regards.
I added couple feeds in RSS Transmute to check if it can combine multiple feeds, but again it did not show any option, shortcode or a Single Feed which can be used to display the combined feed. Please help.
The combined feed can be displayed using the Echo RSS plugin, please check it here: https://codecanyon.net/item/echo-rss-feed-post-generator-plugin-for-wordpress/19486974
I am looking at this for purchase I have a social network I purchased here on CC it is called Sngine PHP Social Network here>> https://codecanyon.net/item/sngine-the-ultimate-social-network-platform/13526001 and my site link is here>> https://www.affasocial.com will this software work as an auto poster for my website. Currently, I use a news ticker and anaconda to auto post but find many issues with rss feeds like most take almost 30 seconds to load which causes issues with posts or broken processes. Please let me know if this will work for my task and thanks.
Hello,
Thank you for contacting me.
Sorry, but this plugin requires a WordPress website to work. It will not work on custom built websites.
However, if you have a WordPress website, you can install this plugin to it, and it will be able to create an RSS feed from the contents of your social media website (by scraping the content from it).
Regards, Szabi – CodeRevolution.
Thank you for the quick professional response.
I am glad to help.
Regards.
I got this because in the description it said it can scrape just about anything. I tried curating youtube video’s and nothing. I then saw that there is a separate youtube scraper plugin….. REALLY?
Hello,
Sorry for the inconvenience, but last year YouTube introduced some security measures and made their search results not so easy to be scraped. However, since then I updated the Crawlomatic plugin and it is able to connect with headless browsers to get around this content protection. Please check this video for details on this: https://www.youtube.com/watch?v=g99IlDkt_SY
Also, if you want to exchange the Crawlomatic plugin with the Youtubomatic plugin, let me know.
Regards, Szabi – CodeRevolution.
Yes please, I would appreciate that!
For details, please contact me by email: kisded@yahoo.com
Regards.
Can I use this plugin to “GET” and organize the data from this open free API https://www.dnd5eapi.co/ .
Hello,
Thank you for contacting me.
I haven’t tried to get content from APIs, but it might work, you can give the plugin a try, using it’s demo site, here: http://wpinitiate.com/coderevolution/custom-curated-rss-feeds-demo/
Also, please check it’s tutorial video, here: https://www.youtube.com/watch?v=gsskO4bn6xw&list=PLEiGTaa0iBIhcqmfD8bXRqr93N5Hoj-zf&index=1
Regards, Szabi – CodeRevolution.
Is keyword filtering of different feeds possible with this plugin ? For Example I create feeds from different e-com sites and then want to filter and display only certain products through keyword filtering, is it possible ? Thank you.
Hello,
Thank you for contacting me.
Yes, the plugin is able to filter products that it adds to the generated feeds using keyword filtering rules.
Please check the tutorial video of the plugin, here: https://www.youtube.com/watch?v=gsskO4bn6xw&list=PLEiGTaa0iBIhcqmfD8bXRqr93N5Hoj-zf&index=1
Regards, Szabi – CodeRevolution.
Thank you Szabi, the plugin looks really promising, though I am a little confused between this one and another one by you named “Echo RSS Feed Post Generator Plugin for WordPress”, I want to create a website where I can fetch products from any affiliate websites using specific filters through RSS Feeds and then list them as wordpress posts, I also want to add user passed keyword filtering and also to assign categories, tags or other taxonomies to the different RSS Feeds I will be creating, which one do you recommend as per my requirement ? Thank you again.
Hello,
Thank you for your question.
The difference between this plugin and Echo RSS is the following:
- this plugin crawls other websites and directly creates RSS feeds from them (on your site).
- while the Echo RSS plugin imports WordPress posts to your site from custom RSS feeds. It can also create custom RSS feeds from posts that are published on your site.
So, if you wish to create posts from feeds of other sites, Echo is the plugin you need.
If you want to crawl other sites and create custom RSS feeds from them, this is the plugin you need.
Regards, Szabi – CodeRevolution.
Now I get it thank you, I think I would have to buy both as I want to create both wordpress posts from custom feeds and I also have to crawl websites and create custom RSS Feeds from them, I just have two final questions – 1. Is there any bundle or package where I can get both ? 2. Also, is there a way where I can specify my affiliate id and it will automatically pass or add my affiliate id to the redirect url of the posts made through feeds ?
Hello,
1. Currently, the bundle that includes both plugins is this: https://codecanyon.net/item/mega-wordpress-bundle-by-kisded/19200046 – it includes also all other plugins I created and also future plugins that I will release.
2. The Echo RSS plugin has multiple mechanisms that might help. One of them is a Regex match and replace feature, which will enable you to make Regex expressions and replace the content that matches these (and even add your affiliate tracking code to the URLs). But, for this you will need to know regex.
Another feature that might help is the ‘Append This String To All Links From Content’ settings field from the plugin’s ‘Main Settings’ -> this will append a parameter to all links from imported posts by the Echo plugin.
Regards.
Greetings ! , I have purchased both of these plugins just now, whats more is that I bought them on cybermonday sale after I saw your video on youtube.
Thank you for your purchase.
Regards.
Your demo site is not working or what? I tried all sample sites, https://www.federmoto.it/specialita/motorally/sezione/notizie/, aptoide.com, etc. all just run and then no posts?
Hello, I responded to your email, provided settings for sites you want to crawl. I add them here also for future use:
Scraper Start (Seed) URL -> https://www.ccn.com/market-news/
Do Not Scrape Start URL: checked
Seed Page Crawling Query Type: Class
Seed Page Crawling Query String: elementor-post__title
Content Query Type (Optional): Class
Content Query String (Optional): elementor-column elementor-col-66 elementor-top-column elementor-element elementor-element-b860f09
and
Scraper Start (Seed) URL -> https://www.tipranks.com/news
Do Not Scrape Start URL: checked
Seed Page Crawling Query Type: Class
Seed Page Crawling Query String: hoverOpacity80
Content Query Type (Optional): Class
Content Query String (Optional): _2R_PgwFP6JivGtFml5dXWQ fontFamilyarial fontSize6
Regards, Szabi – CodeRevolution.
Hi any hint with this url : https://www.federmoto.it/specialita/motorally/sezione/notizie/
it works on crawling helper but doesn’t on crawler…
thanks
Hello,
For me, worked with these settings:
Scraper Start (Seed) URL: https://www.federmoto.it/specialita/motorally/sezione/notizie/
Do Not Scrape Start URL: checked
Seed Page Crawling Query Type: Class
Seed Page Crawling Query String: box-article-simple-content
Content Query Type: Class
Content Query String: article-content
Regards.hi does this work with any website or only wordpress sites?
Hello,
Thank you for your question.
The plugin needs to be installed on a WordPress site, but will be able to create RSS feeds for any site (not just WordPress sites).
Regards, Szabi – CodeRevolution.
that answers my question. thanks.
Would you be willing to do the install and the initial setup of one URL to make it work with products, save it as a template as part of the purchase price? I have NO idea how to do it after watching the video and doing the demo. The url is https://www.wiredforwine.com/collections/type_red-wine
Hello,
Thank you for contacting me.
I tried to create an RSS feed for the page you linked and I saw that indeed, it needed an extra settings for it to work:
(in importing rule settings) -> ‘Set Custom Curl User Agent’ must be set to:
Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/84.0.4147.89 Safari/537.36
This is because this website has a crawling protection system, that will not serve the page to bots (unless they set an User Agent string when they scrape the webpage).
Please set this in the plugin settings, and importing the feed should work.
Let me know if you need further help with this.
Regards, Szabi – CodeRevolution.
OK, that worked. A couple of more questions since I was unable to find detailed docs.
1. Can I create wocoommerce products with this? How?
2. If “no” to #1, do you have a product that this can be done?
3. I see the rss list created, how can I display it on a page?
4. I need this for affiliate links, can these posts be formatted into a grid as a product or post?
Thanks
Russ
1. Yes, WooCommerce products can also be listed in RSS feeds. The method is similar to the regular post scraping. You musts start scraping from a product listing page (a page from the target site showing multiple products). Tutorial video: https://www.youtube.com/watch?v=ykscbdmcndY
3. You can use this free plugin for this: https://wordpress.org/plugins/rss-feed-widget/
4. Depends on the plugin from above, this is done by the plugin that displays the feeds.
Regards.
Nice Work Congratulations ! and GLWS
Thank you
