43 comments found.
Does it support social media feeds such as FB, INSTA, TIKTOK, X, etc.?
Hello,
Thank you for contacting me.
To scrape social media and to create RSS feeds from them, you will need a special tool installed on your server: Puppeteer – which is a headless browser. This is needed, as the social media sites usually use scraping protection systems and Puppeteer can work around these. Tutorial on how to install it: https://www.youtube.com/watch?v=pRUDcSOe724
Afterwards, the plugin can be configured to use it for scraping.
Regards, Szabi – CodeRevolution
Is it possible to exclude some class from content crawl?
Hello,
Thank you for contacting me.
Excluding classes from Crawling is not directly possible, but you can set up the plugin to crawl only links with a specific class, ID, or other custom HTML tags.
You can use the ‘Seed Page Crawling Query Type’ and ‘Seed Page Crawling Query String’ settings fields for this.
Regards, Szabi – CodeRevolution
Hmm, tell me for example i wan’t to show this 3 ads after 2 paragraph on this link https://www.sd.rs/sport/kosarka/dzavonte-smart-posle-poraza-od-panatinaikosa-2024-03-20 i can’t found any plugin where i can exclude content like this “recconomed read articles”
If you want to import this article as a post to your site, I recommend you check Crawlomatic, which is able to also exclude by Class “in-article-reference” (for the above URL). Please check Crawlomatic, here: https://codecanyon.net/item/crawlomatic-multisite-scraper-post-generator-plugin-for-wordpress/20476010
Regards.
quiero hacer esto pero leyendo incluye el tema premium compatible con este plugin, estoy empezando de 0 y me quiero dar esta oportunidad de tener web de noticias sobre finanzas
I want to do this but reading it includes the premium theme compatible with this plugin, I am starting from 0 and I want to give myself this opportunity to have a finance news website
Hello,
Thank you for contacting me.
The plugin does not include a theme, however, it will work with any theme, free or premium, so you can use the theme you like the most.
I hope this info helps.
Regards, Szabi – CodeRevolution
I try to do a test but I can’t make it functional in the demo, but I use feedzy it works well for me even until traffic reaches the site and it is a test. Do you have any Spanish video, something to become more familiar with to learn how to use this version… I would like to read your response
my test with your pluging : https://www.excelsior.com.mx/rss.xml
Hello,
Please send me the demo URL you created, where you tested the plugin. I will check on its settings and help set it up.
Regards.
maybe can auto translate the plugin with wp spanish
Please note that you sent a demo URL where the Aiomatic and the Echo RSS plugins are available, not the “URL to RSS” plugin, as you commented on the “URL to RSS” plugin.
Let me know what I miss, let me know about which plugin are you asking, Echo RSS or URL to RSS?
Regards.
I managed to make it work, through an English video, although I didn’t understand what it said, I just made the same clicks haha, just the demo, the post doesn’t matter, I would have liked to see better details
Ok, I am glad to hear that it works for you!
Regards.
I have a question, I have been testing this plugin…. if the RSS ceased to exist tomorrow, the plugin would still serve me, you will not have a step-by-step manual in Spanish
I am sorry, but i don’t speak Spanish, beacause of this, it is hard for me to create Spanish user manulas. But i noted this idea, if i find the right people for this job, i will ask them to do this.
Regards.
First thank you for answering my questions. Last question I have, can I import posts to my website from a site that does not have RSS, if it has video support the language does not matter
Hello,
Yes, this should be able to be done using Crawlomatic, please check it here: https://codecanyon.net/item/crawlomatic-multisite-scraper-post-generator-plugin-for-wordpress/20476010
Regards.
hello, is it possible to make every article in the feed be included in an <item>? now if I choose to make 10 articles in the feed, all are included in the same <item>
Hello,
Thank you for contacting me.
Yes, the articles can be included separately in an <item> tag each.
Please check these tutorial videos for info on how to set up the plugin, here: https://www.youtube.com/watch?v=gsskO4bn6xw&list=PLEiGTaa0iBIhcqmfD8bXRqr93N5Hoj-zf&index=1
Regards, Szabi – CodeRevolution.
Please tell me that, If I want articles to come in a particular category that is set in my website, can I do that and where is this option. For eg. I want health articles to be copied in my health category of a website.
Hello,
This plugin creates RSS feeds, does not scrape articles to your site.
For a plugin which scrapes websites (and also sets categories to them on your site), please check Crawlomatic: https://codecanyon.net/item/crawlomatic-multisite-scraper-post-generator-plugin-for-wordpress/20476010
Regards, Szabi – CodeRevolution.
hi iam facing error like Yalow point
https://drive.google.com/file/d/1aHty7EOXCRrOLG9onbDLkEt8i176_-ZM/view?usp=sharingFailed to crawl page for post links. Please check the ‘Seed Page Crawling Query String’ settings field in importing rule settings. Seed page will be displayed now.
Hello,
Thank you for your purchase.
Please send me temporary admin login credentials to your site and i help set up the plugin. My email is kisded@yahoo.com
Regards, Szabi – CodeRevolution.
Hi please check your mail
hi aim paling to buy your puling-in but im chucking your demo i generate rss feed but if i open in any other website it is showing error
link http://143.198.112.144/demo3ebe8592/?feed=suvarna%20nuwsi give this rss feeds for another websites it is showing error This feed does not validate
Hello,
Thank you for contacting me.
For which website did you try to give the feed and how does it show the error. Please provide some screenshots so I can get a better understanding of this.
Regards, Szabi – CodeRevolution.
Can images from a website be included in the feed? Can you also choose which categories to import from a website into your website’s feed?
Hello,
Thank you for contacting me.
Yes, based on the page selector you use, the plugin will be able to add also the images in the created rss feed contents.
Regarding categories, this is possible only if you scrape a page which lists posts only from a specific category. In this case, categoey specific feeds will be created.
Regards, Szabi – CodeRevolution
Здравствуйте, почему сайт https://www.nn.ru/text/gorod/ не получается импортировать? Выдает желтый ромбик, пробую на демо
Привет,
Пожалуйста, используйте следующие настройки в плагине:
Do Not Scrape Start URL: checked
Seed Page Crawling Query Type: Class
Seed Page Crawling Query String: central-column
Content Query Type XPath
Content Query String //*[@itemprop=’articleBody’]
С уважением, Саби – CodeRevolution.
Спасибо, все получилось! А можно сделать чтобы не только заголовок и картинка публиковалась, а еще и сам контент?
У меня с помощью вышеуказанных настроек контент поста также добавляется в RSS-ленту:
<content:encoded><![CDATA[<div page-url="" itemprop="articleBody" data-io-article-url="" data-test="app-article-content"><figure itemscope="itemscope" itemtype="http://schema.org/ImageObject"><div data-hyb-ssp-in-image-overlay="61655ea67bc72f91a887cf06"><picture><source media="(max-width: 375px)" type="image/webp"><source media="(max-width: 599px)" type="image/webp"><source media="(max-width: 899px)" type="image/webp"><source media="(max-width: 1279px)" type="image/webp"><source media type="image/webp"><img src="https://cdn.iportal.ru/preview/news/articles/9e26b252b58c10cd0856dfaf66b5db3e619422f9_2560_1707_c.jpg" alt="" loading="eager" fetchpriority="high" decoding="auto" width="100%" /></picture></div><figcaption><div><p itemprop="author" itemscope="itemscope" itemtype="http://schema.org/Person">Фото: <span itemprop="name">Наталья Бурухина</span></p><div><p><svg fill="#77808c" width="20" height="15" viewBox="0 0 20 14" stroke-width="1"><path d="M11.6667 11.375L20 5.616L11.6667 0V2.47162C11.6667 2.47162 1.985 4.57031 0 13C4.22667 8.58731 11.6667 8.76038 11.6667 8.76038V11.375Z" transform="translate(0 0.794128)" /></svg>Поделиться</p></div></div></figcaption></figure><div><p><b>В Приокском районе из-за строительства газопровода начали вырубать деревья. В скором времени от деревни Ольгино до площади Жукова начнут прокладывать трубы. Местные переживают, что для этого придется спилить несколько сотен деревьев в сквере на Гагарина. Нижегородцы стали добиваться пересмотра проекта, а когда накануне увидели спиленные стволы, стали массово жаловаться главе Приокского района. Михаил Шатилов пояснил, что решения по деревьям на Гагарина пока не принято и сейчас работы ведутся лишь около деревни Ольгино.</b><br /></p></div><div><p>Местные уже больше месяца стараются привлечь внимание к проблеме, ведь из-за строительства газопровода на проспекте Гагарина могут спилить более 300 деревьев. Нижегородцы создали петицию в защиту растений, которую <a href="http://www.nn.ru/text/gorod/2023/05/25/72336962/">подписали</a> больше 1500 человек. Также <a href="http://www.nn.ru/text/gorod/2023/05/30/72350909/">сообщили</a> о ситуации с вырубкой деревьев в федеральный СК. Сам глава Приокского района Михаил Шатилов тоже принимает активное участие в этой истории и на своей странице в соцсетях писал о том, что делает всё возможное, чтобы сохранить большую часть деревьев.<br /></p></div><div><p>При этом накануне нижегородцы <a href="http://www.nn.ru/text/gorod/2023/07/18/72506684/">заметили спиленные деревья</a> около деревни Ольгино и возмутились, что обещанного разговора с ними так и не состоялось.<br /></p><p>Глава Приокского района Михаил Шатилов ответил, что сейчас работы ведутся с арзамасской стороны по направлению к деревне Ольгино. И решения по прокладке газопровода в Щербинках, где местные опасаются за вырубку деревьев, пока нет.<br /></p><p>— Поймите, развитие города должно быть. Город может сейчас развиваться только в нашу сторону, мы должна начать там строить новые дома, переселять в новые квартиры детей-сирот и расселять ветхий фонд, должны также строить новые детсады и школы, — пояснил Шатилов.<br /></p></div><div><p>Он также отметил, что на территории Приокского района нет ни одной больницы и строить ее в принципе негде. Поэтому медучреждение планируется возвести в Новинках, куда и будет прокладываться газопровод.</p></div><div><p>Михаил Шатилов также добавил, что в районе довольно много предприятий, где могут работать молодые специалисты, для них должно появляться новое жилье.<br /></p></div><div><p>— Давайте наберемся терпения. Как появится решение по Щербинкам, мы сразу выйдем и всё сразу посмотрим. От вас никто не бегает, не скрывается. И ваш вопрос был по Щербинкам, а в данный момент получается, что вы выступаете против строительства газопровода, против развития города, новых инфраструктур, домов, больниц, школ и детских садов, — заключил Шатилов.<br /></p></div><div><p>Ранее мы рассказывали, что жители домов на улице Зайцева в Сормове узнали, что рядом с лесом, где они обычно гуляют и кормят белок, <a href="http://www.nn.ru/text/realty/2023/06/16/72407384/">планируют построить многоэтажку</a>. Теперь сормовичи переживают, что в этом месте вырубят деревья, а лес отдадут под застройку. При этом в региональном Минграде отвечают, что возводить здание будут только на участке, который под это был выделен.<br /></p></div></div>]]></content:encoded>
У меня почему комментарии вместо контента добавляются скриншот- https://prnt.sc/4nr2oFtxK7Dz
Пришлите мне временные учетные данные администратора для входа на ваш сайт, и я проверю это. Мой е-маил: kisded@yahoo.com С уважением.
Hi is google trends rss still working ? and i want to try the plugin the site says Bandwidth Limit Exceeded
Hello,
Thank you for letting me know of the issue with the website, please try the plugin’s demo here: http://143.198.112.144/custom-curated-rss-feeds-demo/
I am working with my hosting provider on a fix right now.
Regards, Szabi – CodeRevolution.
Will this work with any Amazon URL like daily deals, gold box, or product search results URLs? And if so, does it comply with Amazon TOS? Thanks
Hello,
Thank you for contacting me.
To create RSS feeds for Amazon, you will need to have Puppeteer installed on your site, for it to be able to render the products from Amazon and add them to the created RSS feeds. Please check this tutorial video for info on this: https://www.youtube.com/watch?v=pRUDcSOe724
Regrading Amazon TOS, please contact Amazon support and ask them if creating custom RSS feeds from their products will comply with their TOS, as they are the best to answer this question with precise info.
Regards, Szabi – CodeRevolution.
Is it possible to generate twitter and facebook RSS as well? What should I do?
Can all social media create RSS?
Hello,
Thank you for contacting me.
For social media scraping, I recommend the specialized plugins I created, for each social network. These will create WordPress posts on your site, not RSS feeds. However, if you need also RSS feeds, you can easily create also feeds from the created posts using RSS feed creator plugins, like this one: https://codecanyon.net/item/echo-rss-feed-post-generator-plugin-for-wordpress/19486974
Please check the social media scraper plugins below:
Regards, Szabi – CodeRevolution.
this plugin will read comments ?
Hello,
Thank you for contacting me.
No, this plugin will not post comments, it will create RSS feeds from scraped websites.
To post comments on other sites, please check this other plugin I created: https://codecanyon.net/item/ucomment-wp-comment-bot-plugin-for-wordpress/22750286
Regards, Szabi – CodeRevolution.
hi, is it possible to create rss from public facebook pages and groups? thanks
Hello,
Thank you for contacting me.
To create an RSS feed from public Facebook groups or pages, I recommend using the F-omatic plugin to import the Facebook posts to your site: https://codecanyon.net/item/fbomatic-automatic-post-generator-and-facebook-auto-poster-plugin-for-wordpress/19528972
Combined with the Echo RSS plugin which will create the RSS feed from the imported posts: https://codecanyon.net/item/echo-rss-feed-post-generator-plugin-for-wordpress/19486974
Regards, Szabi – CodeRevolution.
does this upload to custom types?
Hello,
Thank you for contacting me.
This plugin will create custom RSS feeds for your site, based on websites you scrape.
To make it import the articles from the created RSS feeds to your site, I recommend you check also the Echo RSS plugin, which is able to import the posts also as custom post types: https://codecanyon.net/item/echo-rss-feed-post-generator-plugin-for-wordpress/19486974
Regards, Szabi – CodeRevolution.
tried and not importing :(((
Please send me the demo URL where you tried the plugin and I check on this.
Regards.
i need the spam removed please on add a plugin page. i want to see plugin results. not your products
Hello,
Thank you for pointing this out. I updated the plugin to v1.1.2.1, added the ability to disable the backend content generated by the plugin. To do this, please check the ‘Disable Additional Back-End Content’ checkbox from the plugin’s ‘Main Settings’ menu.
Regards, Szabi – CodeRevolution.
i dont think i asked officially. how does it go to next pages? do i need to make rules for next? also the plugin takes up server memory or something
Hello,
Please check this video for the paging part (video applies also for URL to RSS plugin): https://www.youtube.com/watch?v=WfT5R5Oi8RU
Regards, Szabi – CodeRevolution.
Hey! First of all, sorry for my English, I use a translator. I’m not a buyer yet, but I’ve been researching your plugin for a few days now and have also looked at almost everything you need on your YouTube channel. The plugin is complicated, but I was able to figure it out. I think the plugin is perfect, it does everything I need except for one thing.
I can’t extract “href” attribute from “a” links inside article content.
The site consists of posts on a specific collection. Each article has a link to the collection’s website, twitter, and discord. I want to extract these links, but it doesn’t work.
I created a xpath shortcode:
twitter => xpath @@ /html/body/div2/section/div/div/div/div3/div/nav/ul/li3/a
it doesn’t work
Then I found on the Internet what needs to be added @href
twitter => xpath @@ /html/body/div2/section/div/div/div/div3/div/nav/ul/li3/a/@href
but that doesn’t work either.
Here is a link to the Rss I created.
http://143.198.112.144/demob11b229b/?feed=feed622343b7a0dd6Everything works, except for the problem that I described above.
If this is not supported by the plugin, can you add this capability?
If this is something I don’t understand, please help. If this is resolved, I will immediately buy this wonderful plugin.
And yet, I noticed that even when setting %item_pub_date % in the generated rss feed, the current date is displayed. This is minor, but I would also like to know the reason for this. Thanks.
I wrote to you in the comments under your YouTube video, but perhaps you did not notice it.
Hello,
Sorry for not responding in YouTube comments, they have a string spam filtering, your message did not appear to me over there.
I checked the demo you created and I saw that the easiest way to parse the URLs from the page is to use Regex expressions.
I wrote below the expressions that are needed to match the links you need:
‘Custom Shortcode Creator’:
chain => class @@ text-capitalize
total => xpath @@ //*[@id="single-home"]/div/div/div[4]/header/div[2]/h5/text()
price => xpath @@ //*[@id="single-home"]/div/div/div[2]/header/div[2]/h5/text()
date => xpath @@ //*[@id="single-home"]/div/div/div[5]/header/div[2]/h5
website => regex @@ #<a href="([^">]*?)>[\s\n]*?<span>]*?)><i>]*?)><\/i><\/span> <span>]*?)><strong>Website<\/strong>#i
discord => regex @@ #<a href="([^">]*?)>[\s\n]*?<span>]*?)><i>]*?)><\/i><\/span> <span>]*?)><strong>Discord<\/strong>#i
twitter => regex @@ #<a href="([^">]*?)>[\s\n]*?<span>]*?)><i>]*?)><\/i><\/span> <span>]*?)><strong>Twitter<\/strong>#i
</strong></span></i></span></a></strong></span></i></span></a></strong></span></i></span></a>
Here is a Google Docs link in case Envato edits the above text automatically: https://docs.google.com/document/d/1uj-mqb08iZT3PlCi-ELmsK5OmOuYl0X3hTrNbFdm4NI/edit?usp=sharing
Result:
http://143.198.112.144/demob11b229b/?feed=regexparsingYou can test and create more Regex expressions here: https://regexr.com/
I hope this helps.
Regards, Szabi – CodeRevolution.
Hey! It works. Thanks.
But if the site changes or I want to fetch data from another site, I will need to know the regex. And I don’t understand regex at all, and I don’t have time to study either.
My question is, do you ever plan to add support for @href to the xpath way?
Hey, it turns out you have a Crawlomatic. At first I thought to use a bunch of url to rss + echo. I just noticed that you have the Crawlomatic plugin. Can he replace these two plugins for me? Does Crawlomatic have @href support?
Hello,
Yes, sure, if you don’t plan to use the RSS feeds anywhere else, Crawlomatic can replace the 2 plugins and scrape website and create posts directly from them.
Regarding selectors, I checked again on this and @href is working also in the plugin, however, please note that the HTML of the page is modified after page load using JavaScript code, so the XPATH selector you copy from Chrome is not applied also to the initial HTML code of the page – this is why the selection was not working.
Please check modified XPath, to match the original HTML of the page (this will match the Website URL):
//*[@id="wilcity-single-listing-content"]/div/div/div[2]/div/nav/ul/li[1]/a/@href
Regards.
what is a yellow diamond? cause i try to ban a word and i get that. if i remove the banned word it works fine
The yellow diamond means that no results were able to be scraped, because the banned word was found and articles were skipped.
Regards, Szabi – CodeRevolution.
can i strip domain names in the title?
Hello,
Currently removing domain names from the title is not directly possible.
However, you can set up the plugin so it extracts the title of the posts without also the domain name, this might be able to be done using the Regex feature of the extractor.
Regards, Szabi – CodeRevolution.
