89 comments found.
Hi its possible scrap manga in french language ?
Hello,
Thank you for contacting me.
Currently French language manga cannot be scraped, however, if you have some websites in mind from where you would like to scrape manga, please send me an email to kisded@yahoo.com with the URLs of these sites and I check them.
Regards, Szabi – CodeRevolution.
Hello, I would like to know if there is a way to make a scrapper that obtains the information from any site that is based on Madara theme. I am also interested in a scrapper for Tmofans.com
I tried to send mail but it doesn’t work kissed@yahoo.com
Hello,
Thank you for contacting me.
Creating a general scraper for the Madara theme is harder than it sounds, because of the many different possible ways to set up the site using this theme. You can have image lazy loading on or off, CloudFlare usage on or off, chapter lazy loading on or off and many more similar options which differ from site to site. Because of this, scrapers can be created for specific sites only.
Regarding tmofans, I checked and it is behind CloudFlare. This means that it requires a headless browser to be also installed on your server, which is used by the plugin to prevent getting blocked by their firewall. However, this is also not guaranteeing 100% scraping success rate on sites which use CloudFlare, so selecting a site which is not behind CloudFlare is preferred.
Also, my correct email is kisded@yahoo.com
Regards, Szabi – CodeRevolution.
i try demo, Scrap some manga, test 3 max chapter and run this rule now, working perfectly scrap chapter 1,2 and 3, but i try again run this rule now but Scrap again chapter 1,2 and 3 again, how to fix it so it can get 4,5 and etc demo link http://143.198.112.144/demod210d401
Hello,
Thank you for letting me know of this issue.
I updated the plugin to v1.0.4.1 and fixed the duplicate chapter importing issue, please check in the demo and let me know if it worked now correctly.
Regards, Szabi – CodeRevolution.
Will this plugin work with mangastream theme please reply I will willing to purchase
Or if you can make a scrapper to work for wordpress manga websites
Hello,
Thank you for contacting me.
This plugin will work only on the Madara theme for WordPress sites.
Regards, Szabi – CodeRevolution.
Is this plugin doesn’t work without headless browser?
Hello,
Thank you for contacting me.
The plugin is fully functional also without a headless browser. A headless browser is needed only in the case if you wish to scrape content which is dynamically generated on websites (using JavaScript). A headless browser can render pages and scrape also content which is dynamically generated.
Regards, Szabi – CodeRevolution.
Currently scraping wuxiaworld is the only site which requires the above headless browser. The other sites which are scraped with the plugin are working also without a headless browser.
Regards.
Hello, I tried demo on boxnovel and it worked for boxnovel urls, is there a way we can scrap from lightnovelhaven or other similar websites? Also, is there a limit on how many chapters we can scrap?
Also, is there a way we can select which chapter to be scrapped or latest or oldest ones?
Say if I have scrapped a novel which is still ongoing, can I add latest chapters every day. If so, what settings should I use?
I am on shared hosting and will use only novels(text), do I need dedicated server for this plugin to work?
Thank you
Hello,
Thank you for contacting me.
This plugin does not require dedicated hosting (it will work also on shared hosting) – excepting scraping from wuxiaworld, which requires puppeteer to be installed (or an active subscription to HeadlessBrowserAPI).
The plugin will check and add latest chapters every day (if configured to do so). It will publish chapters in order, starting with the oldest one.
Regarding lightnovelhaven, I can create a custom scraper for you, which will be able to scrape this site also, but it requires a VPS or a dedicated server (because the site is behind CloudFlare) and it requires puppeteer integration to work. If you are interested in this, please contact me at my email kisded@yahoo.com and I will provide details.
Regards, Szabi – CodeRevolution.
Hello,
Thank you for notifying me of this issue, I fixed it in the v1.0.3.3 update for the plugin, it will work correctly now.
Regards, Szabi – CodeRevolution.
do it upload the anime iat the server or do it emb it
Hello,
Thank you for your question.
Both are supported, you can copy the images locally to server or upload them to cloud services and embed them.
Regards, Szabi – CodeRevolution.
With Novel the Chapter names are like: Chapter 1- Novel name- Chapter 1, Is it possible to set it to like “Chapter 1” this?
Hello,
Thank you for your question.
Currently this is not possible, however, I noted your suggestion, will add this feature in future plugin updates.
Regards, Szabi – CodeRevolution.
By which method I can get faster reply, Email, Support ticket or this comment section?
Hello,
Fastest is my email kisded@yahoo.com. Please note that in my time zone (GMT+3) it is passed work hours now and probably I will respond tomorrow to your email.
Regards.
Thanks. Your response time is already very fast. I just wanted to know it for urgent matters.
Sure. I am glad to assist.
Regards.
Is there a guide about how to Install Puppeter on AWS servers?
Hello,
Currently I have a video guide for Digital Ocean servers, please check it here: https://www.youtube.com/watch?v=KNOIJA4pTQo
I noted your idea, will work on a tutorial video also for AWS.
Until then, please check this tutorial I found: https://dev.to/chis0m/installing-puppeteer-on-an-ubuntu-aws-ec2-instance-5o7
Regards.
How to fresh install the Plugin? (Reinstalled but many data like the rules and license data still remained).
Hello, you can revoke licensing of the plugin by using the ‘Revoke License’ button from the plugin’s ‘Main Settings’ menu.
Rules at the moment can be deleted only manually, I noted this and will make a cehckbox in future updates, when checked, the plugin will delete its settings data at uninstall.
Regards.
this plugin requires madara theme, but i cant find it on codecanyon
Hello,
I contacted the guys who created the Madara theme and they told me that Envato has some issues with the theme, which they are currently trying to resolve. They try to republish the theme on Envato and if not possible, they will publish it on their private marketplace. They stated that this issue should be solved in a couple of days.
Regards, Szabi – CodeRevolution.
hi, please take a look to other manga theme option like themesia.com and eastheme.com, they have a great manga theme with cheapest price,,,
Sure, noted, I am looking for alternatives also.
Regards.
today is a week after I bought this script, and there has been no update from wpstylish as a madara theme developer,
how about you?
Hello,
No update from them yet. Please contact me by my email kisded@yahoo.com and I will help.
Regards.
How do you plan to continue supporting this when the theme no longer available for sale on themeforest, even buying it from somewhere else the demo content wont work so the theme is basically useless now
Hello,
I contacted the guys who created the Madara theme and they told me that Envato has some issues with the theme, which they are currently trying to resolve. They try to republish the theme on Envato and if not possible, they will publish it on their private marketplace. They stated that this issue should be solved in a couple of days.
Regards, Szabi – CodeRevolution.
That would be cool, can’t wait for the republish
I also hope they will solve this issue soon.
Hello,
Please send me the demo URL you created and I check it In the screenshot you sent it is not visible.
Regards, Szabi – CodeRevolution.
Hello,
Thank you for pointing out this issue, I updated the plugin to v1.0.3.1, now its working correctly, please check.
Regards.
Hello,
Please send me the demo URL you created and I check it.
Regards, Szabi – CodeRevolution.
Can you make it a custom url?
Hello,
Thank you for contacting me.
Sure, i can create a custom scraper for you, for details, please contact me at my email kisded@yahoo.com
Regards, Szabi – CodeRevolution.
works now with phantomjs? If I have it installed on my server?
Hello,
I recommend you install Puppeteer on your server, because it is working better, PhantomJS is no longer updated for a period of time now.
Regards.
Hi do we need to pay to use the headlessbrowserapi? I do not have the budget for this and I am also using shared hosting. Is there any solution? I still cannot scrape any content even try to use cloudflare
I am currently working on updating the plugin to fetch web novels also from alternative sources.
This is the only solution which can help you, because wuxiaworld currently can be scraped only using a headless browser.
Regards, Szabi – CodeRevolution.
hi is there any option instead of puppeteer ? cause im using shared hosting so i can’t install it in the shared server
Hello,
Yes, there is an alternative for local puppeteer from your server: https://headlessbrowserapi.com/ – it is integrated in the plugin and will use cloud puppeteer instances to render the content of scraped pages.
Regards, Szabi – CodeRevolution.
i try the demo using Puppeteer is not working https://ibb.co/wJCYR5w
Hello,
Sorry for this, but currently Puppeteer is not supported in the demo of the plugin.
Regards, Szabi – CodeRevolution.
i will wait for the update so I can buy it
, hope you can add scraping from 2 or 3 sources instead of wuxiaworld
Sure, if you have ideas of source sites, let me know.
Regards.
Noted, thank you.
hello, any update ?
Hello,
Sorry, but I am still working on the update, I estimate that it will be ready by the end of the next week. I will release the update as soon as it is finished.
Regards, Szabi – CodeRevolution.
hello @CodeRevolution, any update ?
Yes, I just finished work on the update, it adds support for scraping a new site for light novels. Please check update v1.0.3
Regards.
I was about to buy the product, until I noticed this error.
It does not copy the comic section, I am very interested in that section as well as others will also be interested.
I mean don’t copy this.
https://wuxiaworld.site/novel/only-i-level-up-comics/ https://wuxiaworld.site/tag/webcomic/Make me copy this part as well and buy it immediately, I’m sure other users will also be interested and will buy it quickly.
I know that fanfox exists, but this one is more dedicated to manwhas.
I will be attentive to any update to buy it immediately.
Hello,
Thank you for the heads up on this, I was not aware that they had also a comic section.
I noted your idea, will check on this an try to add this feature for future plugin updates.
Regards, Szabi – CodeRevolution.
What a shame, I want to buy the complement today, well I will have to wait until I update and can copy those comics.
Do not forget to comment here if you update it, to be able to buy it immediately. If you update it today, I buy it today.
Sorry but implementing this is not possible today, I am working on a different project now. I noted your idea.
Manga Chapters names are are all Deferent
Hello,
Thank you for contacting me.
I am not sure what you mean, can you send me an example chapter URL, so I can check on this?
Thank you.
Regards, Szabi – CodeRevolution.
www.readwn.com Also this is a good site for novels
Hello,
Thank you for reporting this issue with chapter names, it was fixed in update version 1.0.2.1
Regarding the site you suggested, I noted it, thank you. Will check on it.
Regards, Szabi – CodeRevolution.
Hello,
The links you sent don’t exist any more, please check.
Regards.
Here I see chapter titles like:
Knight and Confession – A Story About Treating a Female Knight Who Has Never Been Treated as a Woman as a Woman Knight and Confession
Well, currently the parser removes the “Chapter…” part if it finds it, and leaves only the textual title of the chapter. I will rework this process in the next update.
Fixed in update v1.0.2.2
Regards.
Sorry, I will buy it when it is little more polished. At this moment the Novel Scraping is not working so it is little expensive for only the manga scraping in comparision to other options.
Hello,
Because of recent security measures from wuxiaworld’s part, novel scraping is possible only if you have puppeteer installed on your site and use the plugin together with it to scrape content.
I will be working on updates for the plugin, to make it work also with other alternative web novel sites. If you have some in mind, let me know.
Regards, Szabi – CodeRevolution.
hi i am very interested with this, had try the demo for novel but it failed to scrape anything http://143.198.112.144/demo44c7cb53/manga/
Hello,
Unfortunately the source website from where the plugin is scraping web novels enabled increased security measures, now they are using CloudFlare to protect their site. Scraping will continue to work if you have puppeteer installed on your site.
I will be looking for alternatives to solve this and make an update for the plugin.
If you have other similar websites with web novels in your mind, which could be scraped, let me know.
Regards, Szabi – CodeRevolution.
that some of good source for novel
Thank you, I check them.
wuxiaworld.co is app base novel site so dont have many protection
Looking good, will try to adapt the plugin for wuxiaworld.net first, if it fails, I will try to go with wuxiaworld.co
What is wrong with the latest update? It continues to show these error when crawling novels… https://i.imgur.com/N7UX6mi.jpg
Hello,
Please send me the URL of the demo where you tested the plugin and I check it.
Regards, Szabi – CodeRevolution.