Please, help me on this topic:
I have some problems with proxy. I tried about 30 different HTTP proxies and none of them are worked. Please, give an example with working proxy.
I tried it in my project and in your demo. In the first case it doesn’t make any effect, the IP is the same. In the second case, the page starts to load, but never stops (actually it stops, after 5-10 mins of waiting and throw this err http://snag.gy/0jSNy.jpg)
Hello,Thanks for your message. We also received your email message. The proxy feature should work just fine, we will come back with an email message soon as response to your request.Cheers!
lets say I need to grabe the titles and link from this
can it do this?
Hello and tank you for getting in touch,It should work if you use a simplest url: http://www.google.com/search?q=lebron+james Google is a little picky with grabbers. You can play / test with the grabber here: http://wiseloop.com/demo/php-web-grabber/5.test Cheers!
Question about caching feature.
When the caching time expires and we load the new version of grabbing page, what happens to the old cache?
Hello and thank you for buying,
A cache file is derived considering the grabbed url and the grabbing parameters submitted. The same file is reused if the same url and parameters are used when grabbing. Of course, it is very possible that somebody will never use the same url and parameters and the cache file will just stay there. In order to control this, the developer can decide based on own judgement to use the wlWgUtils::clearCache() method that will clear the entire cache directory. This method will clear entire cache but if a specific logic to handle cache is needed, the developer can use wlWgUtils::getCacheDir() in combination with his own algorithm to implement the cache handling.Cheers!
I mean, what happens when CACHE_TIME_1_WEEK expires? The old cache of the same page will be deleted or we will have 2 cached versions?
When the one week expires, then the same cache file will be reused. You will never have more cache files for an url and a set of grabbing parameters.Cheers!
What’s new in the last update please? Thx
Here are the news:
- added wlWgContentProcessor class that allows grabbing and parsing custom content;
- documentation update;
- FAQ section for the documentation
For more information please check http://wiseloop.com/changelog/php-web-grabber or the included documentation.
First of all, I want to say a BIG THANK YOU for adding the post curl class. I made myself learn more about PHP tonight (took one energy drink and 5 hours) so I could finally use this software. I’ve always known it was super powerful but I had to learn about multi-dimensional arrays and PHP classes. Your updated documentation, demos and FAQ helped tremendously.
I normally build scrapers with python or curl but this script allowed me to avoid python completely and make my current curl grabbers extremely more powerful.
$databasefield1 = $result;
$databasefield2 = $result;
$databasefield5 = $result;
// one database row ends here.
Please bless me with the answer mighty one.
Hello and thank you for buying and for your very kind feedback,As far as I understood your question, the answer is pretty simple: count() function. Please have a look here: http://php.net/manual/en/function.count.php Hope it helps.
Hi, the demo is down.
Hello, We just fixed it. Thank you!
Hello, before buy I want to know something. I can put what I grab from websites in a database and then display into my website? Thanks!
Hello and thank you for getting in touch,Yes you can, the grabbing engine is “transparent” enough and give you acces to the grabbed information so that you can do whatever you want with it: dysplay (by default) or even store it into a database. You must realize that the database saving mechanism is not included in within our product as the grabber deals only with grabbing; that small task shoul be carried on by the developer using the grabber engine.Cheers!
Hi man! This script is supported yet?
Hello and thank you for buying,Yes it is still under our care …
The yahoo search result grabbing not working. It showing just errors!!!
Hello and thank you for getting in touch,This is because probably yahoo changed the way its search result are displayed. The yahoo search is there just for demo purposes and it is not the actual product. Thank you for letting us know, we will fix that soon.Cheers!
I have purchased this your php parser, my use case is very simple .. I have to find a text in HTML page source .. Can you please provide some sample ?
Hello and thank you for buying,There are examples in the downloaded package. Also you can find them here (click on view source): http://wiseloop.com/demo/php-web-grabberGood luck!
Hello there i like your crawler i think its maybe something i am looking for. But it would be really helpful if you can answer the following questions.
1. Lets say there are 2 sites. Site A is not mine but site B is.
2. Can this crawler harvest the images + description data from “Site A” lets say they have buy and sell ads. Can that data be harvested from Site A and bring this back to Site B and insert it.
3. Can it take urls of the Site A ads that it harvested so it can check those ads later and if any of the ad is removed on Site A it also removes the ad from Site B which is mine to keep the data fresh?
I also have a developer (who is currently working on other bits of my work) can he further built this bot by adding removing features from it to suit our needs ?
Hello and thank you for getting in touch.2. No. I grabs only html contens and no media files.3. Yes, but you have to do some additional work.Regarding modifying the code of the component you should check the that with envato as they are responsible for the licensing. Cheers!
Hello, this is a great web scrapper. However, I am a bit concerned that it has not been updated in 2 years. Does everything still work? Why has there not been an update in that long? Thank you for answering these questions!
Use, by you or one client, in a single end product which end users are not charged for. The total price includes the item price and a buyer fee.
Use, by you or one client, in a single end product which end users can be charged for. The total price includes the item price and a buyer fee.
View license details
Get it now and save up to $3
Deliver better projects faster. Photos, templates & courses
Unlimited downloads. Only $29/month
Learn almost anything with
Envato Tuts+ for free
9000 free tutorials, 3000 paid courses
Designers matched perfectly to
you on Envato Studio
2000 artists ready to undertake your work