WiseLoop

WiseLoop supports this item

Supported

110 comments found.

Please, help me on this topic:

I have some problems with proxy. I tried about 30 different HTTP proxies and none of them are worked. Please, give an example with working proxy.

I tried it in my project and in your demo. In the first case it doesn’t make any effect, the IP is the same. In the second case, the page starts to load, but never stops (actually it stops, after 5-10 mins of waiting and throw this err http://snag.gy/0jSNy.jpg)

Hello,
Thanks for your message. We also received your email message. The proxy feature should work just fine, we will come back with an email message soon as response to your request.
Cheers!

Hello and tank you for getting in touch,
It should work if you use a simplest url: http://www.google.com/search?q=lebron+james
Google is a little picky with grabbers. You can play / test with the grabber here: http://wiseloop.com/demo/php-web-grabber/5.test
Cheers!

Question about caching feature. When the caching time expires and we load the new version of grabbing page, what happens to the old cache?

Hello and thank you for buying,
A cache file is derived considering the grabbed url and the grabbing parameters submitted. The same file is reused if the same url and parameters are used when grabbing. Of course, it is very possible that somebody will never use the same url and parameters and the cache file will just stay there. In order to control this, the developer can decide based on own judgement to use the wlWgUtils::clearCache() method that will clear the entire cache directory. This method will clear entire cache but if a specific logic to handle cache is needed, the developer can use wlWgUtils::getCacheDir() in combination with his own algorithm to implement the cache handling.
Cheers!

I mean, what happens when CACHE_TIME_1_WEEK expires? The old cache of the same page will be deleted or we will have 2 cached versions?

When the one week expires, then the same cache file will be reused. You will never have more cache files for an url and a set of grabbing parameters.
Cheers!

What’s new in the last update please? Thx

Hello,
Here are the news:
- added wlWgContentProcessor class that allows grabbing and parsing custom content;
- documentation update;
- FAQ section for the documentation
For more information please check http://wiseloop.com/changelog/php-web-grabber or the included documentation.

Cheers!

First of all, I want to say a BIG THANK YOU for adding the post curl class. I made myself learn more about PHP tonight (took one energy drink and 5 hours) so I could finally use this software. I’ve always known it was super powerful but I had to learn about multi-dimensional arrays and PHP classes. Your updated documentation, demos and FAQ helped tremendously.

I normally build scrapers with python or curl but this script allowed me to avoid python completely and make my current curl grabbers extremely more powerful.

As far as inserting into databases. I almost got it! I’m currently grabbing from ‘’ fields and I am at this point: $databasefield1 = $result[0][0]; $databasefield2 = $result[0][1]; ... $databasefield5 = $result[0][4]; // one database row ends here. I need to keep grabbing in sets of 5 until I reach the end of the array. Only problem is that I never know how big the array will be!

Please bless me with the answer mighty one.

Hello and thank you for buying and for your very kind feedback,
As far as I understood your question, the answer is pretty simple: count() function. Please have a look here: http://php.net/manual/en/function.count.php
Hope it helps.
Cheers!

Hi, the demo is down.

Hello,
We just fixed it.
Thank you! :)

Hello, before buy I want to know something. I can put what I grab from websites in a database and then display into my website? Thanks!

Hello and thank you for getting in touch,
Yes you can, the grabbing engine is “transparent” enough and give you acces to the grabbed information so that you can do whatever you want with it: dysplay (by default) or even store it into a database. You must realize that the database saving mechanism is not included in within our product as the grabber deals only with grabbing; that small task shoul be carried on by the developer using the grabber engine.
Cheers!

Hi man! This script is supported yet?

Hello and thank you for buying,
Yes it is still under our care … :)

The yahoo search result grabbing not working. It showing just errors!!!

Hello and thank you for getting in touch,
This is because probably yahoo changed the way its search result are displayed. The yahoo search is there just for demo purposes and it is not the actual product. Thank you for letting us know, we will fix that soon.
Cheers!

I have purchased this your php parser, my use case is very simple .. I have to find a text in HTML page source .. Can you please provide some sample ?

Hello and thank you for buying,
There are examples in the downloaded package. Also you can find them here (click on view source): http://wiseloop.com/demo/php-web-grabber
Good luck!

by
by
by
by
by
by