UniqWorks

UniqWorks supports this item

Supported

35 comments found.

Hi, is it possible to scrape details from a website with login and password, i do have the login details. Thanks in advance

Hi there!

Thank you for using our plugin! Unfortunatly that’s not possible at the moment.

Warning: curl_setopt() [function.curl-setopt]: CURLOPT_FOLLOWLOCATION cannot be activated when safe_mode is enabled or an open_basedir is set in /home/maxora/gayone.org/wp-content/plugins/wp-web-grabber/wp-web-grabber.php on line 272

Warning: curl_setopt() [function.curl-setopt]: CURLOPT_FOLLOWLOCATION cannot be activated when safe_mode is enabled or an open_basedir is set in /home/maxora/gayone.org/wp-content/plugins/wp-web-grabber/wp-web-grabber.php on line 272

i i’m not a php programmer, i don’t know how to do. i need your help just to hide that error ( with css ) or remove.

OK, try this:

Go to the plugin folder and open the file “wp-web-grabber.php” in your text editor. Then add the following code at line 11:

error_reporting(E_ALL ^ E_WARNING);

Try that and let me know if you still get the error.

thanks a lot, its working.

hginli

hginli Purchased

Hello

i scraping a site it html have live link

i can Disable it live link at my site? i want change it to dead link

thank you very much

Hi there!

The easiest way to do that is using CSS to change the appearance of links, so they look like normal text. Try the following settings:

CSS Class: dead-link

Custom CSS: .dead-link a {text-decoration:none; color:black; cursor:default; border:0}

Note that this might be bad for SEO. A safer solution is using JavaScript to completely replace the links.

Can you scrape linked listing? If they page im crawling has links to other pages with full descriptions.

Hi,

This plugin scrapes only the HTML in the given webpage. It does not follow links on the page to scrape them. If you need to scrape the HTML of the links, you’ll have to do it separately.

suge1w

suge1w Purchased

Hi

How do I change / set the crawling speed? I want to change to once a week.

Hi!

To set the crawl time to once a week enter 10080 in the “cache time” field.

suge1w

suge1w Purchased

Thanks for the reply! Where is the “cache time” field?

suge1w

suge1w Purchased

Nevermind, found the field!

How is this compatible with WooCommerce? I ask because I want to scrape product profiles from a site and display them on mine. I would love it if the products scraped would populate WooCommerce product profiles.

You can use this plugin in places that support shortcodes. This means that you can use it in WooCommerce product description but not in the price or weight field.

Hi before I purchased, can I ask whether the hyperlinked text that i scrape from the news site can be linked to the news site once user clicked?

And can I add the source together with the scraped news title?

Hi, you can’t change the hyperlink using this plugin. You’ll have to use JavaScript code for that. But the plugin can automatically convert relative links to absolute links for you.

WebGrabber uses shortcodes to insert the scraped content into your page. That means you can add any source/link after or before the scraped content in the text editor.

Hi i would like to scrape the news title with outbound link to the external news site. Can you help to customise it? How much does it cost?

Yes I can help you :) Please send me more detail about the customizations you need to my email address: info.uniqworks@gmail.com

How would this scrape directory lists on several pages in same format, like business’s name, phone, addres, email, etc? Who the hell knows what an css selector is and even what code to use? Not eveyone here is a coder!

Hello,

i want to build a form using gravity forms, in that form there will be a field for entering a website.

the form would have other fields too, can i use your plugin to hook into the gravity forms fields and populate them dynamically based on the output from the parsed content from the plugin?

please if there’s any way to explain more, please tell me how to contact your directly :)

Hi,

You can contact me through the contact form in my profile. You can use WebGrabber anywhere that the WordPress text editor is accessible. If the gravity forms has a field that supports text editing tools, then you can use WebGrabber to grab data and display it in that field.

I hope that answers your question. :)

Great plugin, 5 stars! One question, how can you make links within scraped content open in new tab?

Thanks! :) You can rate the plugin here: http://codecanyon.net/downloads

I’ll add an option for that in the next update. For now, you can use JavaScript to make the links open in new tab. Follow these steps:

1- install the embed-code plugin:

https://en-gb.wordpress.org/plugins/embed-code/

2- Add the following code in the Footer Code field:

<script>
var linkList = document.querySelectorAll('.css-selector a');
for(var i in linkList){
    linkList[i].setAttribute('target', '_blank');
}
</script>
3- replace ”.css-selector” in the code with your own CSS selector.

I will try this later today, thank you for getting back to me so promptly.

Is there any way to limit the amount of scraped content displayed? I would like to display only the last five records of a specific css selector instead of all records

You could use the nth-child selector. For example, this code retrieves the 3rd and 4th paragraphs of a page:

p:nth-child(3), p:nth-child(4)

Is this plugin compatible with WP Job Manager? https://wpjobmanager.com/

Unfortunately no :(

It works where ever the editor is? For example would it work on: http://www.wpallimport.com/

Yes it works in most places that the default WordPress text editor is accessible. I haven’t tested it on wpallimport though.

Hi , Can i use your plugin in custom field values? The custom fields will be inturn embeded into the templates which shows the ouput.Possible?

Yes, the plugin works in custom fields as well.

Hi.

I would like to pull recursive (recurring) content from TripAdvisor which is the reviews. There are many reviews on the website so I want to be able to pull the content and display it like comments. Is this possible?

Thanks!

Hi there!

You can scrape one group of comments at a time. If there are multiple list of comments, you need to create a shortcode for each list.

Hi

works fine at all, but there are some stores the plugin didn’t function with them, any idea ?

Hi Sanayar!

Some sites use JavaScript to dynamically load content. There are also sites that block scrapers/robots to prevent them from accessing their content. Unfortunately, WebGrabber cannot scrape these sites.

by
by
by
by
by
by