Scraper – Automatic Content Crawler Plugin for WordPress

LIVE PREVIEW DOWNLOAD

Scraper is an automated plugin that copies content material and posts robotically from any web page. With tons of helpful and distinctive options, Scraper WordPress plugin takes content material creating course of to a different stage.

Design your individual scraping methodology with visible editor, Scraper will robotically fetch and publish 7/24 for you with its built-in scheduler.

Scraper - Automatic Content Crawler Plugin for WordPress - 6

Scraper - Automatic Content Crawler Plugin for WordPress - 7

Scraper - Automatic Content Crawler Plugin for WordPress - 8

Scraper - Automatic Content Crawler Plugin for WordPress - 9

Scraper - Automatic Content Crawler Plugin for WordPress - 10

Scraper - Automatic Content Crawler Plugin for WordPress - 11

Tutorials

We’re creating step-by-step tutorials for plugin. Please tell us when you’ve got any questions, we’ll be including all particulars on tutorials.

Product

[+] Creating Products

[+] Special Conditions for Products

Troubleshoot

[+] Troubleshoot : Memory issues on Scraper

[+] Troubleshoot : Start task doesn’t work

[+] Troubleshoot : It clears HTML content after scraping

[+] Checking connectivity to source website

Settings

[+] Plugin Settings

[+] Project Settings : Track Changes

[+] How to setup proxy for scraping process?

[+] Using Cookies

Different

[+] How to create dynamic WordPress shortcode? NEW!

[+] How to hide elements on visual editor?

[+] How to embed any iframe video?

[+] Downloading PDF attachment

[+] Useful Regex Expressions

[+] Uniqueness check or prevent duplicates

Buildings

[+] Custom Fields

[+] Custom Taxonomies

Options

Scrape Any Web site With Xpath and regex strategies, it’s doable to scrape any web site!		Get Attributes Scraper can parse ingredient’s attributes, which means you may get hyperlinks, picture sources, video sources.

Set Characteristic Picture The plugin can extract any picture to set as a featured picture.		Duplicate Title Skip Scraper verifies that there isn’t a earlier publish with the identical title.

Repair Encoding The plugin robotically repair encoding errors and publish it after fixing it.		Language Translation Scraper robotically detects content material and translate it to any language.

		Help Classes You would publish your new content material to any class that you simply’ve created.

Regex (JSON) Parser You would parse an data that comprises JSON objects.		Gallery Pictures Scraper can parse any picture sequence and create gallery with that.

Search & Exchange You would rework your content material with search & substitute characteristic.		Content material Template with Variables You would generate your distinctive content material template with rework characteristic.

WooCommerce Merchandise Creating woocommerce merchandise with Scraper is very easy. Scraper helps all tags of woocommerce.		Math Capabilities You would sum, subtract or divide any quantity with math features. It may be helpful on worth calculations.

Embed Any Publish Extract Youtube, Instagram or Vimeo ID from web site and use it with embed rework.		Schedule Duties With completely different intervals you may schedule your duties.

Publish Replace You would choose a publish to replace with scraping.		Hyperlink Strip You would strip hyperlinks from authentic publish content material.

Proxy Help You would use proxies on scraping.		Cookie Help Scraper helps cookie, you may outline cookie for any process.

Publish Standing You would set your publish standing to draft or publish.		Group Templates There are lots of templates on Scraper’s library. You would allow any of them simply.

F.A.Q.

+ Is there any characteristic to translate content material?

Sure, it interprets any content material with Google Translate API. It helps all languages that supported by Google.

+ Is it doable to set featured picture?

Sure, it’s doable. You would set any picture ingredient as a featured picture.

+ Is it doable to create picture galleries?

Sure, it’s doable. Scraper can detect picture sequences and outline them as gallery. It might additionally downloads picture to your server.

+ Is it doable to create WooCommerce product?

Sure, we assist all WooCommerce product customized fields and publish varieties.

+ Is it doable to replace costs on product?

Sure, with rework perform, you may apply some regex expressions or mathematical features for numbers. With this manner, you may replace numbers with yours or change the values with math features.

+ Is it doable to scrape meta tags?

Sure, that’s doable. You would scrape HTML tags, meta tags, attributes and even JSON elements of web page with visible editor.

+ Is it doable to JSON values on web page?

Sure, that’s doable. You would write your individual regex expression to extract information from JSON content material.

+ Am i able to replace take a look at my process mannequin earlier than i create it?

Sure, in preview outcomes part, you may take a look at your mannequin earlier than you buy or use plugin. It gives similar outcomes with WordPress plugin.

+ Can i take advantage of proxy for my content material?

Sure, you may set proxy IP and port on settings button which is situated beside fetch button.

+ Am i able to scrape all class with subsequent web page?

Sure, setting subsequent web page ingredient is sufficient. It’ll robotically scrape all merchandise or publish objects in a class web page.

+ Am i able to get assist for my process?

Sure, our assist group might be asisting in your process or any concern that you simply expertise on plugin.

+ Am i able to get refund?

Sure, if the plugin just isn’t working as anticipated. Please reachout to make use of by way of support.wpwbots.net earlier than elevating any refund request.

See Plugin’s Documentation

Visit Frequenly Asked Questions

Subsequent Launch

Changelog

04/30/2021 (v2.0.4)

- Bug: Mounted concern whereas including greater than 26 fields.
- Bug: Mounted Scheduled duties get caught in queue
- Bug: Mounted key title for brand spanking new information discipline
- Added Cron URLs that may be run immediately by way of server's Cron Job

12/16/2020 (v2.0.3)

- Bug: Mounted Duplicate Picture obtain
- Bug: Mounted Scheduled duties get caught in queue
- Bug: Mounted XML/RSS feed scrapping
- Characteristic: Added Activity URLs that may be run immediately by way of server's Cron Job
- Characteristic: Added choice to export output to excel immediately with out posting it to WP
- Added: Prepared to make use of templates
- Eliminated Pointless Recordsdata & Folders

05/19/2020 (v2.0.2)

- Bug: Writer not set when posts imported by way of scheduled duties

05/14/2020 (v2.0.1)

- Bug: Mounted Scheduled duties get caught in queue

04/27/2020 (v2.0.0)

     - Introducing Scraper Professional (for ajax scraping)
     - Up to date Documentation hyperlink
     - Characteristic: Added assist for `Alt` & `Title` for featured picture
    - Characteristic: Inexperienced Highlighter for Feed hyperlink selector
        - Bug: Mounted warning points
     - Bug: Mounted Incorrect XML / RSS parsing message
     - Bug: Mounted HTML Supply scrapping concern

10/21/2019 (v1.1.3)

        + Bug Fixes

07/06/2019 (v1.1.1)

        + UI Adjustments
        + Mounted: Scheduled Posts
        + Added: Ajax information parsing
        + Mounted: Parsing XML Feeds
        + Added: Non-english language assist
        + Mounted: Native timezone functionality

03/20/2019 (v1.1)

        + UI revamped, many adjustments throughout the plugin and visible editor
        + Introducing Simplified view in "Scheduled Duties" tab
        + Clone process characteristic launched.

02/10/2019 (v1.0.42)

        + ignore_params database concern has been fastened.

02/07/2019 (v1.0.41) + product attributes concern has been fastened. + Cut up delimiter bug fastened for gallery photos.

01/12/2019 (v1.0.40) + DeepL Translation integration. + Disable URL parameters for URL uniqueness choice. + Set featured picture with publish mother or father ID. + Complete run restrict performance has been added. + Set creator choice has been added. + Set publish slug choice has been added.

12/06/2018 (v1.0.39) + A number of p ingredient concern has been fastened for post_content. + Web page improve caught points has been fastened.

11/27/2018 (v1.0.38) + (Bugfix) Used photos will not be downloaded once more. + Subsequent web page leap and auto-reset features has been improved. + cURL gzip enabled. + WooCommerce product_cat and product_tag points has been fastened.

11/13/2018 (v1.0.37) + Bulk record URL issues has been fastened. + URL path points has been fastened. + Subsequent web page set off features has been up to date. + Gallery choice points has been fastened. + Visible selector has been improved. + Default worth for product attributes has been up to date. + Subsequent web page selector has been improved. + Article content material selector has been improved. + cURL characteristic has been added. + Proxy points has been fastened. + Visible editor zoom concern has been fastened for low resolutions. + product_tag creation concern has been fastened. + Identical variable title concern has been fastened for visible editor.

11/02/2018 (v1.0.36) + URL Path points has been fastened. + Bulk URL record choice added. + Yandex Translation API has been added. + tbody concern has been fastened for Chrome. + Publish codecs has been added on challenge settings. + Ajax request error has been up to date. + Index choice concern has been fastened for advanced tables. + New monitor choice added : no change on publish standing. + Notices faraway from settings space.

10/22/2018 (v1.0.35) + Pagination points has been fastened. + Picture obtain and is required points has been fastened.

10/19/2018 (v1.0.34) + Reminiscence concern has been fastened.

10/19/2018 (v1.0.33) + Aliexpress picture concern has been fastened. + Error show added for timeout and reminiscence points. + Take away ingredient for eradicating popups, preloaders. + "Required" discipline added. It move if discipline is empty. + Particular Situations part added. + Activity restrict concern has been fastened.

10/16/2018 (v1.0.32) + Subsequent web page perform on preview outcomes. + Auto-detection for scraping characteristic has been added. + Utilizing variables as shortcodes on WordPress is feasible now! + Visible editor Scraping base URL drawback fastened. + Pause process concern has been fastened. (take a look at edilecek) + Proxy URL concern on Visible instrument, fastened. + Excluding posts by attributes is feasible now. + Detailed logs for points, issues. + Connection take a look at performance added. + Extract ID, HTML or URL from picture attachment. + Restrict process set off perform. + Subsequent web page URL points has been fastened for location redirections.

10/12/2018 (v1.0.31) + For is a number of discipline, JSON database format added. + Cut up content material by phrases choice added. + File obtain as attachment added. (pdf) + SKU Uniqueness methodology added. + _stock, _manage_stock, _backorders attributes has added. + Monitor adjustments perform has been up to date with uniquness methodology. + Publish title can be utilized on filenames.

10/10/2018 (v1.0.30) + Publish excerpt discipline added, it is also brief product description. + Publish delete points has been fastened. + Publish standing change performance added.

10/09/2018 (v1.0.29) + Proxy points has been fastened on visible editor + Visible editor's native copy is on plugin with newest model. + Lengthy URL points has been fastened. + Publish uniqueness concern has been fastened for publish updates. + Delete publish with supply URL adjustments characteristic added. + Activity course of delay added. + Cease process characteristic changed with pause process. It continues from final index. + Bit.ly decode characteristic added. + A number of customized discipline characteristic added. + Media library attachment drawback fastened for picture objects. + Some UI issues has been fastened.

09/28/2018 (v1.0.28) + Filename template characteristic added for all photos + Strip and obtain photos choice added for content material photos

09/28/2018 (v1.0.27) + Database migration concern has been fastened

09/28/2018 (v1.0.26) + Gallery shortcode choices added + Publish URL and title uniqueness mechanism rewritten + Class creation points has been fastened + Every publish URL shortcode added

09/26/2018 (v1.0.25) + Base URL points for some web pages has been fastened (Aliexpress) + Clear Promoting codes improved

09/25/2018 (v1.0.24) + Customized discipline points has been fastened. + Documentation up to date + Gallery photos and featured photos should not be duplicated

09/24/2018 (v1.0.23) + A number of class choice characteristic added + Filename rework part enabled + Base URL points has been fastened for proxy + Customized taxonomy featured added + Gallery has been fastened for woocommerce merchandise + Cut up perform added for tags (With delimiter) + Google Translate API errors show + Serial selector for class, tags and pictures + Variable renderer minor fixes + Create new class with information discipline + Visible Editor enhancements, UI bugs has been fastened

09/20/2018 (v1.0.22) + Strip just some tags (for promoting codes) + Attributes UX repair + Base URL points has been fastened + Publish dates added for customized discipline

09/20/2018 (v1.0.21) + A number of attributes for Woocommerce merchandise + UTF8 issues fastened for Non-English languages

09/19/2018 (v1.0.20) + Preg match points fastened + Xpath selector enhancements + Auto detection characteristic for serial hyperlinks

09/17/2018 (v1.0.19) + Subsequent web page choice + Design points and enhancements + Outcome preview + Efficiency updates + Customized discipline concern fastened + Numeric features drawback fastened

09/15/2018 (v1.0.18) + 0 byte picture concern fastened + Picture gallery points fastened + Xpath selector fastened and improved + Regex parser methodology modified with /g flag + Discover and substitute methodology improved, it helps a number of discover&substitute + Excluding URLs is feasible with this model + {{source_url}} choice added + PHP errors fastened + 0 byte picture concern fastened

09/07/2018 (v1.0.16) + RSS feed or XML parsing methodology added. + Woocommerce product class concern fastened.

09/05/2018 (v1.0.13) + Picture Gallery Parse + UX Subject : single publish checkbox lock + Strip solely tags + A.I. Spinner Integration Error + Model Parser

09/05/2018 (v1.0.12) + Set off Points Mounted + Extra Templates Added + Featured Picture points fastened + Cross-origin points fastened + Xpath selector improved

08/17/2018 (v1.0.0) + Cron points fastened + Picture obtain characteristic added + JSON Parsing Methodology Added + A.I. Spinner Service Enabled + Translation Service Enabled + First Launch

Notes

On this part, we’ll be serving to you about your issues earlier than you buy.

Your internet hosting or server ought to enable incoming and outgoing community transfers for scraping.
Our assist group can attain process’s content material from service logs if you happen to present us any. This methodology makes simpler assist course of and with this manner our assist group help you shortly on any case.
We’ll be updating plugin for any bug or options that requested by customers. Each replace has been examined by our assist group and softwares.
Plugin is licensed per area. You can purchase licence for every area. You would transfer your licence to a different area.
Scraper doesn’t assist ajax web sites due to technical limitations.
Our plugin makes use of Google Translate official API in contrast to different plugins. So please be sure to have API key on that service earlier than you buy for translation companies. Please additionally word that Google Translate’s Official API is a paid service.
Scraper’s plugin has features that scrapes parts from given URLs. Our visible editor is a cloud based mostly editor that hosted by us on our net service. Plugin doesn’t comprises visible editor’s information in it. It solely will get JSON information that constructed on visible editor.
Since Amazon blocked our servers, the plugin is unable to scrape any product from Amazon. That could be similar for AliExpress and different huge web sites in future. Please ensure that plugin works correctly earlier than buy. You would merely contact with our assist group or remark and ask about assist standing. We’ll gladly take a look at and inform you about adjustments.
You would request refund on any case that you’re not happy on plugin.