Web Crawler and Scraper

Performs parallel web crawling and web scraping. It is designed to crawl, parse and store web pages to produce data that can be directly used for analysis application. For details see Khalil and Fakir (2017) .


Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.


0.1.9-1 by Salim Khalil, 3 years ago


Report a bug at https://github.com/salimk/Rcrawler/issues

Browse source code at https://github.com/cran/Rcrawler

Authors: Salim Khalil [aut, cre]

Documentation:   PDF Manual  

Task views: Web Technologies and Services

GPL (>= 2) license

Imports httr, xml2, data.table, foreach, doParallel, parallel, selectr, webdriver, callr, jsonlite

See at CRAN