Package: sparkwarc 0.1.6

Edgar Ruiz

sparkwarc: Load WARC Files into Apache Spark

Load WARC (Web ARChive) files into Apache Spark using 'sparklyr'. This allows to read files from the Common Crawl project <http://commoncrawl.org/>.

Authors:Javier Luraschi [aut], Yitao Li [aut], Edgar Ruiz [aut, cre]

sparkwarc_0.1.6.tar.gz
sparkwarc_0.1.6.zip(r-4.5)sparkwarc_0.1.6.zip(r-4.4)sparkwarc_0.1.6.zip(r-4.3)
sparkwarc_0.1.6.tgz(r-4.4-x86_64)sparkwarc_0.1.6.tgz(r-4.4-arm64)sparkwarc_0.1.6.tgz(r-4.3-x86_64)sparkwarc_0.1.6.tgz(r-4.3-arm64)
sparkwarc_0.1.6.tar.gz(r-4.5-noble)sparkwarc_0.1.6.tar.gz(r-4.4-noble)
sparkwarc_0.1.6.tgz(r-4.4-emscripten)sparkwarc_0.1.6.tgz(r-4.3-emscripten)
sparkwarc.pdf |sparkwarc.html✨
sparkwarc/json (API)

Peer review:

Bug tracker:https://github.com/r-spark/sparkwarc/issues

On CRAN:

6 exports 13 stars 1.70 score 40 dependencies 12 scripts 189 downloads

Last updated 3 years agofrom:c3e8975ad7. Checks:OK: 1 NOTE: 8. Indexed: yes.

Exports:cc_warcrcpp_read_warc_samplespark_rcpp_read_warcspark_read_warcspark_read_warc_samplespark_warc_sample_path

Dependencies:askpassblobclicodetoolsconfigcpp11curlDBIdbplyrdplyrfansigenericsglobalsgluehttrjsonlitelifecyclemagrittrmimeopensslpillarpkgconfigpurrrR6Rcpprlangrstudioapisparklyrstringistringrsystibbletidyrtidyselectutf8uuidvctrswithrxml2yaml