Wiki source for ScriptLibraries
====**Libraries and Packages for R and Python**====
The following is a set of libraries/packages that have been useful for scripting.
===**R**===
- [[https://github.com/hadley/rvest rvest]]
- [[https://tidyr.tidyverse.org/ tidyr]]
- [[https://cran.r-project.org/web/packages/sqldf/index.html sqldf]]
- [[https://cran.r-project.org/web/packages/RPostgreSQL/index.html RPostgreSQL]]
- [[https://cran.r-project.org/web/packages/plyr/index.html, plyr]]
- [[https://github.com/ropensci/RSelenium, RSelenium]]
- [[https://cran.r-project.org/web/packages/webshot/index.html webshot]]
- [[https://cran.r-project.org/web/packages/RCurl/index.html RCurl]]
- [[https://github.com/tidyverse/stringr stringr]]
- [[https://github.com/r-lib/httr httr]]
- [[https://cran.r-project.org/web/packages/RJSONIO/index.html RJSONIO]]
- [[https://cran.r-project.org/web/packages/xlsx/xlsx.pdf xlsx]]
- [[https://cran.r-project.org/web/packages/jsonlite/index.html jsonlite]]
- [[https://cran.r-project.org/web/packages/XML/index.html XML]]
Installing these packages can be handled within RStudio through the built-in package search tool or by command line in RStudio's console by entering install.packages('package_name').
===**Python**===
- [[https://github.com/psycopg/psycopg2 psycopg2]]
- [[https://pypi.org/project/selenium/ Selenium]]
- [[https://pandas.pydata.org/ Pandas]]
- [[https://pypi.org/project/html5lib/ html5lib]]
- [[https://pypi.org/project/beautifulsoup4/ BeautifulSoup4]]
- [[https://github.com/RobinL/fuzzymatcher/tree/8e09d35197f524c61c25eac6ef4c8f0bf8b45468 fuzzymatcher]]
- [[https://pypi.org/project/tabulate/ tabulate]]
- [[https://docs.python.org/3/library/csv.html csv]]
Installing libraries in python is done using [[https://pypi.org/project/pip/ pip]]. IT would need to install the latest version of pip on a staff member's workstation and grant root to the workstation in order to install packages. Packages are install through command line in linux. Ask IT for the command to install as it may change for the version of python that is installed. For python 3.6 it was sudo pip3.6 install library_name.
The following is a set of libraries/packages that have been useful for scripting.
===**R**===
- [[https://github.com/hadley/rvest rvest]]
- [[https://tidyr.tidyverse.org/ tidyr]]
- [[https://cran.r-project.org/web/packages/sqldf/index.html sqldf]]
- [[https://cran.r-project.org/web/packages/RPostgreSQL/index.html RPostgreSQL]]
- [[https://cran.r-project.org/web/packages/plyr/index.html, plyr]]
- [[https://github.com/ropensci/RSelenium, RSelenium]]
- [[https://cran.r-project.org/web/packages/webshot/index.html webshot]]
- [[https://cran.r-project.org/web/packages/RCurl/index.html RCurl]]
- [[https://github.com/tidyverse/stringr stringr]]
- [[https://github.com/r-lib/httr httr]]
- [[https://cran.r-project.org/web/packages/RJSONIO/index.html RJSONIO]]
- [[https://cran.r-project.org/web/packages/xlsx/xlsx.pdf xlsx]]
- [[https://cran.r-project.org/web/packages/jsonlite/index.html jsonlite]]
- [[https://cran.r-project.org/web/packages/XML/index.html XML]]
Installing these packages can be handled within RStudio through the built-in package search tool or by command line in RStudio's console by entering install.packages('package_name').
===**Python**===
- [[https://github.com/psycopg/psycopg2 psycopg2]]
- [[https://pypi.org/project/selenium/ Selenium]]
- [[https://pandas.pydata.org/ Pandas]]
- [[https://pypi.org/project/html5lib/ html5lib]]
- [[https://pypi.org/project/beautifulsoup4/ BeautifulSoup4]]
- [[https://github.com/RobinL/fuzzymatcher/tree/8e09d35197f524c61c25eac6ef4c8f0bf8b45468 fuzzymatcher]]
- [[https://pypi.org/project/tabulate/ tabulate]]
- [[https://docs.python.org/3/library/csv.html csv]]
Installing libraries in python is done using [[https://pypi.org/project/pip/ pip]]. IT would need to install the latest version of pip on a staff member's workstation and grant root to the workstation in order to install packages. Packages are install through command line in linux. Ask IT for the command to install as it may change for the version of python that is installed. For python 3.6 it was sudo pip3.6 install library_name.