Provides easier interaction with 'Socrata' open data portals < http://dev.socrata.com>. Users can provide a 'Socrata' data set resource URL, or a 'Socrata' Open Data API (SoDA) web query, or a 'Socrata' "human-friendly" URL, returns an R data frame. Converts dates to 'POSIX' format and manages throttling by 'Socrata'. Users can upload data to 'Socrata' portals directly from R.
Master
Stable beta branch. Test about-to-be-released features in a stable pre-release build before it is submitted to CRAN.
Dev
"Nightly" alpha branch. Test the latest features and bug fixes -- enjoy at your own risk.
Provided with a URL to a dataset resource published on a Socrata webserver,
or a Socrata SoDA (Socrata Open Data Application Program Interface) web API query,
or a Socrata "human-friendly" URL, read.socrata()
returns an R data frame.
Converts dates to POSIX format.
Supports CSV and JSON download file formats from Socrata.
Manages the throttling of data returned from Socrata and allows users to provide an application token.
Supports SoDA query parameters in the URL string for further filtering, sorting, and queries.
Upload data to Socrata data portals using "upsert" and "replace" methods.
Use ls.socrata()
to list all datasets available on a Socrata webserver.
testthat test coverage.
To get the current released version from CRAN:
install.packages("RSocrata")
The most recent beta with soon-to-be-released changes can be installed from GitHub:
# install.packages("devtools")devtools::install_github("Chicago/RSocrata")
The "nightly" version with the most recent bug fixes and features is also available. This version is always an alpha and may contain significant bugs. You can install it from the dev
branch from GitHub:
# install.packages("devtools")devtools::install_github("Chicago/RSocrata", ref="dev")
earthquakesDataFrame <- read.socrata("http://soda.demo.socrata.com/resource/4334-bgaj.csv")nrow(earthquakesDataFrame) # 1007 (two "pages")class(earthquakesDataFrame$Datetime[1]) # POSIXlt
earthquakesDataFrame <- read.socrata("https://soda.demo.socrata.com/dataset/USGS-Earthquakes-for-2012-11-01-API-School-Demo/4334-bgaj")nrow(earthquakesDataFrame) # 1007 (two "pages")class(earthquakesDataFrame$Datetime[1]) # POSIXlt
token <- "ew2rEMuESuzWPqMkyPfOSGJgE"earthquakesDataFrame <- read.socrata("http://soda.demo.socrata.com/resource/4334-bgaj.csv", app_token = token)nrow(earthquakesDataFrame)
# Store user email and passwordsocrataEmail <- Sys.getenv("SOCRATA_EMAIL", "[email protected]")socrataPassword <- Sys.getenv("SOCRATA_PASSWORD", "7vFDsGFDUG") privateResourceToReadCsvUrl <- "https://soda.demo.socrata.com/resource/a9g2-feh2.csv" # dataset read.socrata(url = privateResourceToReadCsvUrl, email = socrataEmail, password = socrataPassword)
allSitesDataFrame <- ls.socrata("https://soda.demo.socrata.com")nrow(allSitesDataFrame) # Number of datasetsallSitesDataFrame$title # Names of each dataset
# Store user email and passwordsocrataEmail <- Sys.getenv("SOCRATA_EMAIL", "[email protected]")socrataPassword <- Sys.getenv("SOCRATA_PASSWORD", "7vFDsGFDUG") datasetToAddToUrl <- "https://soda.demo.socrata.com/resource/xh6g-yugi.json" # dataset # Generate some datax <- sample(-1000:1000, 1)y <- sample(-1000:1000, 1)df_in <- data.frame(x,y) # Upload to Socratawrite.socrata(df_in,datasetToAddToUrl,"UPSERT",socrataEmail,socrataPassword)
Please report issues, request enhancements or fork us at the City of Chicago github.
If you would like to contribute to this project, please see the contributing documentation and the product roadmap.