Introduction to TileDB for R
"TileDB is an open source universal data engine that natively supports dense and sparse multidimensional arrays, as well as data frames. Large
datasets can be stored on multiple backends ranging from a local filesystem to cloud storage providers such as Amazon S3 (as well Google Cloud Storage and Azure Cloud Storage) and accessed using almost any language, including Python and R. The tutorial introduces the 'tiledb' R package on CRAN, which allows users to efficiently operate on large dense/sparse arrays using familiar R techniques and data structures. It also offers key features of the underlying TileDB Embedded library: parallelised read and write operations, multiple compression formats, time traveling (i.e., the ability to recover data stored at previous timepoints), flexible encryption, and Apache Arrow support. Several simple usage examples will be provided and you will have an opportunity to follow along on your laptops. One or two fuller usage examples from Bioinformatics will serve as a more extended case study.
We will illustrate how TileDB can be used to create a performant data store for results produced by Genome-Wide Association Studies, and demonstrate the BioConductor package, TileDBArray, which is built on top of the DelayedArray framework and has shown excellent performance relevant to existing (hdf5-based) solution. Finally, usage of TileDB with cloud storage providers will be illustrated. This covers both direct reads and writes to, for example, Amazon S3 as well as a brief illustration of the 'pay-as-you-go' Software-as-a-Service offering of TileDB Cloud with its additional features."