Skip to content

Overhaul localization to disk

Aaron Graubert requested to merge localize-to-rodisk into master

Created by: julianhess

  • Use file_handler module to formalize input types (e.g. gs:// URL, GDC URL, local file, string literal, etc.)
  • Allow for creation of separate disks for input files and the workspace directory. The former subsumes RODISK localization previously handled in wolF. The latter allow for write IO intensive tasks to write to a separate scratch disk, which can subsequently be read from as a RODISK in downstream tasks.
  • Misc. performance tweaks

Merge request reports