Research Platform Services Wiki

If you're a researcher, we'll help you do stuff.

User Tools

Site Tools


data_management:mediaflux:howto:downloaddata

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
data_management:mediaflux:howto:downloaddata [2019/02/28 13:23]
Neil Killeen
data_management:mediaflux:howto:downloaddata [2019/10/31 15:03] (current)
Neil Killeen [1 Authenticated Users]
Line 31: Line 31:
 Our clients can be downloaded from our    [[data_management:​mediaflux:​downloads|Available downloads]] page. Our clients can be downloaded from our    [[data_management:​mediaflux:​downloads|Available downloads]] page.
  
-    * [[data_management:​mediaflux:​howto:​unimelb-mf-clients:​unimelb-mf-download  ​UniMelb ​download client ]] - Efficient, restartable,​ parallel, synchronizable, ​ download client. +    * [[data_management:​mediaflux:​howto:​unimelb-mf-clients | download client ]] - Efficient, restartable,​ parallel, synchronizable, ​ download client ​(one of several clients described in this page) 
-    * [[data_management:​mediaflux:​howto:​unimelb-mf-clients:​unimelb-mf-check ​ ​| ​UniMelb ​checking client ]] - Efficient client that checks the local file system against assets in Mediaflux.+    * [[data_management:​mediaflux:​howto:​unimelb-mf-clients ​ | checking client ]] - Efficient client that checks the local file system against assets in Mediaflux ​(one of several clients described on this page)
 ==== 2 Non-Authenticated Users ==== ==== 2 Non-Authenticated Users ====
  
Line 43: Line 43:
 Direct shareable links are ok for a small amount of data (they download in serial into a container and are not restartable). ​ The more complex indirect shareable links are much better for big data as they don't pack the data into a container, can be restarted and can download the data in parallel. Direct shareable links are ok for a small amount of data (they download in serial into a container and are not restartable). ​ The more complex indirect shareable links are much better for big data as they don't pack the data into a container, can be restarted and can download the data in parallel.
  
-   * [[data_management:​mediaflux:​howto:​downloaddata:​direct_shareable_links | Direct Shareable Links ]]+   * [[data_management:​mediaflux:​howto:​downloaddata:​direct_shareable_links | Direct Shareable Links - Details ​]]
       * A direct shareable link downloads data to a container (e.g. a tar or zip container). Once that is downloaded, the user must unpack the container (so double the storage is temporarily required) ​       * A direct shareable link downloads data to a container (e.g. a tar or zip container). Once that is downloaded, the user must unpack the container (so double the storage is temporarily required) ​
       * Direct links are not good for big data because if the process fails (e.g.network interruption) ​ you have to start again from the beginning and because twice the storage is required       * Direct links are not good for big data because if the process fails (e.g.network interruption) ​ you have to start again from the beginning and because twice the storage is required
       * Direct shareable links can be provisioned by users via the Mediaflux Explorer (see the [[https://​wiki.cloud.unimelb.edu.au/​resplat/​doku.php?​id=data_management:​mediaflux:​howto:​explorer_video_guide| shareable link how to video on the Explorer how to videos page]]       * Direct shareable links can be provisioned by users via the Mediaflux Explorer (see the [[https://​wiki.cloud.unimelb.edu.au/​resplat/​doku.php?​id=data_management:​mediaflux:​howto:​explorer_video_guide| shareable link how to video on the Explorer how to videos page]]
-   * [[data_management:​mediaflux:​howto:​downloaddata:​indirect_shareable_links | In-direct Shareable Links ]] +   * [[data_management:​mediaflux:​howto:​downloaddata:​indirect_shareable_links | In-direct Shareable Links - Details ​]] 
       * An indirect shareable link downloads a downloader (e.g. a script or application) which itself downloads the data       * An indirect shareable link downloads a downloader (e.g. a script or application) which itself downloads the data
       * These are best for big data because they can restart, may be able to download data in parallel and because they don't pack the data into a container (so you don't need double the storage) ​       * These are best for big data because they can restart, may be able to download data in parallel and because they don't pack the data into a container (so you don't need double the storage) ​
       * Currently, indirect shareable links can only be provisioned by specific users via scripts provided via ResPlat       * Currently, indirect shareable links can only be provisioned by specific users via scripts provided via ResPlat
data_management/mediaflux/howto/downloaddata.1551320633.txt.gz · Last modified: 2019/02/28 13:23 by Neil Killeen