Research Platform Services Wiki

If you're a researcher, we'll help you do stuff.

User Tools

Site Tools


data_management:mediaflux:howto:downloaddata

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
data_management:mediaflux:howto:downloaddata [2018/12/11 15:02]
Neil Killeen [2 Non-Authenticated Users]
— (current)
Line 1: Line 1:
-===== Downloading Data From Mediaflux ===== 
- 
- 
- 
-Because Mediaflux supports a lot of protocols ​ there are a lot of possible ways to access your data.  Users come in two categories of relevance: 
-    - Those that have their own accounts (they might be local or via the Australian Access Federation) and who can directly authenticate to Mediaflux.  ​ 
-  -   Those that don't have accounts - here the users gains access via (usually temporary) secure tokens provisioned by somebody else. Of course, this mechanism can also work for users who have their own accounts as well -  they just don't need those accounts in this instance. 
- 
-==== 1 Authenticated Users ==== 
- 
-This means you have an account and can log in directly to Mediaflux. ​ The details on how to login with various protocols and interfaces are found in (see [[data_management:​mediaflux:​howto:​access|access mechanisms]]).  ​ 
- 
- 
-=== 1.1 Generic Users === 
- 
-This means you have an account and can log in directly to Mediaflux. ​ The details on how to login with various protocols and interfaces are found in (see [[data_management:​mediaflux:​howto:​access|access mechanisms]]).  ​ 
- 
-We recommend that best way to download data is either to use sFTP (if you are already familiar with it and have a client installed), or use the download client that UniMelb supplies (see below). 
- 
- 
-== 1.1.1 From the Vendor [Arcitecta] == 
- 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​sftp | Secure FTP]] - e.g. FileZilla or CyberDuck 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​smb2 | SMB2 (Network File Share of which CIFS is a type of SMB) ]] - OSX Finder and Windows Explorer have this built in 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​explorer | The Mediaflux Explorer ]] - Specialised Java 8 Interactive Drag-and-drop graphical application ​ 
-      * Has the ability to send data to end points called ''​sinks''​ (e.g. a remote SCP or sFTP server) 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​desktop | Mediaflux Desktop ]] - Web-browser based Interface ​ 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​aterm | ATERM Graphical Terminal ]] - Java 8 Interactive terminal application (you type Mediaflux commands into it) - **Advanced Users Only**. 
- 
-==  1.1.2 From Research Platform Services, The University of Melbourne ==  
- 
-Our clients can be downloaded from our    [[data_management:​mediaflux:​downloads|Available downloads]] page. 
- 
-    * [[data_management:​mediaflux:​howto:​unimelb-mf-clients:​unimelb-mf-download ​ | UniMelb download client ]] - Efficient, restartable,​ parallel, synchronizable, ​ download client. 
-    * [[data_management:​mediaflux:​howto:​unimelb-mf-clients:​unimelb-mf-check ​ | UniMelb checking client ]] - Efficient client that checks the local file system against assets in Mediaflux. 
-==== 2 Non-Authenticated Users ==== 
- 
- 
- 
-The following mechanisms means that you don't need to have an account and don't need to login directly to Mediaflux. You may of course still have an account, you just don't need to use it in these cases. 
- 
-These mechanisms all authenticate to Mediaflux with what is called a secure identity token. The token usually expires after a fixed time (which you would be told by the person who provisions your data for you) and it is granted access to the data that it needs and only that data. 
- 
-Direct shareable links are ok for a small amount of data (they download in serial into a container and are not restartable). ​ The more complex indirect shareable links are much better for big data as they don't pack the data into a container, can be restarted and can download the data in parallel. 
- 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​direct_shareable_links | Direct Shareable Links ]] 
-      * A direct shareable link downloads data to a container (e.g. a tar or zip container). Once that is downloaded, the user must unpack the container (so double the storage is required) ​ 
-      * Direct links are not good for big data because if the process fails (e.g.network interruption) ​ you have to start again from the beginning and because twice the storage is required 
-      * Direct shareable links can be provisioned by users via the Mediaflux Explorer ​ 
-   * [[data_management:​mediaflux:​howto:​downloaddata:​indirect_shareable_links | In-direct Shareable Links ]]  
-      * An indirect shareable link downloads a downloader (e.g. a script or application) which itself downloads the data 
-      * These are best for big data because they can restart, may be able to download data in parallel and because they don't pack the data into a container (so you don't need double the storage) ​ 
-      * Currently, indirect shareable links can only be provisioned by specific users via scripts provided via ResPlat 
  
data_management/mediaflux/howto/downloaddata.1544500960.txt.gz · Last modified: 2018/12/11 15:02 by Neil Killeen