A recommended storage pattern is to have the master copy of data on Atlas (project folder) and to only store data on the UL HPC Clusters temporarily for the duration of computational analysis. All analysis performed on the UL HPC Clusters must therefore be regularly transferred to Atlas. This How-to Card describes the different methods to transfer data between Atlas and the UL HPC Clusters. The three recommended methods to transfer data are:
A recommended storage pattern is to have the master copy of data on Atlas (project folder) and to only store data on the UL HPC Clusters temporarily for the duration of computational analysis. All analysis performed on the UL HPC Clusters must therefore be regularly transferred to Atlas. This How-to Card describes the different methods to transfer data between Atlas and the UL HPC Clusters. The three recommended methods to transfer data are:
1.[Via laptop with ```scp``` or ```rsync```]()
1.[Via laptop with ```scp``` or ```rsync```](#1. Via laptop using scp or rsync)
2.[Via dedicated Virtual Machine (VM)]()
2.[Via dedicated Virtual Machine (VM)](#2. Via dedicated Virtual Machine (VM) using rsync)
3.[Via Large File Transfer (LFT)]()
3.[Via Large File Transfer (LFT)](#3. Via Large File Transfer (LFT))
Please visit the dedicated knowledge bases to see how to [connect to UL HPC Clusters](https://hpc-docs.uni.lu/connect/access/) and to [mount to Atlas](https://service.uni.lu/sp?id=kb_article_view&sysparm_article=KB0010233).
Please visit the dedicated knowledge bases to see how to [connect to UL HPC Clusters](https://hpc-docs.uni.lu/connect/access/) and to [mount to Atlas](https://service.uni.lu/sp?id=kb_article_view&sysparm_article=KB0010233).
...
@@ -39,4 +39,4 @@ An alternative solution is to use LFT for transferring data between Atlas and UL
...
@@ -39,4 +39,4 @@ An alternative solution is to use LFT for transferring data between Atlas and UL
Please visit the dedicated [How-to Card on LFT]({{'/?exchange-channels:lft' | relative_url }}) to see further information.
Please visit the dedicated [How-to Card on LFT]({{'/?exchange-channels:lft' | relative_url }}) to see further information.
> NOTE: LFT is only recommended for the use case mentioned above, where raw data were received via LFT. In other use cases, we recommend opting for method 1 or 2.
> NOTE: LFT is only recommended for the use case mentioned above, where raw data were received via LFT. In other use cases, we recommend opting for method 1 or 2.