My student and I are working on a project where we will be reducing and analyzing a large number of datasets. This will require that we both have access to some shared space. I see we can create folders in shared-storage, but the issue is that these are a) not private and b) also likely not large enough for the scope of our project (~100s of GB).
Ideally, we’d use our scratch spaces that are increased in size, but I have no idea how to share any directories in /scratch with her since I can’t find its absolute path, and I’m not even sure if permission setting works the same as on linux machines.
I am looking for advice on how to best set up such a project space, and apologies if this is described elsewhere.
The collaboration tool is being finalized before deployement. It addresses exactly what you need, where you’ll be able to create a group, add people to it, and addd shared storage. Currently, however, the only option for sharing is through /shared-storage.
If you don’t need this immediately, you can wait for the collaboration feature to be delivered. We don’t have a firm date, but it should be a month or two.
If you need this immediately and you want to do it only once, you can use the shared-storage and encrypt the files. Run the following in the terminal:
# install gpg to do the encryption and decryption:
micromamba install gnupg -y
# tar and encrypt the folder you want, using some password
mkdir -p /shared-storage/users/ogoann/
tar -czf - my_data | gpg --pinentry-mode loopback -c > /shared-storage/users/ogoann/my_data.tar.gz
# Type some password
# the other person can decrypt it with:
gpg --pinentry-mode loopback -d /shared-storage/users/ogoann/my_data.tar.gz | tar -xzf -
# Type the password from above.
