Connect to the data transfer node
You can use the following method to connect to the data transfer node using Key or system Password + OTP Authentication Code.
After connecting to the data transfer node and entering HFS storage space, you can upload files to the space through SFTP protocol, or download the files from HFS to the your local machine.
TWSC also provides users with the rsync
command to transfer large amount files with a good experience. However, since the system does not provide the logs of file transmission using rsync
, it may not be able to be traced if there are information security concerns. If you agree to undertake the risk of use and authorize TWSC to enable the rsync
function, please send your request to isupport@twcc.ai .
1. Connect using keys
The following example demonstrates with Windows + FileZilla (similar to macOS)
Step 1. Connect to a compute service- Users of TWSC Interactive Container service can connect to the container through Jupyter Notebook or SSH
- Users of TWSC Scheduled Container, HPC Job, and Taiwania 2 (HPC CLI) can connect to the login node of Taiwania 2 (HPC CLI)
See the connection method:
- After logging in, enter the following command to read the SSH private key
cat ~/.ssh/id_rsa
- Take connecting to the Taiwania 2 login node via MobaXterm as an example:
- Save the SSH private key to your local machine, copy all the red frame part, open notepad and paste it on (the beginning and ending information must be included).
macOS:TextEdit software is available
-----BEGIN RSA PRIVATE KEY----- (This line also needs to be copied)
...
...
-----END RSA PRIVATE KEY----- (This line also needs to be copied)
- Save the notepad: the file location and file name are not limited, the extension name must be
.ppk
, and the file type should be changed toall files
.
- Click the site manager in the upper left corner, add a new site in the lower left corner, and the menu as shown in the figure below will pop up
- For input and selection, refer to the figure below
Protocol: SFTP
Host: xdata1.twcc.ai
Logon Type: Key file
User: system account
Key file: directory of the key file
- Click Connect to login successfully
2. Connect using system password + OTP
In addition to the above login method using the key, HFS can also login using password + OTP . Please refer to the following instructions:
Step 1. Download software that supports SFTP connection and 2-Step verificationPlease download and install software that supports SFTP connection and 2-Step verification (e.g., Filezilla, Cyberduck, WinSCP, etc).
Step 2. Connect to the data transfer nodeThe following uses Filezilla as an example of operation. After opening the software:
- Open the Site Manager on the upper left
- Protocol: select SFTP- SSH File Transfer Protocol
- Host: enter xdata1.twcc.ai
- Logon type: select Interactive
- User: enter your system account
- Click Transfer Settings
- To avoid the steps of re-entering the password and OTP every time you transfer files, check Limit number of simultaneous connections and set the maximum number of connections to 1.
After checking, when multiple files are being transferred, only one file can be transferred at a time. If it is inconvenient for you, it is recommended to connect using the key.
- Click Connect
- Select a login method
- Click OK
- Enter your system account password
- Click OK
- Enter the OTP
- Click OK
- After the connection is successful, the remote site on the right is the data in the HFS space, and the local site on the left is the data of your local machine.
- The default directory is the user's /home directory, and the data under the /home directory is displayed in the panel below.