README.md 4.68 KB
Newer Older
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
1
# Globus Sign in
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
2
You may have alredy tested your globus sign in with the instuctions you were sent in your training registration confirmation. 
3

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
4
**Globus Sign In for CADES users with a UCAMS ID (ORNL employee)**
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22

If you are an ORNL employee you will use the ORNL organizational sign in and your UCAMS ID to access the Globus web interface. 
1. Navigate to the Globus website (https://www.globus.org/) and click `Log in`.
   - Select your organization <kbd>Oak Ridge National Laboratories</kbd> from the drop-down menu and select `Continue`.
   - Use your UCAMS username and password to log in.
     * If you have an existing Globus account, you may choose to link them at this time, or skip to the next step, by clicking `No thanks, continue`.
   - Accept the user agreement and `Continue`. The next screen with ask you to `Allow` permissions.

**Globus Sign In for CADES users with an XCAMS ID** 

If you only have an XCAMS ID (You are not an ORNL employee), you will need to use a Globus ID. If you don’t have one, follow the instructions below: 
1. Navigate to the Globus website (https://www.globus.org/) and click `Log in`.
    -  Click "Globus ID" (small Blue text).
    -  Then find and click "Need a Globus ID? Sign up."
    -  Fill out the resulting form with your email and a password of your choice. 
    -  Check your email for a confirmation code. Your ID and account will be activated after you enter the confirmation code.


Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
23
24
# Globus Endpoints

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
25
Globus Endpoints are storage locations to which you have access. Endpoints may be managed by either individuals or institutes, and this determines what authentication is needed. Institutions run large, multi-user, endpoints such as dedicated Data Transfer Nodes (DTNs).
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
26

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
27
Users may also create their own personal endpoints, and manage access and sharing. That is beyond the scope of this training, for instructions see: https://support.cades.ornl.gov/user-documentation/_book/data-transfer-storage/globus-connect-personal.html
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
28
29
30

# CADES and OLCF Endpoint Names

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
31
Once logged into Globus, you can select the Endpoints icon in the left blue menu, and search for public endpoints by name.
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
32
33
34
35
36
37

Searching for ```CADES OR``` or ```OLCF DTN``` will present these endpoint for you to activate.


## Activating Endpoints

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
38
39
40
41
42
Activating an endpoint generally requires credentials at the institutes hosting the endpoints.
  * For example, activating the OLCF or NERSC endpoints requires accounts at those facilities.
  * Authentication is commonly required for institutional Data Transfer Nodes (DTNs)

### Activiating the CADES-OR Endpoint
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
43

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
44
45
1. Click in the "Endpoints" box on the left blue menu on globus.org side and search for `CADES-OR` (CADES Open Research).
   * You will be redirected to enter your UCAMS credentials or globusID.   
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
46
47
    
    * Authenticating the Endpoint with your credentials is known as *Endpoint Activation* and can be done when adding and using an Endpoint for the first time, or can be completed by navigating to the "Manage Endpoints" screen as shown in the following image (`Endpoints`&rarr;`Endpoint List`&rarr;`activate`).   
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
48
    
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
49
50
*  Once the endpoint is set you can modify the path to point to your file/data. In this example, we will connect to Lustre storage: `/lustre/or-hydra/cades-birthright/world-share/`

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
51
52

## Moving Files 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
53
Once you have signed in to globus and activated the CADES-OR endpoint you can move files with the "File Manager" between diffrent directories. 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
54
55

*Example:* 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
56
57
58
59
60
61
62
63
64

This example setup shows you how to move files from Lustre to your NFS /home/userID area to aviod losing them in the Lustre purge. 
Next go to “filemanager” on the left blue column menu: 
* In the left "Collection" window type CADES-OR. 
* Notice that you see your NFS home/userID directory contents listed, this is the default landing point. 
* In the right "Collection" window type "CADES-OR"
* In the "Path" window enter the path to birthright Lustre scratch space world-shared area: 
   * /lustre/or-hydra/cades-birthright/world-shared
* Click on *my_test_file.txt* in world-shared and use the " < Start" option at the bottom of right colum to move it to NFS. 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
65
66
67
* Notice that you can move whole folders. 

A note about data managment: 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
68
69
This makes it easy to move folders and files out of Lustre, but you really should save only the data that you need to keep. 
When you start a simulation campaign, plan first for what files you will keep and what files you will discard. 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
70

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
71
72
## Globus Challange

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
73
74
75
76
77
78
79
1. Sign in to gloubs.org. 

2. Activate the CADES-OR endpoint. 

3. Use Globus to: 
   * Get  /lustre/or-hydra/cades-birthright/world-shared/GPU_basics and 
   * Put it in your /home/userID NFS directory
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
80
81
82

* What was your transfer speed? 

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
83
4. Can you find the OLCF HPSS endpoint? 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
84

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
85
5. Can you find the NERSC endpoints? 
Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
86

Parete-Koon, Suzanne's avatar
Parete-Koon, Suzanne committed
87
88
89
90