...
| Code Block |
|---|
stargrid01:~/0x$globus-job-run carvergrid.nersc.gov /bin/csh \-c "ls /global/scratch/sd/balewski/w2011/" globus-job-run pdsfgrid.nersc.gov /bin/csh -c "ls /home/ibhadju/temp/simPreStage/" |
Synchronize a disk with HPSS
| Code Block |
|---|
copy 1 file from HPSS to disk. Here's my example.
echo "nersc#hpss/home/p/porter/auk.tar nersc#dtn/project/projectdirs/star/porter/auk.tar"
| ssh -t cli.globusonline.org transfer
It will return a task id and you can query that specifically via
ssh -t cli.globusonline.org details your-task-id
If this all works, then try to sync a directory tree from a source to a destination
- here is my example from disk to hpss
echo "nersc#dtn/global/scratch/sd/porter/reco/2007ProductionMinBias/
nersc#hpss/home/p/porter/ -r -s 1 " | ssh -t cli.globusonline.org transfer
You need the slashes at the end of the directory names. The 's 1' means use filesize to
determine success.
Let me know how that goes. The same syntax could be used to copy files/directories between
rcf and nersc once the rcf endpoint is configured.
|
...
Q: what is the path to /star/data13/ visible to globus?
...
| Code Block |
|---|
Ok. Let's do a transfer. 1st check for endpoints (assuming your globus online user name is same as on your laptop, otherwise add yourname@ in front of the cli...) ssh -t cli.globusonline.org endpoint-list should show nothing. But add the -p, ssh -t cli.globusonline.org endpoint-list -p This should produce a public list that includes nersc#dtn & nersc#hpss. (always just use the -t to hide any passwords you might need ...) Activate both those endpoints, ssh -t cli.globusonline.org endpoint-activate nersc#* This will prompt for a pass phrase - use your nim password. Now list again & this should show the endpoints with a time associated with it ( we can increase the time to 11 days as needed). ssh -t cli.globusonline.org endpoint-list Now copy 1 file from HPSS to disk. Here's my example. echo "nersc#hpss/home/p/porter/auk.tar nersc#dtn/project/projectdirs/star/porter/auk.tar" | ssh -t cli.globusonline.org transfer It will return a task id and you can query that specifically via ssh -t cli.globusonline.org details your-task-id If this all works, then try to sync a directory tree from a source to a destination - here is my example from disk to hpss echo "nersc#dtn/global/scratch/sd/porter/reco/2007ProductionMinBias/ nersc#hpss/home/p/porter/ -r -s 1 " | ssh -t cli.globusonline.org transfer You need the slashes at the end of the directory names. The 's 1' means use filesize to determine success. Let me know how that goes. The same syntax could be used to copy files/directories between rcf and nersc once the rcf endpoint is configured. Jeff |
Jeff2:
| Code Block |
|---|
Let's do a transfer.
1st check for endpoints (assuming your globus online user name is same as on your laptop, otherwise add yourname@ in front of the cli...)
ssh -t cli.globusonline.org endpoint-list
should show nothing. But add the -p,
ssh -t cli.globusonline.org endpoint-list -p
This should produce a public list that includes nersc#dtn & nersc#hpss. (always just use the -t to hide any passwords you might need ...)
Activate both those endpoints,
ssh -t cli.globusonline.org endpoint-activate nersc#*
This will prompt for a pass phrase - use your nim password.
Now list again & this should show the endpoints with a time associated with it ( we can increase the time to 11 days as needed).
ssh -t cli.globusonline.org endpoint-list
Now copy 1 file from HPSS to disk. Here's my example.
echo "nersc#hpss/home/p/porter/auk.tar nersc#dtn/project/projectdirs/star/porter/auk.tar" | ssh -t cli.globusonline.org transfer
It will return a task id and you can query that specifically via
ssh -t cli.globusonline.org details your-task-id
If this all works, then try to sync a directory tree from a source to a destination - here is my example from disk to hpss
echo "nersc#dtn/global/scratch/sd/porter/reco/2007ProductionMinBias/ nersc#hpss/home/p/porter/ -r -s 1 " | ssh -t cli.globusonline.org transfer
You need the slashes at the end of the directory names. The 's 1' means use filesize to determine success.
Let me know how that goes. The same syntax could be used to copy files/directories between rcf and nersc once the rcf endpoint is configured.
|