How to copy data from non-headnode.
-
2009年8月21日 7:13The cluster in my office have 50 nodes, each nodes have their own hard disk. But only the headnode connect to the internet. I want to copy the data, which is stored in other nodes not in the headnode, to my desktop. How should I do. The procedure what I do now, first copy the data to the shared folder of the headnode, then copy the data to my desktop. Is there any straight way to direct copy to data to my desktop?
全部回复
-
2009年8月24日 10:10Hi,
you can enable the NAT on the headnode and then your nodes can access the outside of the private network.
A more simpler way is to login to the headnode and forward you local drives, or mount a network share on the headnode of your local drive.
Then access the node data from the headnode and copy it to the network or RDP share.
Johannes
JH -
2009年11月19日 19:51
Since you already have a shared folder on the headnode, it would be simplest if the jobs performed a final copy of the data from the compute nodes to the headnode share before they finish. Alternatively, you could create and run a separate data-consolidation job with tasks that copy the data from the compute nodes to the headnode share, and then a final task that runs on the headnode to copy the data to a share on your desktop.
- 已标记为答案 Don PatteeModerator 2009年12月9日 6:42