HPC, DFS, and data locality RRS feed

  • Question

  • I am searching for information regarding the interaction between HPC and DFS.  In particular, I am trying to understand the similarities and differences between Microsoft's DFS and Hadoop's HDFS, and whether, like HDFS, MS-DFS can be queried concerning the data locality of shards.  We seek use that information in an HPC cluster to schedule tasks on compute nodes that are close to the data.  Any information would be helpful, as would links to "programming HPC" FAQs and books, as I am fairly new to this.

    John Lilley Chief Architect RedPoint Global Inc.

    Thursday, May 16, 2013 1:04 AM

All replies