Answered by:
Data Management (Sorting and Cleaning up files on WHS)

Question
-
I am about to move to a headless operation of this server, but I have found an issue that, either I am not doing something right (damn good chance), OR, what I AM doing, there is no way around other than to be ON the desktop of WHS.
Once this server was built, I spent 2 days collecting all my data from multiple nodes on the network and moving it all to WHS. Once that was done, the data size totaled 3.3TB. No Big Deal. This was the point behind building this server in the first place....to get all my files in ONE place permanently. But herein lays my issue. I was 'lazy' for lack of a better term, in moving my data over. I created a share and dumped EVERYTHING there with the intention of running a file dupe against the data, and once dupes were removed, migrating the data into its final home (ie, Video files, Personal User Files, Music, ect ect).
Just now I went to verify something that I belived to be true, which was I accessed the server through the remote Server Console from a node on my network, and attempted to 'move' a file from one share directory to another. And the process performed exactly how I expected it (read: DIDNT WANT IT TO) do. The data chose a path from server, to node, back to alternate server share, instead of relocating itself quickly in a way that a normal file would move from one directory to another on a standard migration process from spot to spot on the same computer.
Did I miss something with this process? is there an environment setting I can make to tell the server to move it 'virtually' instead of actually takeing across the network and back again?
This seems the last reason and time I would need to access the WHS desktop directly. migrating this data into its final home would take days if I chose to do it from a node on the environment, UNLESS, again, I am missing something?
Thanks all again for the input and help. This forum has been a great resource, and I certainly apprecate all the feedback and advice.
-Andrew- Moved by Ken WarrenModerator Saturday, April 18, 2009 3:09 AM not a hardware/installation question
Saturday, April 18, 2009 2:29 AM
Answers
-
For Add-In's check http://www.wegotserved.co.uk/. They review among other things add-ins and have a large collection of description and links to them in the add-in section.
Personally I use these add-ins:
- WHS Disk Management Add-In (http://forum.wegotserved.com/index.php?autocom=downloads&showfile=64)
- Advanced Admin Console (http://forum.wegotserved.com/index.php?autocom=downloads&showfile=19)
- Avast Antivirus (http://www.avast.com)
- Before mentioned File Manager
- And a self-made not yet released add-in that lets me run uTorrent as an add-in.
Have a look at the add-in section and see what fits your need. Check out the reviews and users comments before you decide to install them on your server.
HP MediaSmart EX475, 2GB ram, 2x512 + 1x120 GB storage. Author of WHS File Manager Add-In, WHS Jungle Disk Add-in and WHS Media Connect Configuration Add-in. http://blog.paks.no/whs-add-ins/- Marked as answer by Lara JonesModerator Thursday, May 14, 2009 5:12 PM
Saturday, April 18, 2009 6:47 PM -
Thanks everyone, yes kayra, i was aware that this is how it works with any OS, but my thoughts had been, if there was a plugin that gave me more of a 'remote desktop' as to avoid.
I think Pal's suggestion is as close as you're going to get.
thank you for the pointer to WHS file manager add-in, I will take a look into it. This is the last big 'migration' I need to do. Once these are all in place, I wont mind the 'mini' moves I will be doing, it again, gets back to not wanting to have 2 days taken moving 3TB of data around, when it can be done 'in theory (READ: unsupported) in a matter of minutes.
When I moved a few test files within D:\shares, I had issues streaming them to my XBox 360 afterwards (codec error as I recall, not sure though, it's been a while now).
Kayra: the problems you ran into with your own testing, was it Corrupt files? can you be more spacific as to what 'broke'
Mr Andreassen: your suggestion is appreciated, and it begs the question off that answer: Would you mind posting any other links to 'Add-In utilities and programs' that accompany WHS?
Changing the way moving threads from one forum to another works is not something us MVPs have any control over. We select the thread to move and tell it which forum it should be in. Everything else is handled automatically by the MS servers.
FYI Kayra: I understand how this is considered a software question, though I felt it had to do with Installation, so therefore posted in said forum. Yes, there is usually an email given if something is moved, but is it too hard to leave a pointer in the other forum?
Had me questioning for a while whether I ever hit the submit button last night.....
thanks again everyone for the input and direction
-Andrew- Marked as answer by Lara JonesModerator Thursday, May 14, 2009 5:13 PM
Saturday, April 18, 2009 7:06 PMModerator
All replies
-
I did the same as you on my set-up. Get ready for spending some quality time with moving these files around on WHS. It is not quick! There's a thread here about a third party program to speed things up. I never tried it and just invested the time and organized the files, slowly.Saturday, April 18, 2009 2:43 AM
-
I am about to move to a headless operation of this server, but I have found an issue that, either I am not doing something right (damn good chance), OR, what I AM doing, there is no way around other than to be ON the desktop of WHS.
As I previously informed you in the thread titled Copying data from a Non-storage drive to a storage drive (my second post in that thread), that's how shares work (on all Windows PCs, not just WHS). Unfortunately, you will have to "go out and back in again" one way or another (moving files from D:\shares is unsupported and has caused problems in the past for some users, including myself when I tested it). You could try logging into the server desktop and use \\localhost (instead of \\server) for the UNC path. It may speed it up slightly. Of course, logging into the server desktop is unsupported.
Once this server was built, I spent 2 days collecting all my data from multiple nodes on the network and moving it all to WHS. Once that was done, the data size totaled 3.3TB. No Big Deal. This was the point behind building this server in the first place....to get all my files in ONE place permanently. But herein lays my issue. I was 'lazy' for lack of a better term, in moving my data over. I created a share and dumped EVERYTHING there with the intention of running a file dupe against the data, and once dupes were removed, migrating the data into its final home (ie, Video files, Personal User Files, Music, ect ect).
Just now I went to verify something that I belived to be true, which was I accessed the server through the remote Server Console from a node on my network, and attempted to 'move' a file from one share directory to another. And the process performed exactly how I expected it (read: DIDNT WANT IT TO) do. The data chose a path from server, to node, back to alternate server share, instead of relocating itself quickly in a way that a normal file would move from one directory to another on a standard migration process from spot to spot on the same computer.
Did I miss something with this process? is there an environment setting I can make to tell the server to move it 'virtually' instead of actually takeing across the network and back again?
This seems the last reason and time I would need to access the WHS desktop directly. migrating this data into its final home would take days if I chose to do it from a node on the environment, UNLESS, again, I am missing something?
Thanks all again for the input and help. This forum has been a great resource, and I certainly apprecate all the feedback and advice.
-AndrewSaturday, April 18, 2009 3:04 AMModerator -
You can try my WHS File Manager Add-in. It's a free dual-pane file manager (Norton/Total commander style) that uses UNC paths \\server\share to copy / move files. That way you at least only move files internally on the server, you don't have a client PC doing the job and you don't need to RPD in.
http://blog.paks.no/2009/03/29/whs-file-manager-add-in/
HP MediaSmart EX475, 2GB ram, 2x512 + 1x120 GB storage. Author of WHS File Manager Add-In, WHS Jungle Disk Add-in and WHS Media Connect Configuration Add-in. http://blog.paks.no/whs-add-ins/Saturday, April 18, 2009 11:05 AM -
Thanks everyone, yes kayra, i was aware that this is how it works with any OS, but my thoughts had been, if there was a plugin that gave me more of a 'remote desktop' as to avoid.
thank you for the pointer to WHS file manager add-in, I will take a look into it. This is the last big 'migration' I need to do. Once these are all in place, I wont mind the 'mini' moves I will be doing, it again, gets back to not wanting to have 2 days taken moving 3TB of data around, when it can be done 'in theory (READ: unsupported) in a matter of minutes.
Kayra: the problems you ran into with your own testing, was it Corrupt files? can you be more spacific as to what 'broke'
Mr Andreassen: your suggestion is appreciated, and it begs the question off that answer: Would you mind posting any other links to 'Add-In utilities and programs' that accompany WHS?
FYI Kayra: I understand how this is considered a software question, though I felt it had to do with Installation, so therefore posted in said forum. Yes, there is usually an email given if something is moved, but is it too hard to leave a pointer in the other forum? Had me questioning for a while whether I ever hit the submit button last night.....
thanks again everyone for the input and direction
-AndrewSaturday, April 18, 2009 6:33 PM -
For Add-In's check http://www.wegotserved.co.uk/. They review among other things add-ins and have a large collection of description and links to them in the add-in section.
Personally I use these add-ins:
- WHS Disk Management Add-In (http://forum.wegotserved.com/index.php?autocom=downloads&showfile=64)
- Advanced Admin Console (http://forum.wegotserved.com/index.php?autocom=downloads&showfile=19)
- Avast Antivirus (http://www.avast.com)
- Before mentioned File Manager
- And a self-made not yet released add-in that lets me run uTorrent as an add-in.
Have a look at the add-in section and see what fits your need. Check out the reviews and users comments before you decide to install them on your server.
HP MediaSmart EX475, 2GB ram, 2x512 + 1x120 GB storage. Author of WHS File Manager Add-In, WHS Jungle Disk Add-in and WHS Media Connect Configuration Add-in. http://blog.paks.no/whs-add-ins/- Marked as answer by Lara JonesModerator Thursday, May 14, 2009 5:12 PM
Saturday, April 18, 2009 6:47 PM -
Thanks everyone, yes kayra, i was aware that this is how it works with any OS, but my thoughts had been, if there was a plugin that gave me more of a 'remote desktop' as to avoid.
I think Pal's suggestion is as close as you're going to get.
thank you for the pointer to WHS file manager add-in, I will take a look into it. This is the last big 'migration' I need to do. Once these are all in place, I wont mind the 'mini' moves I will be doing, it again, gets back to not wanting to have 2 days taken moving 3TB of data around, when it can be done 'in theory (READ: unsupported) in a matter of minutes.
When I moved a few test files within D:\shares, I had issues streaming them to my XBox 360 afterwards (codec error as I recall, not sure though, it's been a while now).
Kayra: the problems you ran into with your own testing, was it Corrupt files? can you be more spacific as to what 'broke'
Mr Andreassen: your suggestion is appreciated, and it begs the question off that answer: Would you mind posting any other links to 'Add-In utilities and programs' that accompany WHS?
Changing the way moving threads from one forum to another works is not something us MVPs have any control over. We select the thread to move and tell it which forum it should be in. Everything else is handled automatically by the MS servers.
FYI Kayra: I understand how this is considered a software question, though I felt it had to do with Installation, so therefore posted in said forum. Yes, there is usually an email given if something is moved, but is it too hard to leave a pointer in the other forum?
Had me questioning for a while whether I ever hit the submit button last night.....
thanks again everyone for the input and direction
-Andrew- Marked as answer by Lara JonesModerator Thursday, May 14, 2009 5:13 PM
Saturday, April 18, 2009 7:06 PMModerator -
Thanks Pal and Kariya, much appreciated on the feedback. I will check out the add-in links and mess around with what other options they offer.
kariya, I understand that it may be a bit fuzzy from a while ago, but honestly, do you think that moving a file within the shares could have actually borked the playback because of a codec?
that honestly seems separate. I would expect a completely corrupt file or not, not 'partially corrupt'......
quite interesting.
well, Thanks Again for all the info, this has been a great resource. I will continue to mess and play with WHS, and hopefully will be able to give back some of what I have received in the way of help and guidance.
-javadog (Andrew)Monday, April 20, 2009 3:15 AM -
Thanks Pal and Kariya, much appreciated on the feedback. I will check out the add-in links and mess around with what other options they offer.
No, it didn't actually mess up because of the codec. That's just the error message it kicked up (probably because it doesn't have any idea what a tombstone is).
kariya, I understand that it may be a bit fuzzy from a while ago, but honestly, do you think that moving a file within the shares could have actually borked the playback because of a codec?
that honestly seems separate. I would expect a completely corrupt file or not, not 'partially corrupt'......
quite interesting.
well, Thanks Again for all the info, this has been a great resource. I will continue to mess and play with WHS, and hopefully will be able to give back some of what I have received in the way of help and guidance.
-javadog (Andrew)Tuesday, April 21, 2009 12:46 AMModerator