Answered by:
Peer to peer performance and question

Question
-
I realize that Mesh P2P is still a work in progress. In that context, I have a comment and a question.
Slow performance: I went for broke yesterday and tried to sync 17GB of photos between two systems. It looked like it was going to work... eventually. I stopped the sync because it was going to take over a day. In contrast, I can copy the photos over my Gigabit LAN in way less than 20 minutes. I can also use SyncToy to do it in slightly more than 20 minutes. It seems that Live Mesh sync should eventually be optimizable to be as fast as SyncToy. I'm looking forward to that!
Is there any way to speed up sync in the current version? I tried copying the photos to both systems before adding them to the Mesh, but it still looked like it was going to take more than a day to sync, even though all the photos in both folders were already identical!
That was my comment and my question, but I should mention that I'm using Mesh for my daily work files, and it makes switching from my desktop to my laptop so much easier! I would cry if anyone took Mesh away!
Monday, August 18, 2008 1:56 PM
Answers
-
The team blog (specifically this article) indicates that the team have only really tested up to 10Gb in a single folder.
From my own experience with folders under this size (a pictures folder of 5GB and a music folder of 9GB), the p2p sync takes a long time before it actually appears to start copying files - once it starts, files are synched in fits and starts.
For non-changing data (such as pictures), the initial synch appears to take a long time, but unless you're desperate to synch, perhaps you'll just need to leave it to do its magic for the moment until the team get things going quicker.
Or perhaps start with an empty folder, make sure it is synching (synching nothing, that is ;-)), and then move the pictures/files in in small chunks (1GB at a time?). Not sure whether this will get it going a bit quicker, but may help.
As Stephen says, nothing we can do directly to speed it up - just need the Live Mesh team to do some work on the performance (which I believe Ben had indicated they were).
Glyn- Marked as answer by kensm [msft] Monday, August 18, 2008 7:38 PM
Monday, August 18, 2008 6:54 PM
All replies
-
I don't know that there's much that we can do to speed up that sync in our settings. And having Mesh sync to a folder that already contains the files you want to sync doesn't help since the fles all need to be synchronized anyway -- creating and resolving conflicts for each match.
-steve
Microsoft MVP Windows Live / Windows Live OneCare Forum ModeratorMonday, August 18, 2008 5:54 PMModerator -
The team blog (specifically this article) indicates that the team have only really tested up to 10Gb in a single folder.
From my own experience with folders under this size (a pictures folder of 5GB and a music folder of 9GB), the p2p sync takes a long time before it actually appears to start copying files - once it starts, files are synched in fits and starts.
For non-changing data (such as pictures), the initial synch appears to take a long time, but unless you're desperate to synch, perhaps you'll just need to leave it to do its magic for the moment until the team get things going quicker.
Or perhaps start with an empty folder, make sure it is synching (synching nothing, that is ;-)), and then move the pictures/files in in small chunks (1GB at a time?). Not sure whether this will get it going a bit quicker, but may help.
As Stephen says, nothing we can do directly to speed it up - just need the Live Mesh team to do some work on the performance (which I believe Ben had indicated they were).
Glyn- Marked as answer by kensm [msft] Monday, August 18, 2008 7:38 PM
Monday, August 18, 2008 6:54 PM -
I presume that it's the encryption that is the main cause of the slowness? Anyone know?Tuesday, August 19, 2008 10:37 PM
-
Encryption may play a part, but mostly I think it is because Live Mesh throttles the bandwidth used to prevent impact to other activities.
-steve
Microsoft MVP Windows Live / Windows Live OneCare Forum ModeratorWednesday, August 20, 2008 3:53 PMModerator -
Mesh currently isn't very good at using the local network for P2P, either; so it may be sending the files up into the cloud and then back down to the other computer - which certainly isn't going to be fast. :)Friday, August 22, 2008 4:17 PM
-
OK in my quest to continually push the limits, I tried to peer to peer sync my photos again with the newer version of Live Mesh 0.9.3103.14. The sync is getting further faster, but not completing. Is there anything I should try, or should I log a bug?
The photos folder is currently 16GB, 7000 files, 160 folders.
Live Mesh synced most of the files, and much quicker this time (just a few hours not a few days - sorry I don't know exactly how long I walked away and let it rip).
The "most of the files" is the problem. About 10% of the folders still have Live Mesh Placeholder Files, and the sync has been grinding away (green wheel spinning) for days now, with only sporadic progress.
I also can't make any sense of the downloading status information:
On the system with the complete photos folder, it says "Uploading: 0 bytes of 0 bytes" and "Downloading: 0 bytes of 11.6 GB". Green wheel spinning.
On the system receiving the photos folder, it says "Uploading: 0 bytes of 0 bytes" and "Downloading: 2.73 MB of 9.17GB". Green wheel spinning. Ocasionally the downloading quantities increase a bit.
I should note that the receiving system is a laptop, which gets moved around, sometimes wireless, sometimes wired, and sometimes not on my LAN at all.
Is there anything I should try, or should I log a bug?Wednesday, September 10, 2008 6:59 PM -
Hi imabanana,
We're continually working to improve sync performance (and we have had a few very serious issues revolving around synchronization for the last week). We also know that we need to improve the status information that is provided during sync operations (right now the information is pretty much useless).
Having said that, I would suggest that you go ahead and open a bug, and send us your logs - just to be sure. More information is better as we work to improve things.
Thanks,
Ben.Wednesday, September 10, 2008 7:50 PM -
OK, I opened bug 367081 and uploaded logs.Wednesday, September 10, 2008 9:15 PM
-
Hey!
I just tested out syncing last night between 2 system and shut off syncing to the cloud.
Both systems are on the same Gigabit switch but the data still seems to be going up to the cloud and back down.
That will kill my internet connection whenever I do big changes on Video file folders.
is there a way to make mesh look locally first before it searches for a PC thru the web?
I'd love to ditch Live Sync and Sync Toy and just use one program for everything!
thx!
Steve
Wednesday, March 4, 2009 4:26 AM -
Hey Steve,
I'd probably start a new thread for this problem so that it can be debugged separately to the above. I'd also be logging a bug with logs from both machines (instructions here) - so that the team can figure out why the connection is not going true p2p.
The basics to check are:
1. what are the firewall restrictions on both machines?
2. what antiviruse restrictions exist?
3. can the two machines ping each other (i.e. does the switch do any funky routing?)
Cheers!
Oren
Wednesday, March 4, 2009 9:09 AM -
Hi Steve121212,
I can report that the newer Mesh versions (I'm currently running 0.9.3424.14) do a good job of LAN peer-to-peer syncing. It took less than a couple of hours to sync my 17GB Pictures folder.
Are you sure you have "Never with this device" selected for Live Desktop? If yes, then you should start another thread as suggested by nachmore.
The only thing missing for me now is the ability to sync Hidden files and folders. Unfortunately my picture-editing software uses them, and the are not synced, so I lose changes when I move from one system to another...
Wednesday, March 4, 2009 12:03 PM