locked
Demigrator and qms.exe solution? RRS feed

  • Question


  • I've read through just about every thread dealing with the insane amount of
    cpu and disk usage caused by demigrator and qms.exe.  There appears to be
    absolutely no solution to making these processes cohabitate on a friendly
    basis within WHS.  With that, I've taken one idea I found on another forum
    and added my own kink.

    What I do is run a .bat file in Scheduled tasks that deactivates demigrator
    at 6am and reactivates it at 1am.  This gives the wretched process five
    hours out of the day to churn about, just in case it is actually doing
    something useful.

    Now, when demigrator is deactivated, qms goes absolutely berserk.  If both
    processes are active, qms only chews up 10-20% cpu, even though it's paging
    and I/Oing like crazy.  But when demigrator is stopped, qms gobbles up
    practically all of the cpu.

    So, using the Task Manager, I manually set qms.exe's priority to low, low,
    low.  If I set it to just below normal it still manages to strongarm the
    system to a standstill.  With it set as low as it can go, it sits there
    quietly and doesn't bother anyone.

    I'd like to permanently set the priority on qms.exe, but I don't really
    know how.

    Any comments on this setup?
    Tuesday, October 5, 2010 1:59 PM

All replies

  • Please tell us, which version number your Windows Home Server console shows under Settings/Ressources. What you describe sounds like the behavior of an unpatched server prior to Power Pack 1, so I would like to check this first.

    Other than that - self built or OEM?
    How many disks are in the system?
    How much memory?
    Any 3rd party applications added (i.e. Virus scanner)?
    Can you see any related errors or warnings in the event log?
    Did you at any time copy files manually to D:\Shares instead of using the UNC path?

    Best greetings from Germany
    Olaf

    Tuesday, October 5, 2010 2:29 PM
    Moderator
  • Hi Olaf -- Thanks for the reply.

    I have an HP Mediasmart EX485 with -- I believe -- 1gb of ram. It's completely stock It came with one 750gb SATA drive, and I added another 750gb and a 1.5tb drive.  I have the photos and music drives duplicated.

    The server software is 2.5.15.35297

    The only 3rd party software running is Squeezeserver, and it's a recent version. 

    There is about 800gb of flac files in Music, and <50gb in photos and public.

    I have only ever copied files into the \servername directories, which look like "Music on \'servername' (v:)" in Windows Explorer.  I did use Windows Explorer on a remote machine to make some new directories and move files about within the Music folder, but never from within the console.

    I've disabled Twonky and the iTunes servers.

    How do I get to the event log?  I'm still fairly new to this, although I am a mainframe COBOL programmer, so I'm not afraid to get my hands dirty.

    Thanks,

    Jason

    Edit: Found the event logs -- qsm.exe is huge, but nothing strikes me as wrong there.  DEUtil.nnnnn.nnn.log looks interesting -- :


    Volume - Id = f8067049-499d-47e3-bd33-c182115b4f6e Size = 698 GB Free = 166317 MB
    Volume - Id = e3bb9d8f-848c-43e6-a5d2-a26d3389e7bb Size = 1397 GB Free = 353501 MB
    [10/6/2010 4:30:22 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\10\28\239\26\reference.idx,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 609.3618ms
    [10/6/2010 4:30:42 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\11\37\26\25\25.dat,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 893.6658ms
    [10/6/2010 4:30:57 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\12\1605\26\reference.idx,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 1262.3492ms
    [10/6/2010 4:31:02 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\12\25\1653\reference.idx,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 954.1313ms
    [10/6/2010 4:31:07 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\13\25\152\25.dat,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 1115.7457ms
    [10/6/2010 4:31:12 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\13\35\221\container.idx,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 618.6744ms
    [10/6/2010 4:31:18 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\4\405.dat,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 1420.1567ms
    [10/6/2010 4:31:23 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\folders\{8BA2C80A-EBCE-4EB7-9688-34B7CA729661}\twonkymedia.db\default.view\1\6\32\243.dat,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 1896.4105ms
    [10/6/2010 4:31:29 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\shares\Music\Flac\Jason's Music\Brian Wilson\ Smile\Brian_Wilson_Smile_17_Good_Vibrations.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 1633.0812ms
    [10/6/2010 4:31:33 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\shares\Music\Flac\Jason's Music\Drive-By Truckers\Live from Austin TX\Drive-By_Truckers_Live_from_Austin_TX_03_A_Ghost_To_Most.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 555.0286ms
    [10/6/2010 4:31:41 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\shares\Music\Flac\Jason's Music\Erik Mongrain\Equilibrium\Erik_Mongrain_Equilibrium_02_Alone_In_The_Mist.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 7035.3771ms
    [10/6/2010 4:31:51 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\shares\Music\Flac\Jason's Music\Robert Silverman\ Beethoven's 32 Piano Sonatas (Disc 4)\Robert_Silverman_Beethoven's_32_Piano_Sonatas_(Disc_4)_01_Sonata_No.10_in_G_major,_Op.14,2____I-_Allegro.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 2515.1629ms
    [10/6/2010 4:32:00 AM 10bc] ***ERROR: DEfileFromShadow(D:\DE\shares\Photos\Ducati 696\P1050383.JPG,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 925.8062ms
    [10/6/2010 4:33:26 AM 10bc] Secondary Pass: (balancing) 229102.406ms
    [10/6/2010 4:33:26 AM 10bc] Full Primary and Secondary Pass 3160681.3446ms

    [10/5/2010 6:18:54 PM 16b4] ERROR: Unable to fully process file D:\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - Sometimes I Just Feel Like Smilin' - 1971\PAULBU~4.MP3 due to a fatal error - err=183
    [10/5/2010 6:18:54 PM 16b4] ERROR WITH: D:\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - Sometimes I Just Feel Like Smilin' - 1971\PAULBU~4.MP3 because of too few shadows (1) instead of 2
    [10/5/2010 6:18:54 PM 16b4] ErrorNeedsReporting is reporting fatal error 183 on file D:\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - Sometimes I Just Feel Like Smilin' - 1971\PAULBU~4.MP3 as an error
    [10/5/2010 6:18:54 PM 16b4] Info for D:\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - Sometimes I Just Feel Like Smilin' - 1971\PAULBU~4.MP3
    [10/5/2010 6:18:54 PM 16b4]     State = Migrated     NumberOfShadows = 1
    [10/5/2010 6:18:54 PM 16b4]     Shadow(0)     Volume(e3bb9d8f-848c-43e6-a5d2-a26d3389e7bb)    State(Healthy)
    [10/5/2010 6:18:54 PM 16b4] GetShadowState: \shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 03 Pity The Fool.mp3 shadow {F8067049-499D-47E3-BD33-C182115B4F6E},200000000e187 filename mismatch, \shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 03 Pity The Fool.mp3 vs \DE\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\PAULBU~1.MP3-1
    [10/5/2010 6:18:54 PM 16b4] GetShadowState: \shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 06 Double Trouble.mp3 shadow {F8067049-499D-47E3-BD33-C182115B4F6E},200000000e188 filename mismatch, \shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 06 Double Trouble.mp3 vs \DE\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\PAULBU~2.MP3-1
    [10/5/2010 6:18:54 PM 16b4] GetShadowState: \shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 08 Droppin' Out.mp3 shadow {F8067049-499D-47E3-BD33-C182115B4F6E},200000000e18a filename mismatch, \shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 1989\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - 08 Droppin' Out.mp3 vs \DE\shares\Music\MP3\Gilbert's MP3s\MP3\Blues and Jazz\Blues\Paul Butterfield Blues Band\Paul Butterfield Blues Band - The Resurrection Of Pigboy Crabshaw - [10/5/2010 6:20:29 PM 16b4] ***ERROR: DEfileFromShadow(D:\DE\shares\Music\Flac\Jason's Music\Andrew Hill\Judgment!\Andrew Hill - 06 - Reconciliation.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 2487.7586ms
    [10/5/2010 6:20:42 PM 16b4] ***ERROR: DEfileFromShadow(D:\DE\shares\Music\Flac\Jason's Music\Puccini\Madama Butterfly - Barbirolli\Puccini - Madama Butterfly - booklet 4.jpg,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 5613.4042ms
    [10/5/2010 6:20:58 PM 16b4] OpenedFile::Lock: Error 300 from SendToFilter(BatchOplock) on c:\fs\18\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac
    [10/5/2010 6:20:58 PM 16b4] nonfatal - DEFileFromShadow(c:\fs\18\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) threw - err=170
    [10/5/2010 6:20:58 PM 16b4] Nonfatal exception in Secondary Pass on c:\fs\18\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac: error =170
    [10/5/2010 6:21:35 PM 16b4] OpenedFile::Lock: Error 300 from SendToFilter(BatchOplock) on c:\fs\16\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac
    [10/5/2010 6:21:35 PM 16b4] ***ERROR: DEfileFromShadow(c:\fs\16\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) took too long. 551.8394ms
    [10/5/2010 6:21:35 PM 16b4] nonfatal - DEFileFromShadow(c:\fs\16\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac,4731dc43-0dd0-4ca9-9849-def22cb39eeb) threw - err=170
    [10/5/2010 6:21:35 PM 16b4] Nonfatal exception in Secondary Pass on c:\fs\16\DE\shares\Music\Flac\Gilbert's Music\Gilbert CDs\Shirley Horn\I Remember Miles\Shirley Horn - I Fall In Love Too Easily.flac: error =170
    [10/5/2010 6:22:14 PM 16b4] Secondary Pass: (balancing) 176205.0972ms
    [10/5/2010 6:22:14 PM 16b4] Full Primary and Secondary Pass 1061866.916ms
    [10/5/2010 6:30:29 PM 14bc] OnStop() called.
    [10/5/2010 6:30:29 PM 14bc] Service stopping.
    [10/5/2010 6:30:29 PM 14bc] **Stopping a Migration Pass***
    [10/5/2010 6:30:29 PM 14bc] StopMigrationPassTimer called
    [10/5/2010 6:30:29 PM 14bc] ...waiting for migration pass to complete
    [10/5/2010 6:30:29 PM 16b4] Sleeping between passes 494844.8719ms
    [10/5/2010 6:30:29 PM 14bc] migration pass stopped
    [10/5/2010 6:30:29 PM 14bc] StopMigrationPass 384.5614ms
    [10/5/2010 6:30:30 PM 14bc] Service stopped.


    Tuesday, October 5, 2010 10:26 PM
  • Hi Jason,

    the timing issues could point to hardware issues. Maybe one of the disks is overheating in the narrow case, has not a good contact to the SATA connector or is running somehow delayed due to other reasons.

    Or is one of the disks one of the new disks with so called "Advanced Format" (the 1.5 TB disk would be the favorite candidate in question)? If so, you should remove it from the pool and set the jumper to support the old format, if you did not so before integration.

    The event logs I mean you can find on the server desktop in Control Panel/Administrative Tools/Event Viewer.

    Best greetings from Germany
    Olaf

    Wednesday, October 6, 2010 12:27 PM
    Moderator
  • Olaf,

     

    The disk is a Seagate Barracuda 1.5tb, OEM packaged SATA drive.  I checked the manual and can only find information on one jumper which lowers the transfer speed. I find it unlikely that this is the culprit, but please advise.

    The event logs show nothing crucial, just a whole bunch of warnings that I managed to turn off by hunting through another thread to which you also contributed.

    So here's what I did -- First off I fixed all my file conflicts, then I removed the 1.5tb drive from the pool, turned off duplication on all folders and let it sit for a while.  Now I'm running the 1.5tb drive as a backup, and am backing up all the server files to it.  Let's see what happens here.

    Thanks,

    Jason

    Thursday, October 7, 2010 11:12 AM
  • In addition to SqueezeCenter, you also have TwonkyMedia installed on your server; it's installed by HP as part of their "value add". Your issues may be (probably are) a result of having multiple media streaming tools installed. You could try removing one, probably Twonky since you likely don't use it. If it's visible as an add-in in the console, remove it from there, otherwise remove it via remote desktop by uninstalling from add/remove programs.
    I'm not on the WHS team, I just post a lot. :)
    Thursday, October 7, 2010 12:23 PM
    Moderator
  • Hi Jason,

    the exact model name of the disk would help (ST....), usually sticking on a label on the disk.

    Best greetings from Germany
    Olaf

    Friday, October 8, 2010 7:35 PM
    Moderator
  • Olaf,

    In retrospect, I do believe that I have copied files from within the server console, using Windows Explorer, from the desktop to D:\shares\Music -- is this a problem?

    There is no pre-made shortcut to a c: alias. How would I go about creating one? Is it as simple as mapping a network drive to \\servername\Music?

    Also, I uninstalled Twonky, but since I had it disabled, I doubt it was the culprit.

    Thanks,

    Jason

    Monday, October 11, 2010 12:42 PM
  • Hi Jason,

    C: you would see in Windows Explorer, if you logon locally on your server.
    Copying stuff directly to d:\shares can cause trouble, since Windows Home Server here stores and expects tombstones only, which point to the real file on the real disk. Filed directly copied to D:\shares are not moved to a different disk by the WHS mechanics and therefore blocking the disk space on D:.

    Therefore you should try to delete them and copy them over again.

    Best greetings from Germany
    Olaf

    Monday, October 11, 2010 8:12 PM
    Moderator
  • Olaf,

    Sorry to be a pest, but I don't see a c:\..music or c:\..photos anywhere in the tree.  If I remember correctly, that's why I originally copied to the d: directories. 

    I can copy from outside the server directly into the \servername\music directory, but I'd like to have the option of using the WHS console. 

    Jason

    Tuesday, October 12, 2010 2:50 AM
  • Ah well, now I understand your misunderstanding, I think. You would also never copy to C:\fs\somewhere! UNC path means network based to the share, i.e. \\servername\music or \\servername\photos. This can be done from a client PC or from the server desktop (unsupported).

    Best greetings from Germany
    Olaf

    Tuesday, October 12, 2010 9:27 PM
    Moderator