Omitting many details, the logic of the multithreadiding is given below:
$buff = [System.IO.File]::ReadAllLines("$path\Setupact.log");
........
$NThreads = 5;
$Script =
{
Param (
[string]$output,
[int]$From,
[int]$Till,
[String[]]$Data
)
$need = "***,Ini,Set,Tru,Ope,End,TI:";
$i = $From;
foreach( $s in $Data[$From..$Till])
{
$lng = $s.Length;
if ( $lng -gt 50 )
{
$l = $s.Substring(50);
# ....+....1....+....2....+....3....+....4....+....5
# 2016-08-12 08:17:03, Info [0x0803b4] MIG COnlineWinNTPlatform: ComputerName=R500D
# 2018-05-01 09:30:27, Info [0x0803b8] MIG Processing profile: C:\Users\Евгений
if ( "3b4,3b8".IndexOf( $s.Substring( 38,3 ) ) -ge 0 )
{
$CommObj.$output.RawData += $s;
$CommObj.$output.Indexes += $i;
}
elseif (
$l.StartsWith( "VERBOSE: OS part root (NT)"
) -or`
$l.StartsWith( 'Plugin {ff9c714f' ) -and $l.Contains( "\Disk" ) -or`
$l.StartsWith( '[SetupPlatform.exe] Enumerate and log' )
)
{
$CommObj.$output.RawData += $s;
$CommObj.$output.Indexes += $i;
}
elseif ( $l.StartsWith( "CSetupDiag" ) )
{
if ( $l.Contains( "SkuName" ) -or $l.Contains( "OsLanguage" ) )
{
$CommObj.$output.RawData += $s;
$CommObj.$output.Indexes += $i;
}
}
elseif ( $need.IndexOf( $l.Substring( 0, 3 ) ) -ge 0 )
{
$CommObj.$output.RawData += $s;
$CommObj.$output.Indexes += $i;
}
}# End-Of-IF(if( $lng -gt 50 )
++$i;
}; # End--of-%{
}# End-Of-ScriptBlock
$CommObj =
@{
output0 = @{RawData=@(); Indexes=@()};
output1 = @{RawData=@(); Indexes=@()};
output2 = @{RawData=@(); Indexes=@()};
output3 = @{RawData=@(); Indexes=@()};
output4 = @{RawData=@(); Indexes=@()};
output5 = @{RawData=@(); Indexes=@()};
output6 = @{RawData=@(); Indexes=@()};
output7 = @{RawData=@(); Indexes=@()};
}
$sessionState = [System.Management.Automation.Runspaces.InitialSessionState]::CreateDefault();
$sessionstate.Variables.Add((New-Object -TypeName System.Management.Automation.Runspaces.SessionStateVariableEntry `
-ArgumentList "CommObj", $CommObj, "object" ) );
# Create runspace pool consisting of $NThreads runspaces
$RunspacePool = [RunspaceFactory]::CreateRunspacePool( 1, $NThreads, $sessionState, $Host );
$RunspacePool.Open();
$Jobs = @();
$chunkl = [math]::Round( $bfl / $NThreads ); # $bfl = $buff.Length;
$from = 0;
for( $n = 0; $n -lt $NThreads; $n++ )
{
$size = $chunkl;
if ( $n -eq 0 )
{
$size = $bfl - ( $NThreads - 1 ) * $chunkl;
}
$output = "output$n";
$till = $from + $size - 1;
$Job = [powershell]::Create().AddScript($Script);
$Job = $Job.AddParameter("output",$output).AddParameter("From",$from).AddParameter("Till",$till).AddParameter("Data",$buff );
$Job.RunspacePool = $RunspacePool;
$Jobs += New-Object PSObject -Property @{
RunNum = $n;
Job = $Job;
Result = $Job.BeginInvoke();
}
$from += $size;
}
Do
{
Start-Sleep -m 100;
} While ( $Jobs.Result.IsCompleted -contains $false) #Jobs.Result is a colection
$RawData = @();
$Indexes = @();
1..$NThreads | %{
$n = $_ - 1;
$key = "output$n";
$RawData += $CommObj.$key.RawData;
$Indexes += $CommObj.$key.Indexes;
}
$RawData contains no more then 2000 lines and a lot of unnecessary information. Thus this array is then thorough parsed but as the number of the line are negligable, it took milliseconds, below are given durations of the different steps
in milliseconds:
Best duration 2858, current 3155
Get-BuildProperties : 15
ReadAllLines : 550
Get-Hardware : 179
Get-OOBE-boot : 1
Get-MicrosoftAccount : 91
MainLoop : 1875 <----- this is multithread collecting of the RawData
RawDataParsing : 73 <------ this is thorough parsing of the RawData
UnattendGC : 124
Get-ReportingEvents : 173
Get-SystemEvents : 52
ReparseEvents : 0
And here are the main target of the task:
--- Installation brief description ------------------------------------------------------------
Download : 2018-08-17 00:12:26 2018-08-17 00:36:56 24 minutes 30 seconds
Installing 0-100% : 2018-08-17 00:27:39 2018-08-17 00:55:05 27 minutes 26 seconds
Step 0-30 % : 2018-08-17 00:55:50 2018-08-17 01:03:29 7 minutes 39 seconds
Step 30-75 % : 2018-08-17 01:03:29 2018-08-17 01:06:55 3 minutes 26 seconds
Step 75-100 % : 2018-08-17 01:06:55 2018-08-17 01:12:04 5 minutes 9 seconds
Setup Logging : 2018-08-17 00:17:15 2018-08-17 01:12:04 54 minutes 49 seconds
Upgrade Duration : 2018-08-17 00:12:26 2018-08-17 01:12:04 59 minutes 38 seconds
1st reboot : 2018-08-17 00:55:50 2018-08-17 00:56:19 29.000 seconds
2nd reboot : 2018-08-17 01:03:29 2018-08-17 01:03:42 13.000 seconds
3rd reboot : 2018-08-17 01:06:55 2018-08-17 01:07:07 12.000 seconds
OOBE boot : 2018-08-17 01:07:23 2018-08-17 01:09:01 1 minutes 38 seconds
Updated, Installed : 2018-08-17 00:42:46 2018-08-17 01:09:35 26 minutes 49 seconds
Offline Installation : 2018-08-17 00:55:50 2018-08-17 01:09:01 13 minutes 11 seconds
Script continued : 3155 milliseconds (15:00:45.713,15:00:48.869)
Setupact.log lines read : 585030
System Events analyzed : 30
But full report contains more then a hundred lines and include hardware description read from the log, storage devices description, a lot of the OS properties and so on + all of the converted RawData lines which EXPLAINS the durations in the table of
the Upgrade process steps. Get-Hardware function which collects most part of the hardware and system info, also use 4-threads to parse 8000 lines at the beginning of the log: this minimize number of comparisons in the 5 -threads Main Loop.
