Hi,
I spent some time building a C# application to import running it in parallel using the Parallel for each loop, asynchronous synchronous batched, tasks and all sorts of permutations of the threaded looping idea. There's a limit of 1000 for the execute
multiple methods as well as a limit of 2 execute multiple methods online which doesn't help.
Ironically using tasks was by the far the fastest of the C# attempts and then only when you loaded the threads hard. I had the CPU running at 80-90 % and the data throughput was the fastest.
However, I rolled my own SSIS component as even the above methods were too slow. Using the C# scripting parts I had nearly a 300% increase in throughput. SSIS is built primarily for this purpose and it does its job well.
If you're on a tight budget, rolling you're own component is not a massive learning curve and will save you time, or Kingsway soft if you have the money.
regards,
Don
