Sign in
Microsoft.com
 
Microsoft
 
 
 

locked
How to improve performance for bulk data load in Dynamics CRM 2013 Online RRS feed

 > 

  • Question

  • Question
    Sign in to vote
    0
    Sign in to vote

    Hi all,

    We need to bulk update (or create) contacts into Dynamics CRM 2013 online every night due to data updated from another external data source.  The data size is around 100,000 and the data loading duration was around 6 hours.

    We are already using ExecuteMultiple web services to handle the integration, however, the 6 hours integraton duration is still not acceptable and we are seeking for any advise for further improvement. 

    Any help is highly appreciated.  Many thanks.

    Gary

    Thursday, February 12, 2015 4:42 AM

All replies

  • Question
    Sign in to vote
    0
    Sign in to vote

    Hello,

    Have you tried import thread separation already?

    Dynamics CRM MVP/ Technical Evangelist at SlickData LLC
    My blog

    Thursday, February 12, 2015 5:15 AM
    Moderator
  • Question
    Sign in to vote
    0
    Sign in to vote

    Hello,

    Have you tried import thread separation already?

    Dynamics CRM MVP/ Technical Evangelist at SlickData LLC
    My blog

    Hi Andrii, import thread separation?

    Thursday, February 12, 2015 5:40 AM
  • Question
    Sign in to vote
    0
    Sign in to vote

    I think Andrii's referring to running multiple threads in parallel (see http://www.mscrmuk.blogspot.co.uk/2012/02/data-migration-performance-to-crm.html - it's a bit dated, but should still be relevant).

    Microsoft do have some throttling limits applied in Crm Online, and it is worth contacting them to see if you can get those raised.

    100 000 records per night seems a large number. Are all these records new or updated records, or are there some that are unchanged, in which case you could filter them out before uploading ? Or are there useful ways to summarise the data before loading ?

    Microsoft CRM MVP - http://mscrmuk.blogspot.com/ http://www.excitation.co.uk

    Thursday, February 12, 2015 7:11 AM
    Moderator