DevForce Community Forum : ImportEntities slowness

ImportEntities slowness : We got it. Thanks!

Thu, 08 Jul 2010 19:47:11 -700

Author: ting
Subject: 1939
Posted: 08-Jul-2010 at 7:47pm

We got it. Thanks!

ImportEntities slowness : Thanks. I have submitted the solution...

Thu, 08 Jul 2010 10:15:21 -700

Author: mikewishart
Subject: 1939
Posted: 08-Jul-2010 at 10:15am

Thanks. I have submitted the solution on ticket #7159

ImportEntities slowness : Wow, that's not the code...

Wed, 07 Jul 2010 19:37:08 -700

Author: ting
Subject: 1939
Posted: 07-Jul-2010 at 7:37pm

Wow, that's not the code I was expecting. However, that shouldn't affect the timing on the second import. Do you have a small solution that you can send over to support so that we can look for anything that stands out?

ImportEntities slowness : Not importing from offline storage,...

Tue, 06 Jul 2010 23:32:42 -700

Author: mikewishart
Subject: 1939
Posted: 06-Jul-2010 at 11:32pm

Not importing from offline storage, just directly from the "fromManager". The entities in fromManager were queried for in standard ways. I tried this anyways:

var toManager = new DomainModelEntityManager(fromManager);
var entityList = new List();
foreach (var propertyInfo in fromManager.GetType().GetProperties())
{
if (propertyInfo.PropertyType.BaseType == typeof(EntityQuery))
{
    var entities = ((IEnumerable)fromManager.GetType().GetProperty(propertyInfo.Name).GetValue(fromManager, null)).Cast().ToList();
    entityList.AddRange(entities);
}
}
Console.WriteLine("Importing " + entityList.Count() + " entities " + DateTime.Now.ToString("HH:mm:ss:ffff"));
toManager.ImportEntities(entityList, MergeStrategy.OverwriteChanges);
Console.WriteLine("Importing 2nd time " + entityList.Count() + " entities " + DateTime.Now.ToString("HH:mm:ss:ffff"));
toManager.ImportEntities(entityList, MergeStrategy.OverwriteChanges);
Console.WriteLine("Done " + DateTime.Now.ToString("HH:mm:ss:ffff"));

Importing 2 entities 23:05:50:3062
Importing 2nd time 2 entities 23:05:52:3902
Done 23:05:53:9682

So, 2.08s first time, 1.58s second time.

Throwing in query gave the same timing results.

var toManager = new DomainModelEntityManager(fromManager);
var q = ((DomainModelEntityManager)toManager ).Customers.With(QueryStrategy.Normal);
q.ExecuteAsync(op =>
{
var entityList = new List();
foreach (var propertyInfo in fromManager.GetType().GetProperties())
{
    if (propertyInfo.PropertyType.BaseType == typeof(EntityQuery))
    {
      var entities = ((IEnumerable)from.GetType().GetProperty(propertyInfo.Name).GetValue(from, null)).Cast().ToList();
      entityList.AddRange(entities);
    }
}
Console.WriteLine("Importing " + entityList.Count() + " entities " + DateTime.Now.ToString("HH:mm:ss:ffff"));
toManager.ImportEntities(entityList, MergeStrategy.OverwriteChanges);
Console.WriteLine("Importing 2nd time " + entityList.Count() + " entities " + DateTime.Now.ToString("HH:mm:ss:ffff"));
toManager.ImportEntities(entityList, MergeStrategy.OverwriteChanges);
Console.WriteLine("Done " + DateTime.Now.ToString("HH:mm:ss:ffff"));
});

Importing 2 entities 23:29:41:5530
Importing 2nd time 2 entities 23:29:43:4812
Done 23:29:45:0553

ImportEntities slowness : We haven't been able to reproduce...

Tue, 06 Jul 2010 20:47:27 -700

Author: ting
Subject: 1939
Posted: 06-Jul-2010 at 8:47pm

We haven't been able to reproduce this on our end. My import takes 0.1 second.

If you are loading the entities from offline storage as the first thing in an application, you could be measuring the initialization time of the Entity Framework. Try merging twice or performing a query before the merge to see if the timing is different.

ImportEntities slowness : It seems like ImportEntities is...

Sat, 03 Jul 2010 11:43:26 -700

Author: mikewishart
Subject: 1939
Posted: 03-Jul-2010 at 11:43am

It seems like ImportEntities is very slow now. Regardless of importing 2 entities or 2000 entities to a new EntityManager, it takes around 2 seconds...

var toManager = new DomainModelEntityManager(fromManager);
// magic happens here... build up a list of entities to copy into entityList.
Console.WriteLine("Importing " + entityList.Count() + " entities " + DateTime.Now.ToString("HH:mm:ss:ffff"));
toManager.ImportEntities(entityList, MergeStrategy.OverwriteChanges);
Console.WriteLine("Done " + DateTime.Now.ToString("HH:mm:ss:ffff"));

results:
Importing 2 entities 11:35:14:8009
Done 11:35:16:7471

Importing 2071 entities 11:35:26:7271
Done 11:35:28:9743

Any idea what I could look for that would cause this?

Thanks!