Mike Taulty Compares LINQ to SQL and LINQ to Entities

Apparently, Mike's recent vacation recharged his batteries because he's kept the promise he made in his June 22, 2007 blog.Suspend() post. He's moved on from his previous exhaustive coverage of LINQ to SQL to the more challenging task of analyzing the Entity Framework (EF) and LINQ to Entities.

Mike's August 3, 2007 LINQ to SQL/LINQ to Entities post contrasts LINQ to SQL and LINQ to Entities with the following basic premise:

LINQ to SQL is very much a consumer of ADO.NET in that it fits into the existing ADO.NET picture by sitting on top of the SQL provider (SqlClient).

The Entity Framework is a different beast in that it plugs in new bits to ADO.NET. It adds a new provider (the Entity Provider) altogether and a new language that this provider understands (Entity SQL). So, you can expect to see EntityCommand, EntityDataReader, EntityAdapter and so on.

The unusual thing about this new provider is that it's a layered provider in that its job is to sit above existing providers.

He then goes on to diagram the flow from a LINQ to Entities query expression as an Entity SQL (eSQL) command tree to an Entity Provider that translates the eSQL to the database's SQL dialect (e.g., T-SQL, PL/SQL, DB2 SQL.) Mike describes the process:

Regardless of the correctness of the [diagram], we've got a query captured as an expression tree from a LINQ perspective and then that needs to be turned into what I'd call a conceptual command tree which is a transformation from the LINQ query to an Entity Provider query dealing with the conceptual and then there's a transformation from that to a logical command tree which is then handed to the "real" provider which generates the right kind of SQL for that thing.

Based on my understanding of database-specific EntityClient providers, Mike's narrative sounds right to me, although I believe that Microsoft calls the conceptual command tree the Canonical Query Tree (CQT). There's more about QCTs and their role in query processing in Murali's August 21, 2006 Queries in ADO.NET vNext post.

An Earlier Attempt to Diagram Data Flow in the Entity Data Model

For reasons unknown, Microsoft has never published an official, detailed data-flow diagram for the EF and Entity Data Model (EDM). The Microsoft Patent Application for the Entity Framework and EDM includes several simplified diagrams (with extreme overuse of the term "rich") but nothing one could use to better understand how EF, EDM and LINQ to Entities interact.

I made a stab at diagramming the EF and EDM for my "Objectify Data With ADO.NET vNext" article in the October 2006 issue of Visual Studio Magazine. The article was based on the ADO.NET vNext August 2006 CTP, which predated the ADO.NET team's replacement of DataProviders with Entity Providers use of the term EntityClient.

Courtesy of 1105 Media, Inc.

Changing the System.Data.SqlClient Data Provider to an EntityClient Provider for SQL Server 200x legend and changing the T-SQL to eSQL legend on the arrow between the Map Provider Layer and the Data Provider box might bring this diagram into closer alignment with today's EF and EDM implementation. Comments, suggestions or both from Danny Simmons,  Zlatko Michailov, or both would be appreciated.

What Entity Framework Pilgrims Need from Microsoft

Prior to Tech*Ed 2007, I made a list of what I believed was needed from the ADO.NET Team for the delayed and orphaned Entity Framework to gain any traction at all with developers of data-intensive .NET projects. I published the list in a May 29, 2007 Defining the Direction of LINQ to Entities/EDM post to which Microsoft's Mike Pizzo responded with a detailed comment.

So here's another request: Mike Taulty and I currently must guess at our data flow diagrams. It's more than about time for Microsoft to publish a detailed, annotated EF/EDM/LINQ to Entities data flow diagram with the proper names of the components. Diagrams that illustrate how EF integrates with Projects Jasper and Astoria (and why) would be useful, too. 

Note: The diagrams in John Papa's ADO.NET Entity Framework Overview in MSDN Magazine's July 2007 "Data Points" column don't provide sufficient detail. However, his column does provide a summary of the Orcas Beta 1 version's features.

So far, I'd give the ADO.NET team a "C" or lower grade for responding to my requests. The Entity Framework June 2007 CTP was useful, despite its inability to run on Orcas editions other than Web Developer Express. (See my Entity Framework June 2007 CTP Visual Basic Samples post for example eSQL queries with results in DataGrid controls.)

Danny Simmons "June" CTP of the Entity Framework is finally out provided a detailed list of new features in the CTP, but he hasn't added a post in a month. He did say in an Orcas Beta 2!!! thread in the ADO.NET Orcas forum: 

Since the Entity Framework is now shipping separately from Orcas, the Orcas beta 2 does not include any Entity Framework bits, and unfortunately the existing CTP will also not work with beta 2.  We will, however, have a beta version of the entity framework sometime in August that will work with beta 2 (and have some additional goodies <grin>).

However, it's August 3 and there's nothing official so far in the ADO.NET Team Blog about the forthcoming EF CTP or Beta, and not even a hint from Danny whether this drop will finally include a preview of the long-awaited EDM Designer.

Update 8/3/2007 1630 PDT: Mike Pizzo responds in a comment to this post.

Update 8/8/2007: Mike Taulty updated his post with these EF observations:

[If] you have a 1:1 mapping between the conceptual model and the logical model you can simply pass the tree on unaltered. That's kind of neat and I don't suppose it's by accident :-)

I'm reading quite a bit about Entity Framework at the moment and it's causing me headaches :-) [Emphasis added.]

Me, too.

Following are links to a few recent OakLeaf posts about EF, EDM and LINQ to Entities in reverse date sequence:

• Orcas and Entity Framework June 2007 CTPs - New Features July 9, 2007
• Entity Framework and Orcas Team Suite June 2007 CTPs July 8, 2007
• ADO.NET Entity Framework June 2007 CTP Available for Download July 2, 2007
• Entity Framework: Complex Types Redux in Beta 2 June 17, 2007
• Entity Framework Updates (Tech*Ed, June 2, 2007)
• Using the Entity Framework with IronPython 1.1 in Project Jasper May 11, 2007
• LINQ to SQL:Entity Framework::REST:SOAP? May 4, 2007
• Persistence Ignorance Is Bliss, but Is It Missing from the Entity Framework? March 14, 2007, last updated April 24, 2007
• ADO.NET vNext and Entity Framework Resources August 31, 2006, last updated April 11, 2007

Update 8/4/2007 0630 PDT: EF Beta 2 release in August is official. From Elisa Flasko, ADO.NET Team program manager in Entity Framework Beta 2:

As promised, we will have Beta releases of the Entity Framework that correspond to the Beta 2 and RTM releases of Orcas. A Beta 2 release of the Entity Framework that works with the recent release of Orcas Beta 2 will be available later this month, along with a list of the new features available in that release.

Pablo Castro says We'll host an experimental Astoria data service for you. Mike Flasko,
Astoria Program Manager, is offering free "in-the-cloud" storage of relational databases up to 100 MB in size and providing RESTful CRUD features. I'm considering putting the 50MB version of my "OakLeaf University" sample database up there.

Technorati Tags: Entity Framework, Entity Data Model, EDM, EDM Designer, Entiy SQL, eSQL, LINQ to Entities, LINQ, VS 2008 Beta 2, Project Jasper, Project Astoria