Showing posts with label Table Storage Services. Show all posts
Showing posts with label Table Storage Services. Show all posts

Saturday, November 15, 2008

LINQ and Entity Framework Posts for 11/13/2008+

Note: This post is updated daily or more frequently, depending on the availability of new articles.

•• Update 11/15/2008 5:00 PM PST: Additions to SDS/Cloud Computing section
• Update 11/14/2008 8:00 AM PST: Additions

Entity Framework and Entity Data Model (EF/EDM)

• Matthieu Mezil explains How to simulate a 1 to 0..1 relationship when you must have a 1 to 1 using EF in his 11/14/2008 post. His approach automatically creates a missing entity to prevent exceptions when saving changes.

• Kim Major continues his series about Renaissance Computer Systems, Ltd. (Hashmonaim, Israel) use of a a repository interface to the Entity Framework in his Testable Data Access With The Repository Pattern of 11/13/2008.

Kim includes the code to implement an in-memory version of the repository, which is one of the topics covered in Chapter 4, “Working with Advanced Query Operators and Expressions” of my forthcoming Professional ADO.NET 3.5 with LINQ and the Entity Framework book from Wiley/WROX.

The first member of Kim’s series is Data Access With The Entity Framework post of 11/12/2008.

Matthieu Mezil’s How to split a data table? post of 11/13/2008 describes how to split a single table into two EDM entities to enable delayed loading of part of the table.

LINQ to SQL

No significant new posts as of 11/13/2008 5:00 PM PST. 

LINQ to Objects, LINQ to XML, et al.

• Eric White’s 11/14/2008 post offers The SkipLast Extension Method that lets you skip the last n items of a LINQ to XML query resultset without performing an initial Count() operation.

Rob Conery demonstrates the RAD capabilities of T4 templates by responding to a user’s request to add IEnumerable<T> overloads to the Add, Delete, and Update methods on the repository class in his SubSonic 3.0 Repository Template Update post of 11/13/2008.

Rob Conery’s SubSonic 3.0 Preview 2 post of 11/12/2008 describes his flagship O/RM tool’s LINQ to SubSonic features, such as LINQ queries that perform updates, inserts and deletions, as well as batched queries that return DataReaders to which you can apply the ToList<T> method. Rob also provides an IRepository<T> interface.

Another interesting feature is that v3p2 uses T4 templates to generate all except “core data access” code. If you don’t like Rob’s codegen, you can roll your own templates.

ADO.NET Data Services (Astoria)

• Gil Fink expands on his earlier Service Operations post (see below) with Consuming Data Services Service Operations of 11/14/2008, which explains how to consume ADO.NET data services service operations from clients.

• Pablo M. Cibrano offers a walkthrough that describes Using the WCF OAuth channel with an ADO.NET service which is based on his detailed OAuth channel for WCF RESTful services essay about  of 11/14/2008. Pablo says:

My WCF channel implementation for OAuth mounts on top of Alex Henderson’s OAuth library and it basically transforms a OAuth token into a .NET security principal that can be used later within the service implementation. The channel is implemented as a RequestInterceptor, one of new features introduced in the REST WCF Starter Kit.

• Gil Fink’s Service Operations – Adding Business Logic to a Data Service post of 11/14/2008 explains service operations and how to use them to add business logic to ADO.NET Data Services.

ASP.NET Dynamic Data (DD)

Wally McClure’s ASP.NET Podcast Show #127 - Dynamic Data post of 11/10/2008 includes source code for the Global.asax file discussed by the participants.

SQL Data Services (SDS) and Cloud Computing

•• Mike Amundsen posted a SDS Photo Demo posted thread in the SQL Data Services (SDS) - Getting Started forum on 11/15/2008. Mike says:

This demo stores @200 original images (plus another 400 thumbnail and preview versions) along with JS and CSS files directly in SDS storage (about 80MB in all). A small C# ASP.NET handler accepts anonymous requests, processes them and, when needed initiates authenticated requests to an SDS-Proxy that then talks directly to SDS servers to get the images, scripts, and stylesheets.

You can test-drive the demo at http://amundsen.com/examples/sds-photos/.

Jim Nakashima warns that Visual Studio "Publish" of a Large Windows Azure Cloud Service may Fail if the size of the package is too large (11/15/2008). The workaround is to use the cspack.exe command-line packing utility.

•• Sriram Krishnan’s Compressed GZip content from Windows Azure blob storage post of 11/15/2008 observes:

Windows Azure currently doesn't compressing uncompressed data on the fly for you. However, there's nothing stopping you from storing the data compressed in the first place. The key is to set the Content-Encoding header to 'gzip' when uploading the blob so that when the blob storage serves it back out, clients know that the content they're getting is compressed and know how to deal with it.

and post the sample code required to compress blob files for storage.

•• Ryan Dunn has a fix for the Azure Services Training Kit’s missing AjaxControlToolkit.dll in his Fixing the SDS HOL from Azure Training Kit post of 11/14/2008. See David Aiken’s announcement later in this section.

• Shan McArthur wonders How can we use Live ID for web authentication in the Azure deployment model? in his detailed thread in the Windows Azure forum. It appears from Shan’s post that the cards are stacked against Live ID authentication in the current Azure Services version.

• Aaron Ricadela analyzes VMware's Lofty Cloud Computing Goals for Paul Maritz’s forthcoming Virtual Data Center Operating System in this Business Week article of 11/13/2008. The VDC OS appears to me to be an Amazon EC2 clone with and on-premises option.

Roger Jennings’ unfinished Azure Storage Services Test Harness: Table Services 1 of 11/13/2008 describes a test harness that’s currently undergoing feature bloat. The post provides a table that compares execution times for various Table Services operations on data uploaded from the Northwind Customers table (instead of trivial Contacts or blog Items/Comments tables.)

You’ll be surprised a how close the performance of Azure Storage and Fabric are to the same operations run with Development Storage and Fabric over a relatively slow DSL connection to the Windows Azure service.

David Aiken announces fixes to the Azure Services Training Kit in his Hands on Labs Updated post of 11/13/2008. The update contains updates and bug fixes to the original kit, which includes labs for Windows Azure as well as .Net Services, SQL Services, and Live Services.

Gus Perez’s Windows Azure Links page is:

[A] single page I update with links to good info on Windows Azure from other peers at Microsoft as well as those coming from the community instead of posting individual entries every once in a while.

As of 11/13/2008, the OakLeaf Blog was one of Gus’s six “Community” sites.

John Foley brings folks up to date on IBM’s recent cloud-computing machinations with his IBM Turns To Cloud Management post of 11/13/2008 to InformationWeek’s “Plug into the Cloud” blog.

Sriram Krishnan began a Python wrapper for Windows Azure storage project on 11/12/2008 and is hosting the source code at this GitHub repository. Sriram says:

I've gotten [the project] to the point where I can authenticate against a storage endpoint, be it development storage on your local machine or the *.core.windows.net endpoints in the sky. I spent some time today implementing the basic blob primitives (list containers, get/put blob but there is a long way to go before it is usable).

Jim Nakashima’s Using the CloudDrive Sample to Access Windows Azure Logs post of 11/12/2008 provides step-by-step instructions for copying log files to Blob Storage services and using PowerShell and the CloudDrive sample to copy them to a local folder.

John Spurlock has updated his SpaceBlock front-end to handle S[S]DS and Azure Blob storage, in addition to Amazon S3 and Nirvanix service accounts. You can install the project with ClickOnce or download source code from the CodePlex.SpaceBlock site.

SQL Server Compact (SSCE) 3.5 and Sync Services

No significant new posts as of 11/13/2008 3:00 PM PST. 

Miscellaneous (WPF, WCF, MVC, Silverlight, etc.)

Simon Segal’s WCF Transactions - Treat with care post of 11/13/2008 is a detailed treatise on issues that arise when transacting long-running services with WCF.

Sunday, November 02, 2008

Cloud Computing at PDC and Elsewhere: Day 4 (10/30)

A daily compendium of PDC keynotes and sessions about Cloud Computing, SQL Data Services, and related topics. This post will be updated frequently from 8:00 AM to 5:00 PM PDT or later. Unless otherwise noted all sessions were on 10/29/2008.

SQL Data Services and Related Session Videos From Channel9

Channel9 is posting videos of PDC 2008 interviews and sessions about 24 hours after the session’s end. Following are segments from Wednesday’s sessions that are related to SQL Data Services (SDS):

Pablo Castro and Niranjan Nilakantan: ES07 Windows Azure: Modeling Data for Efficient Access at Scale (Wed 10/29 | 1:15 PM-2:30 PM | 403AB):

Learn how to use the highly scalable, available and durable Table Storage service. This session presents a deep dive with demos into the programming APIs and data models for structured storage.

Unfortunately, the screen captures are drastically overexposed. For more background about ADO.NET Data Services (Astoria) as a front-end for Table Services and SQL Data Services, read Pablo’s ADO.NET Data Services in Windows Azure: pushing scalability to the next level post of 11/1/2008.

Patrick McElroy: SQL Services: Futures (Wed 10/29 | 10:30 AM-11:45 AM | 408B):

Learn about new capabilities in upcoming versions of SQL Services. See demonstrations of services like advanced query processing, sync services, and reporting services running in the cloud. Also learn about plans to integrate with other services.

Andrew E. Fitzhugh: How HP Built their Magcloud Service on Windows Azure (Wed 10/29 | 10:30 AM-11:45 AM | 411). Here’s the abstract:

Hear from an online magazine publishing service that was prototyped on Microsoft cloud services. Learn from the development team about what they built, why they built it, and what they learned about the platform along the way.

You can learn more about the project by reading Kurt Mackie’s PDC: HP Startup Tests Windows Azure Cloud Platform article of 10/31/2008.

Other .NET Services Session Videos From Channel9

Following are segments from Wednesday’s sessions that are related to Azure cloud computing services other than SQL Data Services (SDS):

Clemens Vasters: .NET Services: Connectivity, Messaging, Events, and Discovery with the ServiceBus (Wed 10/29 | 10:30 AM-11:45 AM | 406A):

Learn how to use the ServiceBus in the Microsoft .NET Services to address difficult connectivity, security, and discoverability issues.

Michael Conrad, John Shriver-Blake: Showcase: Windows Azure Enables Live Meeting (Wed 10/29 | 12:00 PM-12:45 PM | 408A):

The next generation conferencing team discusses why the cloud computing platform was selected for a next-generation, high-scale conferencing service that requires high performance and reliability and the ability to automatically adjust scale. The team shares learnings from the prototyping phase and discusses features on the cloud services roadmap that are central to their success.

Steve Garrity, Mark Gilbert: .NET Services: Logging, Diagnosing, and Troubleshooting Applications Running Live in the Cloud (Wed 10/29 | 1:15 PM-2:30 PM | 515B):

Learn the real world ways of tracking down and fixing problems on services and systems running live in the cloud. These black belt techniques and application patterns are used to simplify the operations and debugging of large scale services while they run. Also get a peek at how we run and monitor the .NET Services at Microsoft.

Justin Smith: .NET Services: Access Control In Microsoft .NET Services (Wed 10/29 | 3:00 PM-4:15 PM | 408B):

Learn how to manage access control to the ServiceBus, Workflow, and Data Services via the Access Control Service. This session illustrates the access control capabilities of these services, and several common patterns for building your application securely using the .NET Services, access control service.

Justin Smith: .NET Services: Access Control Service Drilldown (Wed 10/29 | 4:45 PM-6:00 PM | 515A):

This session shows how to use the access control service in your application. Learn how to secure your application or service using the Access Control service's APIs. We'll then drill into the protocols and security patterns the service uses along with explaining some of the service internals.

Sriram Krishnan: Windows Azure: Cloud Service Development Best Practices (Wed 10/29 | 3:00 PM-4:15 PM | Petree Hall CD):

This session goes beyond the "Hello World" development experience, giving best practices across common tasks for serious service developers. These tasks include logging, debugging, deployment, management, and maintenance of individual services.

 

Wednesday, October 29, 2008

Cloud Computing at PDC and Elsewhere: Day 2 (10/28)

A daily compendium of PDC keynotes and sessions about Cloud Computing, SQL Server Data Services, and related topics. This post will be updated frequently from 8:00 AM to 5:00 PM PDT or later. Unless otherwise noted all blog posts are dated 10/28/2008.

• Updated 10/29/2008 9:00 AM PDT: Additions of remaining 10/27 videos of Cloud Computing sessions

On-Demand Keynote 3 From Day 2

• Don Box and Chris Anderson: A Lap Around the Azure Platform (Day 2, Keynote 3)

Chris Anderson and Don Box take the microphone over in Keynote 3 and explore Microsoft's latest technologies through the eyes of working developers.

Don and Chris write the simplest possible program with HTTP URIs and XML that shows all the capabilities of the Azure Services platform. (This keynote, like Rick Rashid’s Day 3, Keynote 4, wasn’t streamed live.)

Session Videos From Channel9

Channel9 is starting to post videos of PDC 2008 interviews and sessions about 24 hours after the session’s end. Here are some of the first that are related to cloud computing:

• David Campbell, Zach Skyles Owens: SQL Server: Database to Data Platform - Road from Server to Devices to the Cloud (Mon 10/27 | 5:15 PM-6:30 PM | 408B)

Cloud-based data services will change the way you develop and deploy applications, and SQL Server technologies are evolving to help you build data-driven solutions that span devices, desktops, servers, and the cloud. Learn how to use ADO.NET Data Services Framework (code name "Astoria"), SQL Server Data Services (SSDS), and the Microsoft Sync Framework. Hear how to build applications that can be deployed using SSDS in the cloud or SQL Server on-premises, and learn how to gain insights using the BI capabilities of Microsoft SQL Server.

• Steve Marx: Developing and Deploying Your First Windows Azure Service (Mon 10/27 | 5:15 PM-6:30 PM | Petree Hall CD)

In this session we take a tour of the capabilities of the Microsoft cloud platform by building and running a simple service using the platform SDK. The sample service highlights some of the features of the platform including service management, storage, and an integrated developer experience. This is a demo-heavy session.

• Lynn Ayres, Tore Sundelin: Identity: Connecting Active Directory to Microsoft Services (Mon 10/27 | 3:30 PM-4:45 PM | 515B)

Learn how to augment your existing IT infrastructure with Microsoft Services. Manage and secure end-user access to cloud services using your existing investment in Active Directory. Enable end users to access Microsoft services through existing Active Directory accounts, the same way they access your intranet-hosted software today. Hear how to enable existing software to use new service capabilities without re-writes, and do it all through the use of open and standard protocols.

• Jitendra Thethi, Larry Beck, Erik Johnson, Brandon Watson Showcase: Industry Leaders Moving to the Cloud (Mon 10/27 | 12:45 PM-1:30 PM | 411)

Senior architects from Accenture, Epicor and Infosys, who have been using Microsoft's cloud platform for the last while, walk through the applications they've built on the platform, the architectures they've used and the lessons they've learned on what works and what doesn't. Get a real world perspective and questions answered from architects who have been getting their hands dirty with cloud services.

• Kolby Avital: "Dublin" and .NET Services: Extending On-Premises Applications to the Cloud (Mon 10/27 | 12:45 PM-1:30 PM | 515A)

Would you like to extend your existing SharePoint and .NET applications both on-premises and to the cloud in a non-intrusive way? This session will show you real-world examples of how to harness .NET Services workflow, access control and service bus to enhance business processes and add new capabilities to your application. We will demonstrate the use of "Dublin" Windows Application Server technologies to build extended application functionality. Lastly, you will see how workflow can be used to integrate across multiple organizations and the cloud. For ISVs, this session will provide a blueprint for how to sell more products to your installed base without requiring them to upgrade.

• Brad Calder: Windows Azure Storage: Essential Cloud Services (ES04 01:14:50):

Modern services need available, scalable and durable data in many forms, including both structured and unstructured data. This session presents blob, table and queue storage services and the APIs for manipulating and querying data.

Brad Calder is Director/Architect of Cloud Storage, which is the essential scalable, available and durable storage for Microsoft’s Cloud Platform.

• John Shuchuck: A Lap Around the Azure Services Platform (Mon 10/27 | 3:30 PM-4:45 PM | Petree Hall CD)

Learn about the Azure services that enable developers to easily create or extend their applications and services. From consumer-targeted applications and social networking web sites to enterprise class applications and services, these services make it easy for you to give your applications and services the most compelling experiences and features.

Manuvir Das: A Lap Around Windows Azure (Mon 10/27 | 11:00 AM-12:15 PM | Petree Hall CD 00:46:39)

Hear about key problems that cloud computing is solving and how these services fit into the Microsoft cloud computing initiatives. Learn about the pillars of the platform, its service lifecycle, and see how they fit with both Microsoft and non-Microsoft technologies. Also, hear about the services roadmap over the next few years.

Benjamin Ravani: Datacenters and Resilient Services (Mon 10/27 | 12:45 PM-1:30 PM | 408A | 00:52:31)

Microsoft Global Foundation Services (GFS) continues to learn by running online services while also building the next generation of services that are both resilient and cost effective. A key factor in realizing these goals is to apply innovation and lessons learned during the design phase. Take a look at the datacenter operations, and explore the challenges of managing large-scale services, such as Windows Live ID (WLID), which handle billions of transactions per day.

Kim Cameron: Identity Roadmap for Software + Services (Mon 10/27 | 11:00 AM-12:15 PM | 502A | 00:67:21)

The security demands on applications continue to grow in the face of compliance, online threats, and cloud- based software. In this session find out how to use Microsoft's portfolio of identity software and services to advantage your connected applications. Learn about the future roadmap for Identity and the claims-based architecture underlying it all, from Windows Live ID to Active Directory, from on-premises software to the cloud, and anchored in industry standard protocols.

Caleb Baker: Identity: "Geneva" Server and Framework Overview (Mon 10/27 | 1:45 PM-3:00 PM | 403AB | 00:74:21)

See how to use "Geneva" and the claims-based identity model to enable single sign-on, strong authentication, federation, and the ability to flow user authentication between applications. Find out how to use "Geneva" with ASP.NET, WCF, Active Directory, Windows Live ID, and Windows CardSpace.

This section will be updated as segments become available on 10/28/2008.

Cloud-Related Posts

• Joe Wilcox: PDC Day 2 Quick Roundup (10/28/2008)

Microsoft saved some of the biggest developer news for the second day of the Professional Developers Conference. … Things were moving so fast during today's keynote, which went way over time, I simply couldn't get to it at once.

• Jim Nakashima: ASP.Net MVC Projects running on Windows Azure (10/28/2008)

Strictly speaking, ASP.Net MVC projects are not supported on Windows Azure.  That is to say that we haven't spent the time to fully test all of the MVC scenarios when running on Windows Azure. 

That said, for the most part, they do work, just as long as you know what tweaks you need to make in order to get up and running.

I've attached a sample application that Phil and Eilon on the MVC team put together to help make it easier for you to get started.

• Jim Nakashima: Video Walkthrough: A Quick Lap around Windows Azure Tools for Microsoft Visual Studio (10/28/2008)

(A brief 00:05:38 screencast rather than a Channel9 webcast.)

Ray Ozzie: Ray Ozzie: Reflections on Azure (00:06:02)

Microsoft CSA Ray Ozzie joins us for a quick chat (you can imagine how busy he is...) about the complexities of designing and implementing the Azure Services Platform, his key take-aways from the past two days at PDC and his guiding architectural principles for Azure (for those who know Ray, he is a staunch advocate for simplicity and adherence to protocols that already exist and are widely used).

Jim Nakashima: Windows Azure Walkthrough: Simple Table Storage (10/28/2008)

The Windows Azure Table Storage Services provides queryable structured storage. Each account can have 0..n tables.

The UI class (the aspx page and it’s code behind) is data bound through an ObjectDataSource to the SimpleTableSample_WebRole.ContactDataSource which creates the connection to the Table Storage service gets the list of Contacts and Inserts to, and Deletes from, the Table Storage.

Clint Covington: Storing Access apps and data in the cloud (10/28/2008)

Today’s guest writer is Liam Cavanagh from the Sync Framework and SQL Services team. They are doing some cool stuff that allows Access developers to store their app and data in the cloud using SQL Server Data Services. Liam is looking for people that want to beta test an upcoming release early next year. –Clint