Tuesday, April 21, 2009

Windows Azure and Cloud Computing Posts for 4/13/2009+

Windows Azure, Azure Data Services, SQL Data Services and related cloud computing topics now appear in this weekly series.

• Updated 4/21/2009 for posts through 4/19/2009.
Updated 4/15/2009 3:40 PM PDT for 33-page McKinsey & Co. Clearing the Air on Cloud Computing report and Nicholas Carr’s The big company and the cloud response (see the “Azure Infrastructure” section).

Note: This post is updated daily or more frequently, depending on the availability of new articles.

Azure Blob, Table and Queue Services

Joe Gregorio, the primary contributor to the AtomPub protocol, concludes on 4/18/2009 that The Atom Publishing Protocol is a failure in the light of “browsers are much more powerful, Javascript compatibility is increasing among them, there are more libraries to smooth over the differences, and connectivity is on the rise.” He also attributes AtomPub’s failure to JavaScript Object Notation:

The idea was that with a common format you could build up libraries and make it easy to move information around. The 'problem' in this case is that a better format came along in the interim: JSON. JSON, born of Javascript, born of the browser, is the perfect 'data' interchange format, and here I am distinguishing between 'data' interchange and 'document' interchange. If all you want to do is get data from point A to B then JSON is a much easier format to generate and consume as it maps directly into data structures, as opposed to a document oriented format like Atom, which has to be mapped manually into data structures and that mapping will be different from library to library.

Dare Obasanjo adds his commentary on Joe’s post in Joe Gregorio on why the Atom Publishing Protocol (AtomPub) is a failure of 4/18/2009. Dare’s conclusion:

In my opinion, the growth in popularity of object-centric JSON over document-centric XML as the way to expose APIs on the Web has been the real stake in the heart for the Atom Publishing Protocol.

Rick Strahl discusses browser support for JSON in his Native JSON Parsing: What does it mean? post of 4/19/2009.

Brent Stineman’s detailed Azure Storage – Hands on with Queues, Part 1 of 4/16/2009 is the first member of a series on writing HTTPWebRequest calls to Azure Queues without using the sample ServiceClient library.

Rob Bagby proceeds with his detailed, lavishly illustrated Azure Web Services project with Azure Application Part 3: Expose (REST) Web Service And Consume in Silverlight of 4/17/2009. The screencast is here.

Rob Bagby continues his Azure shopping cart project with a 10-foot-long Azure Application Part 2: Access Azure Table Storage post of 4/14/2009:

This is part 2 in this series where I am building an Azure shopping cart application from the ground up.  In this post, I will create a simplified ASP.NET version of the wine catalog.  We will create a table in developer storage (the local version of Azure Storage) to store our wines and write 2 web pages: 1 to view all wines and another to add a wine.  We will then access the same table in the cloud in Azure Table Storage.

Here’s a link to the screencast: deCast - Building an Azure App Part II: Azure Table Storage

SQL Data Services (SDS)

Ryan Dunn asks Why does Windows Azure use a cscfg file? and provides the answer in this post of 4/16/2009.

Microsoft reminds us that Microsoft SQL Server Data Mining Services for the cloud are available for SDS. There’s more information at the home page: http://www.sqlserverdatamining.com/ssdm/.

.NET Services: Access Control, Service Bus and Workflow

Don’t forget the New Azure Training Kit [is] Available with

    • 11 hands-on labs – including new hands-on labs for PHP and Native Code on Windows Azure.
    • 18 demo scripts – These demo scripts are designed to provide detailed walkthroughs of key features so that someone can easily give a demo of a service
    • 9 presentations – the presentations used for our 3 day training workshops including speaker notes

You can download it from http://go.microsoft.com/fwlink/?LinkID=130354

Live Windows Azure Apps, Tools and Test Harnesses

Aleksy Savateyev describes his forthcoming Azurelight project that combines a Silverlight front end with an Azure Services Platform back end in his Announcing Azurelight post of 4/10/2009:

Microsoft codename "Azurelight" is an easy-to-use application for providing basic product support in the cloud, collecting feedback about products and exchanging opinions with other users. It's also intended to be used by developers as a reference application utilizing both Windows Azure and Silverlight for rich yet scalable and highly available business solutions.

Thanks to Mary Jo Foley for the heads-up in her Aleksey Savateyev's Blog- Web, S+S, etc. - Announcing Azurelight post of 4/13/2009.

Note: As of 4/15/2009, 12:00 noon Aleksy’s blog has reappeared after being 404 all morning.

Azure Infrastructure

Mike Amundsen announced in RESTful Web Services Cookbook of 4/19/2009 that he and Subbu Allamaraju are writing a book titled RESTful Web Services Cookbook, which will be published by O’Reilly by the end of 2009. Mike describes the book:

Each recipe in this book will tackle one or more related design problems, and then discuss solutions and trade-offs. We think that learning the trade-offs is sometimes more important than just learning the right way, because an important part of software development is about making judicious trade-offs. In this book, we will therefore try to emphasize pragmatism over principles.

Amy Wohl chimes in with her McKinsey Got It Wrong: Cloud Computing is for Enterprises summary post of 4/18/2009. Amy’s full post is here.

James Hamilton’s SSD versus Enterprise SATA and SAS disks post of 4/18/2009 provides a detailed analysis of the economics of solid-state disks (SSDs) vs. conventional mechanical hard disk drives (HDDs). James concludes:

If you are storing data where you need 1.109 MB/s of 8k I/Os per GB of capacity or better, then the Intel device will be I/O bound and you won’t be able to use all the capacity. If the workload requires less than this number, then it is capacity bound and you won’t be able to use all the IOPS on the device. For very low access rate data, HDDs are a win. For very high access rate data, SSDs will be a better price performer.

Mike Walker reports that a “Mapping Applications to the Cloud” article will appear in Architecture Journal 19: TechEd 2009 Special Edition, which you can download here.

• John Foley says Cloud Computing Gets A Much-Needed Reality Check by McKinsey & Co. in this 4/17/2009 InformationWeek post. Michael Hickens does the same in his Anti-Cloud Hype Is Hype post of 4/16/2009.

• Jim Nakashima details the contents of *.cspkg files in his Digging in to the Windows Azure Service Package post of 4/16/2009.

• Leena Rao concludes that McKinsey’s Cloud Computing Report Is Partly Cloudy on 4/16/2009 in this TechCrunch post.

Steve Lohr chimes in with another McKinsey review in the NY TimesWhen Cloud Computing Doesn’t Make Sense article of 4/15/2009.

Instead of chasing cloudy visions, McKinsey suggests, corporate technology managers should focus mainly on adopting one building-block technology of the cloud model, virtualization. Such virtualization allows server computers to juggle more software tasks, and thus increase utilization, reducing capital and energy costs.

Steve Nagy “dive[s] a little deeper into the lifetime of a server in the Azure Fabric and the process of deploying resources on demand” in his Azure Server Virtualization Provisioning and Multitenancy post of 4/18/2009.

Steve Nagy’s Multitenancy And The Cloud post of 4/17/2009 describes why the definition of the term “multitenancy” has changed over time.

Nicholas Carr critiques the McKinsey & Co. report (see below) in his The big company and the cloud post of 4/15/2009:

[I]t has to be said, the numbers McKinsey presents seem a bit skewed, probably understating some of the savings or other benefits of moving to a cloud. For instance, again drawing on a "disguised client example," McKinsey suggests that replacing an in-house data center with cloud services would reduce IT labor costs by only about 10 to 15 percent.

I look forward to further analyses of these numbers. I'd be particularly interested in hearing Amazon's perspective on McKinsey's comparisons.

Will Forrest defines cloud computing as “hardware-based services
offering compute, network and storage capacity where:

    1. Hardware management is highly abstracted from the
      buyer
    2. Buyers incur infrastructure costs as variable OPEX
    3. Infrastructure capacity is highly elastic (up or down)”

in a detailed, 33-page McKinsey & Co. final report, Clearing the Air on Cloud Computing, dated 4/14/2009. Don’t miss it!

Steve Marx’s Does Windows Azure Support Java? post of 4/15/2009 answers the question with:

Windows Azure doesn’t support Java today. … But, you can run whatever you want.

Sun Microsystems reports about Cloud Security Presentation at the 10th Annual CERIAS Symposium on 4/15/2009:

A panel of four experts addressed the issue of “Security in the Cloud” at the recent symposium hosted by The Center for Education and Research in Information Assurance and Security (CERIAS). The speakers included Lorenzo D. Martino, College of Technology, Purdue University; Keith Watson, CERIAS, Purdue University; Dennis R. Moreau, Configuresoft Inc.; and Christoph Schuba, Sun Microsystems.

Cost Savings Will Drive Users to the Cloud; Providers Will Take Care of Security

Bill McColl’s What's Really Industry-Changing About Cloud Computing? post of 4/15/2009 describes “Four exciting new directions in massively parallel cloud computing:”

    • Cloudbursting.
    • Libraries and App Stores.
    • Live Data.
    • Domain Specific Development Tools.

Kym Jones discusses Legal Issues Surrounding Cloud Computing in this 4/15/2009 Cloud Computing Journal post. Jones writes:

Deploying cloud resources requires a different legal analysis than using, or selling, traditional Internet services. This session [at Cloud Computing Expo Europe] will focus on the interconnected nature, but nationless state, of cloud computing. Delegates will come away with: Five legal theories that will minimize risk regardless of the nation in which you live; a legal toolkit to address thorny contract issues in the United States and European Union; and a comparison of the risks of doing business with several major grid providers.

Dave Linthicum “talks about the use of architectural approaches for cloud computing, and issues with moving towards the clouds” in this Moving Towards Cloud Computing podcast of 4/15/2009.

Cath Jennings’ (no relation) Cloud computing: The answer to supply chain woes post of 4/15/2009 claims:

The adoption of cloud computing services in a supply chain context will mirror the former uptake patterns of on-premise enterprise resource planning (ERP) software. This means that such offerings are unlikely to be used to support non-commodity, core business processes for at least another three years.

Gordon Haff’s Thoughts on the cloud from Razorfish CNet News post of 4/15/2009 describes Microsoft’s Razorfish organization’s:

[W]ork with Rackspace's cloud hosting division, Mosso, to "build consumer-facing websites and web applications that can handle large traffic spikes during promotions and product launches of brands." However, we mostly discussed cloud computing more broadly. Here were some of the takeaways of which that I took particular note.

Razorfish is operating its internal systems more and more in the style of public cloud providers. Almost nothing runs on a dedicated physical server. They're also consolidating down from 25 datacenters to three. Klauder told me that big enablers here were cheap bandwidth and wide area network (WAN) acceleration--for which Razorfish uses Riverbed products. Razorfish also uses co-location facilities to optimize bandwidth use.

I wonder what the Azure team has to say about this turn of events.

Andrew Nusca asks Is adopting the cloud a money-losing mistake? in this 4/15/2009 post to ZDNet’s Between the Lines blog and reports:

But new research from McKinsey & Co. says that trying to adopt the cloud model would be a money-losing mistake for most large corporations. The research is being presented at a symposium this afternoon sponsored by the Uptime Institute, an organization that focuses on improving the efficiency of data centers.

The McKinsey study, “Clearing the Air on Cloud Computing,” concludes that outsourcing a typical corporate data center to the cloud would more than double the cost. The study uses Amazon’s well-known Web Services as the model for the price of outsourced cloud computing. According to McKinsey, the total cost of the data center functions would be $366 a month per unit of computing output, compared with $150 a month for the conventional data center. …

On the other hand, the cloud can be beneficial for small and medium-sized companies, typically with revenues of $500 million or less.

Dustin Amrhein’s Enhancing Development and Test with Cloud Computing post of 4/15/2009 describes “Five ways cloud computing strengthens IT development and test efforts.”

Maureen O’Gara reports EMC Creates Whopping Big Cloud Storage on 4/14/2009: EMC also has the first product derived from this new architecture, the world's biggest high-end storage array ever:

Dubbed the Virtual Matrix Architecture, it promises storage that scale to hundreds of thousand of terabytes and tens of million of IOPS supporting hundreds of thousands of virtual machines in a single federated storage infrastructure.

Dmitry Sotnikov’s Will Cloud make SOA mainstream? post of 4/14/2009 comments on Gartner’s report on SOA and Cloud Computing: “Cloud Computing Will Cement the Mainstream Role of SOA”.

In my opinion, on the one hand this is all common sense, and web interfaces are the obvious API approach for cloud/SaaS applications, and thus indeed in that way make SOA finally become widely spread. …

Overall, this is a very short report (less than one page of actual text) with a $195 price tag, so you might want to spend the money elsewhere. However, obviously do buy it if you need an analyst-approved document to prove to your boss that SOA is important.

Kyle Gabhart asserts Owning Hardware is Soooooo 2008 in this 4/14/2009 review of Fortune Magazine’s recent Tech Daily post: "Goodbye hardware. Hello, services". Kyle quotes Fortune:

"As Salesforce CEO Marc Benioff said back in November: In this economy, ‘customers are not going to bring out their checkbooks for the cost and risk and complexity of big database purchases, or application server purchases, or data center purchases.' They're buying more services, and fewer servers."

Krishnan Subramanian starts a new series with Scientists And Cloud Computing – Part 1 of 4/14/2009:

Again and again in this space, I have pushed the idea of scientific community tapping into Cloud Computing for their academic research. I have argued that it will save tons of money and time for the scientists. Of late, we are hearing many success stories about scientists and other academics tapping into the Clouds for their research. In this two part series, I want to highlight how scientists are taking advantage of the Clouds. In this first article, I want to, once again, emphasize the importance of Cloud Computing for scientists and in the second part, I will list out some of the successful use cases.

Reuven Cohen makes The Case for a Cloud Computing Trade Association in this lengthy 4/13/2009 post:

I believe the association should focus on the commonalities we share -- accelerating the adoption of cloud computing through a consensus view of the general opportunities cloud based technology brings to customers. I'm not speaking about defining what cloud computing is so much as defining the problems it solves and opportunities it enables. The things we can actually agree on.

Ruv also reports that as of 4/15/2009 his Open Cloud Manifesto Reaches 150 Supporting Companies.

Mary Jo Foley asks What is Microsoft doing to add Java support to Azure? in this 4/13/2009 post as the result of “Google’s recent announcement that is allowing developers writing for the Google App Engine cloud platform to develop in Java:

The answer? Not much that company officials haven’t said before. 

Cloud Computing Events

Markus Klems reports on 4/20/2009 from CloudSlam about Francis Carden’s OpenSpan - Workflow automization on the presentation layer presentation.

Mike Ormond’s UK Azure NET Usergroup post of 4/17/2009 is a brief postmortem of the first meeting of a new Windows Azure community in the UK.

Rob Bagby announced on 4/14/2009 MSDN Events Presents: The Best Of MIX, which will deliver “3 great sessions to you, including ‘What’s New in Silverlight 3?’, ‘Building Web Applications with Windows Azure’ and ‘MVC 1.0 vs ASP.Net Webforms’” (emphasis added). Where and When (registration links):

Joseph F. Fovar reports VMware Outlines Cloud Vision, Previews vSphere, At Partner Conference on 4/14/2009:

VMware opened its annual partner summit Tuesday by introducing how partners can take advantage of new VMware technology to help start moving customers to the compute cloud. [Link added.]

The company also unveiled a new partner initiative aimed at making it easier for solution providers to work with its technology.

David Linthicum chimes in a bit late with his 'Open Cloud Manifesto?' Just Stop! post of 4/13/2009: Dave writes (in part):

Manifestos are nothing new; I've been dealing with them since I started in IT. The core notion is that my ideas count and yours don't, and what I say is the way it should be. At least, that's the impression I get. I recall manifestos issued around relational database technology in the late '80s and around other topical IT trends. The trouble is, manifestos have the opposite of the desired effect, serving to polarize rather than bring together. This manifesto was no different.

Aaron Skonnard’s Speaking on Windows Azure at VSLive! Las Vegas in June post of 4/13/2009 announces that he’ll be presenting:

  • Windows Azure: A New Era of Cloud Computing, 8:30 a.m.–9:45 a.m., Wednesday, June 10
  • Codename “Dublin”: Windows Application Server, 10:00 a.m.–11:15 a.m., Wednesday, June 10
  • Workshop: A Day of Windows Azure, 9:00 a.m.–6:00 p.m.,Thursday, June 11

at VSLive! Las Vegas in the Venetian.

SDForum describes its Shaping the New Age of Application Development Developers Conference as follows:

It’s no longer about a sweet web interface.  Instead it’s about applications with collaboration and analytics at the core and built from the ground up to easily accommodate elastic demand, community driven functionality and pay-per-use models. Along with the technology, profitable business models and the funding environment has also changed. 

The rules have changed. It’s a new age. SDForum’s “Shaping the New Age of Application Development” 2-day conference for developers can help you make sense of what’s changing, plot a winning course and keep you on the cutting edge. 

When: 8:30AM April 17 - 3:00PM April 18, 2009

Where: The Tech Mart, 5201 Great America Parkway, Santa Clara, CA  95054

Other Cloud Computing Platforms and Services

Dennis Howlett’s RightNow's DoD play: a good antidote to the cloud security naysayers post of 4/15/2009 details:

RightNow’s new hosting capabilities use DITSCAP/DIACAP to ensure compliance with DoD Instruction 8500.2, meet US Federal security standard FISMA (NIST 800-53) and include a 24×7 dedicated security and information assurance team. For civilian agencies with requirements similar to the DoD, RightNow now offers a second, highly secure hosting environment to meet their needs.

Alin Arimie reports on “automated, high-definition video encoding in the cloud for large-scale media companies” by HDCloud and Amazon EC2 in his HD Cloud - The FedEx Of Web Video. How Do They Do It? post of 4/15/2009:

This is another success story in the “cloud”. By leveraging public and proprietary cloud technologies, HDCloud is able to scale horizontally without limits. Remember, video processing requires lots of processing power and results must be delivered in timely manner.

More information is available from the HD Cloud Launches Next-Generation Video Transcoding Service post of 4/15/2009.

Reuven Cohen reposted on 4/15/2009 his The Unified Data Center: Unified Computing Perspectives article for the Cisco Data Center Networks Blog of 3/19/2009. Ruv claims:

For some the biggest buzz word so far in 2009 is “cloud”, for Cisco it’s “unified”. Today Cisco announced a new server centric strategy which is underpinned by the use of a “unified computing” methodology. This new unified approach to computing represents a radical shift in how we as an industry both visualize and manage a modern virtualized data center.

For Cisco Unified Computing seems to be an overarching mantra being applied to the broader management of data center resources (compute, storage, and network elements) through a singular virtualized point of interaction. In a sense they are attempting the unification of the the entire infrastructure stack in what some are calling a unified infrastructure fabric. …

What’s been exciting for us at Enomaly is envisioning the potential for a singular infrastructure abstraction that can encompass the entire infrastructure stack as well as emerging cloud centric technologies through a unified application interface (API). At Enomaly we have been saying this for awhile and fully believe that this model represents the future of computing.

James Hamilton goes Under the Covers of Google App Engine Datastore in this 4/14/2009 post that includes his “notes from an older talk done by Ryan Barrett on the Google App Engine Data store at Google IO last year (5/28/2008). Ryan is a co-founder of the App Engine team.”

John Foley reports in his Microsoft To Amazon: We'll Fix Windows Licensing post of 4/13/2009:

In a surprising admission, Microsoft president Bob Muglia says Microsoft's licensing arrangements with Amazon Web Services and other cloud service providers are both too complicated and too expensive. "We'll fix that," Muglia promises.

The subject came up in a recent 90-minute interview in InformationWeek's New York offices. I asked Muglia, president of Microsoft's Server and Tools division, about what I see as a growing rivalry between Microsoft and Amazon in the cloud computing market. "There are people at Microsoft who think of Amazon as a competitor," he admitted. "I don't. I think of them as a customer."

James Urquhart’s Maybe "cloud-computing" hasn't lost its VC luster post of 4/13/2009 for CNet News reports:

In reviewing the companies I will be judging [for Under the Radar] this year, it feels like the term "cloud" covers way too much ground to be useful in a venture pitch. In fact, a few weeks back I wrote a post that built on a conversation I had with venture capitalist Lars Leckie of Hummer-Winblad Venture Partners, in which I asked the question, "Has 'cloud computing' lost its VC luster?".

It's possible I'm being a little too harsh on the term, however. Soon after writing that post, I exchanged emails with good friend and sometimes mentor, Gamiel Gran, Vice President of Business Development at Sierra Ventures. I asked Gamiel what he thought of the term "cloud computing" as it is applied to start-up pitches.

His response frankly surprised me. Far from being a confirmation that the use of term has gotten out of control, Gamiel embraces "cloud" for all its worth (and its worth multiple trillions of dollars in Sierra's estimation). He is excited about the opportunities that cloud computing presents for new businesses, and wants to see more of it--lots more of it.

James goes on to quote the entire text of Gamiel’s response.

Joe Weinman claims in his 6 Half-Truths About the Cloud guest post of 4/11/2009 on GigaOM:

The following “six commonly held views that, while not wrong, are just not entirely accurate:”

  1. Economies of scale are the key to cloud benefits
  2. All IT will move to the cloud
  3. Clouds generate value by replacing capital expenditures with operating expenditures
  4. Private clouds are as effective as public clouds
  5. Cloud = virtualization
  6. Clouds are greener

Joe Weinman is Strategy and Business Development V-P for AT&T Business Solutions.

Peter Kim’s AT&T has Cloud Computing Advantages: What They Are is the Issue post of 4/13/2009 takes issue with Joe Weinman’s article for GigaOM. Kim wrote:

Weinman suggests that telcos will have an edge in "statistics of scale," essentially the ability to smooth out demand peaks created by customers in different verticals and time zones. …

Actually, a telco's potential advantages in cloud computing are interesting in an economist's sense, as the smoothing of demand over time and between verticals might be considered derivative from "scale" or a derivative from "scope economics.”

Wednesday, April 15, 2009

LINQ and Entity Framework Posts for 4/13/2009+

Note: This post is updated daily or more frequently, depending on the availability of new articles.

Entity Framework and Entity Data Model (EF/EDM)

Özgür Aytekin’s Practical Entity Framework for C#: Compiled Queries in Entity Framework of 4/14/2009 includes this suggestion:

With any new technology, performance implications are important to consider. If you want to get the best performance from Entity Framework queries, you should use the Compile function of the CompiledQuery class. In this video, Todd Miranda demonstrates how to use compiled queries in the Entity Framework: http://msdn.microsoft.com/en-us/vcsharp/dd565858.aspx

Alex JamesTip 12 - Choosing an Inheritance Strategy post of 4/14/2009 describes EF’s support for Table Per Hierarchy (TPH), Table Per Type (TPT), and Table Per Concrete Class (TPC) inheritance models. Alex notes that the EDM Designer doesn’t support TPC, but he supplies suggestions for choosing between TPH and TPT.

Mariuz reports in his Entity Framework and Firebird Embedded post of 4/13/2009 that Firebird Embedded works with Entity framework.

Sankarsan’s four-part A Layered ASP.NET MVC Application uses EF as the data access layer:

  1. A Layered ASP.NET MVC Application - Part I
  2. A Layered ASP.NET MVC Application - Part II
  3. A Layered ASP.NET MVC Application - Part III
  4. A Layered ASP.NET MVC Application - Part IV

LINQ to SQL

Damien Guard’s LINQ to SQL tips and tricks #2 of 4/13/2009 provides a “few more useful and lesser-known techniques for using LINQ to SQL:”

    • Take full control of  the TSQL
    • Complex stored procedures
    • Cloning an entity

Denny Tuppeny rehashes the Eager-Fetching of Relationships with LINQ to SQL topic in this 4/13/2009 post.

LINQ to Objects, LINQ to XML, et al.

Stephan Cruysberghs writes in his New connection providers in LINQPad post of 4/14/2009:

A few weeks ago I started testing the beta version of LINQPad 1.35. Some days ago it has been officially released. This great tool from Joe Albahari was introduced in 2007 and nowadays it has become a very mature tool which should be in the toolbox of every .NET developer.

Version 1.35 offers new connection providers and it has native support for LINQ to SQL and the Entity Framework models. It also provides new query types like SQL and Entity-SQL.

I am a fan of this tool and I already demonstrated its features in many of my articles. I was probably one of the first developers who used LINQPad to execute LINQ to Entities queries. In the past you needed to add some references and create the ObjectContext in each script. It was a bit of work but it functioned fine. Now you can do the same thing with the new connection providers but they also offer many advantages. In a small article which can found on my website I will highlight some of the new features.

ADO.NET Data Services (Astoria)

No significant new posts as of 4/15/2009 12:00 noon

ASP.NET Dynamic Data (DD)

No significant new posts as of 4/15/2009 12:00 noon 

SQL Data Services (SDS) and Cloud Computing

This topic moved on 1/3/2009 to Windows Azure and Cloud Computing Posts for 1/5/2009+.

Miscellaneous (WPF, WCF, MVC, Silverlight, etc.)

Guy Burstein continues his series about .NET RIA Services with:

LINQ and Entity Framework Posts for 4/6/2009+

Note: This post is updated daily or more frequently, depending on the availability of new articles.

Entity Framework and Entity Data Model (EF/EDM)

Matthieu Mezil reports multiple EDM Designer: one more new feature[s]:

  • On 4/12/2009: [W]hen an entity type isn't mapped or is only partially mapped (so we aren't able to use our edmx), I reduce its opacity.
  • On 4/11/2009: [T]he ability to see with context menu in which views the selected type (entity type or complex type) is present and the ability to navigate to this view.
  • On 4/7/2009: Published EDM Designer: new version

Gil Fink reminds EF developers on 4/10/2009 that the ADO.NET Entity Framework Extensions Library includes:

[U]tilities that make querying stored procedures,
creating typed results from DB data readers and state tracking external data much easier in the Entity Framework. A sample application demonstrates several patterns using these
utilities, including stored procedures with multiple result sets, materialization of CLR types, and registering entities in the Entity Framework state manager” (the description is taken from the library’s page). The following utilities are included in the current release of the
ADO.NET Entity Framework Extensions library:

  • Execution of store commands via the ObjectContext.
  • Connection lifetime management.
  • State management of entities from external sources.
  • Materialization of arbitrary CLR types given a data reader or DB command.
  • Stored procedure mapping:
    • Multiple result sets.
    • Column renames, polymorphic results and nested structures via the
      materialization service.
  • Getting and setting key values for entity references.
  • Rewrite InvocationExpressions in LINQ queries and expressions.

You can download the library from here.

Danny Simmons attacks Building N-Tier applications with the EF – The Basics on 4/8/2009 with more about new features in EF v4 as well as suggestions for n-tier apps in EF v3.5.

Danny SimmonsD3: Using T4 to Generate Entity and Context Classes post of 4/8/2009 explains how to use T4 templates “to create the DPMud model using the EF Designer and then generate both the classes and the database from the model (database generation has been discussed previously on the EF Design blog).”

Goodbye Linq to SQL POCO, Hello nHibernate

Simon Segal reports on 4/7/2009 that his Entity Framework Profiler hosts IronRuby and IronPython.

LINQ to SQL

Jason Young’s Unit Testing a LINQ to SQL or EF Query post of 4/9/2009 begins:

I was writing a slightly non-trivial method to query a database to find a record matching a certain time range. It quickly became clear that it would be nice to write some automated unit tests against it. Integration tests would be less than ideal because of the execution time and complexity. I ended up with a way to test the code without jumping through too many hoops.

Steve from TeamDataLogic’s Goodbye Linq to SQL POCO, Hello nHibernate post of 4/8/2009 announces:

After a long time trying to get model first poco working with Linq to SQL (using xml mapping files) we have finally given up and have moved over to nHibernate.

Matt Warren surfaces on 4/8/2009 with Building a LINQ IQueryable provider - Part XIV (IQToolkit v3), “the fourteenth in a series of posts on how to build a LINQ IQueryable provider.” Matt suggests:

If you have not read the previous posts you might request a week’s vacation, sit back, relax with a mochacino in one hand a netbook in the other, or if you've got better things to do with your time print them all out and stuff them under your pillow.

.NET Junkie’s Integrating Enterprise Library Validation Application Block With LINQ to SQL and Entity Framework Part 1: Basic Integration post of 4/7/2009 “describes how to integrate the Enterprise Library Validation Application Block in conjunction with an O/RM technology such as LINQ to SQL and Entity Framework.”

David DeWinter’s LINQ to SQL: Updating Entities post of 4/7/2009 begins:

Updating entities using any object-relational mapper can be difficult for at least two reasons: (1) the number of update options that these ORM frameworks provide and (2) the complexity of requirements in today’s business scenarios. With this post I want to discuss a few of the ways that you can update entities in LINQ to SQL to fit your particular scenario.

LINQ to Objects, LINQ to XML, et al.

Suprotim Agarwal explains how to Return the First Element of a Sequence in LINQ in this brief 4/10/2009 article.

LinqMaster shows you How to Use LINQ GroupBy in this 4/8/2009 post.

ADO.NET Data Services (Astoria)

My Uploading Entities for Storage in Azure Tables of 4/9/2009 discusses “the ease, speed, accuracy and reliability of uploading typical entities to persistent storage, as well as the cost of data ingress/egress and long-term storage.”

ASP.NET Dynamic Data (DD)

Steve Naughton’s Hiding Foreign Key column Globally in Dynamic Data post of 4/11/2009 “is based on a question in the Dynamic Data forum Hide Foreign Key Column:”

And so I thought I’d document what I did for posterity or at least so I can find it again if ever the question arises again. So I decided  here is what I would need:

  1. An Attribute to mark FK relation ships as hidden.
  2. Some Extension methods to extract and test the attribute
  3. An IAutoFieldGenerator to filter the Columns on a page

SQL Data Services (SDS) and Cloud Computing

This topic moved on 1/3/2009 to Windows Azure and Cloud Computing Posts for 1/5/2009+.

SQL Server Compact (SSCE) 3.5 and Sync Services

Shawn Kelley announced on 4/7/2009 a Custom Conflict Resolution Survey for the SyncFramework and requests answers to three questions as comments to the post.

Miscellaneous (WPF, WCF, MVC, Silverlight, etc.)

Guy Burstein brings developers up to date on .NET RIA Services with:

Charlie Calvert’s Creating a New Silverlight Project in Visual Studio 2008 post shows you how to “start a new Silverlight project or how to add a new or existing Silverlight project to an existing ASP.NET Web Application.”

Sunday, April 12, 2009

Windows Azure and Cloud Computing Posts for 4/6/2009+

Windows Azure, Azure Data Services, SQL Data Services and related cloud computing topics now appear in this weekly series.

Note: This post is updated daily or more frequently, depending on the availability of new articles.

  Update 4/10 to 4/12/2009: Rob Bagby starts an Azure shopping cart, Pat Helland’s new cloud presentation, other additions
• Update 4/8 and 4/9/2009: Big news from Google for GAE, other additions
§ indicates item repeated from Windows Azure and Cloud Computing Posts for 3/30/2009+

Azure Blob, Table and Queue Services

I asked Will Azure Attempt to Store Multiple Tables with the Same PartitionKey Value on the Same Node? in the Windows Azure forum on Easter Sunday afternoon. Specificially, I asked:

My question is will Azure attempt to store all entities with the same PartitionKey value in multiple tables on the same node?

Microsoft’s Brad Calder replied about 4-1/2 hours later with a detailed answer about controlling locality, which I recommend to anyone wondering about similar topics. The answer, by the way, was no. The entities must have the same PartitionKey and be in the same table to be localized on a single node.

Werner VogelsGood Advice on Keeping Your Database Simple and Fast post of 3/25/2009 posits:

The AWS services Amazon S3 and Amazon SimpleDB were designed to handle the dominant storage usage patterns within Amazon and they greatly reduced our need to rely on relational storage for scaling our systems. But it is almost never the case that a single storage technique is used in applications and services that need to operate at enterprise scale. For example it is a common pattern that objects stored in S3 using a primary key, have a collection of secondary keys (e.g. metadata) stored in SimpleDB. SimpleDB provides very fast indexing for querying of the metadata that will return primary keys of objects located in S3.

Azure and SimpleDB tables are quite similar and Azure Blob Services resemble S3. Amazon recently upgraded Simple Queue Services (SQS) to match Azure Queue Services features.

Erik Carlin, Rackspace Cloud’s Chief Architect explains Cloud Servers and EC2: Why Persistence Matters in this 4/7/2009 post. Erik contrasts ephemeral (volatile) EC2 instance memory with (non-volatile) Elastic Block Store (EBS) and S3 memory. The analogy also applies to ephemeral Azure instances and memory and non-volatile Azure Data Services: tables, blobs, and queues.

Rob Bagby presents Screencast Published - Understanding The Azure Table Storage API, a 00:26:14 Channel9 screencast to accompany his earlier Azure Table Storage, the REST and ADO.NET Data Services Story post of 4/3/2009:

In this screencast, I illustrate consuming Azure Table Storage from a variety of means.  I show you the easy way, using the StorageClient sample application along with the ADO.NET Data Services Client Libraries, as well as making calls directly to the REST API using Fiddler as the client.

Said Syed’s Future of Block Storage in the Cloud post of 4/7/2009 asks “Are Storage Clouds or Compute Cloud for everyone?” Said’s answer:

Probably not. For transactional type databases or I/O, cloud is a very bad idea. For those who want to run 7/24/265 operations, it could actually be more expensive to run the operation on the cloud but that is relative as some offer as low as 10 cents per hour (or was it a month???) for compute with a nice size disk drive (not cloud storage mind you). Again, still not high performance, high capacity, high I/O capable, especially over the cloud (S3 that is).

SQL Data Services (SDS)

The SQL Server Team announced SQL Server 2008 Enterprise Edition Receives Common Criteria Certification on 4/10/2009. SDS v2 will be based on SQL Server 2008 EE, so I wonder if the the certification will apply to SDS. (I’ve asked.)

Emil Sayegh’s Today from Mosso: Red Hat Enterprise Available on Cloud Servers and MS SQL 2008 on Cloud Sites post of 4/7/2009 announces that SQL Server 2008 is now available on Rackspace Cloud Sites (but not Cloud Servers). Emil claims the benefits are:

• Lower storage costs through SQL Server 2008’s data compression features
• Increased security and data protection features through encryption
• Improved scalability and performance through resource governing

Emil promises:

Following closely behind are APIs from Cloud Servers. Watch for several partners who will soon actively support The Rackspace Cloud including Aptana, Encoding, rPath, RightScale, SOASTA, and Sonian. RightScale announced it again yesterday at Cloud Computing Expo.

.NET Services: Access Control, Service Bus and Workflow

Bruno Tekaly starts a series about .NET Services with his Azure - Microsoft .NET Services- Step 01 - The Service Bus - Blog Post about Setup post of 4/10/2009. Bruno says:

This blog post is all about getting ready to learn about .NET Services, and the Service Bus specifically. This blog is based on the Azure Services Toolit and adds additional background information.

Bruno’s a Microsoft developer-evangelist.

Clemens Vasters’ .NET Services March 2009 CTP - Service Bus Routers and Queues - Part 5: The Queue API for the rest of us and .NET Services March 2009 CTP - Service Bus Routers and Queues - Part 4: The REST Queue Protocol in Code Snippets posts of 4/6/2009 adds two new chapters to his .NET Service bus saga.

§ Clemens Vasters continues on his .NET Service Bus roll with his .NET Services March 2009 CTP: Host a Public Website At The Kitchen Table or from a Coffee Shop! No Kidding post of 4/5/2009:

Using the application/service built from the sample linked at the top of this post you can host a publicly discoverable and accessible website or Web service from your Windows notebook or desktop machine from within most network environments without having to open up a port on the firewall, mapping a port on your NAT, or using some type of dynamic DNS service to make the site discoverable. All those essential connectivity features are provided by the .NET Service Bus and with the help of the included sample code. [Emphasis Clemens’.]

Live Windows Azure Apps, Tools and Test Harnesses

•• Gaurav Mantri announces Cerebrata Software’s Cloud Storage Studio for Azure Storage - A browser based client for Azure Storage in this thread added to the Windows Azure forum on 4/9/2009.

•• Rob Bagby starts “building an Azure shopping cart application from the ground up” with his lengthy and fully illustrated Azure Application Part 1: Setup and running “Hello World” post of 4/9/2009. His Screencast Published - Building an Azure App Part I: Setup and Hello World post of 4/10/2009 complements the earlier step-by-step tutorial.

If you new to Azure, this is the place to start.

•• The Azure Team published the following WCF Azure Samples to the MSDN Code Gallery on 3/13/2009:

    1. Service using BasicHttpBinding and .Net client
    2. Service using binary HTTP binding and Silverlight client
    3. Service using WebHttpBinding binding and ASP.NET AJAX client
    4. Service using binary HTTP binding with transport security and message credentials and Silverlight client
    5. Chat service which can push data to Silverlight clients
    6. Service using the AtomPub protocol and a .Net client

and subsequently uploaded live demos of some of the samples to http://wcfazure.cloudapp.net/.

My Uploading Entities for Storage in Azure Tables of 4/9/2009 describes a Windows client test harness for uploading entities from Northwind Orders and Order Details tables, describes the HTTP POST and DELETE request and response messages, and provides some basic timing information on these operations. Additional information on the status of cross-table transactions for Azure tables is included.

Ryan Dunn announces availability of the latest Azure Training Kit and Tools Update in his 4/9/2009 post. The kit includes:

    • 11 hands-on labs - including new hands-on labs for PHP and Native Code on Windows Azure.
    • 18 demo scripts - These demo scripts are designed to provide detailed walkthroughs of key features so that someone can easily give a demo of a service
    • 9 presentations - the presentations used for our 3 day training workshops including speaker notes.

and can be downloaded from here. According to Ryan:

The Azure Services Management Tools include an MMC SnapIn and Windows PowerShell cmdlets that enable a user to configure and manage several Azure Services including .NET Access Control Services, and the .NET Workflow Service. These tools can be helpful when developing and testing applications that use Azure Services. For instance, using these tools you can view and change .NET Access Control Rules, and deploy and view workflows.

You can download the latest management tools from http://code.msdn.microsoft.com/AzureManagementTools.

Mike Ormond’s Windows Azure – A Couple of Learnings of 4/9/2009 describes problems running Azure’s Development Environment on Windows 7. 

§ My Azure Table Test Harness with HTTPS, Encryption, and Membership Services for Authentication/Authorization post of 4/6/2009 shows you how to test drive my live AzureTableTestHarnessSSL.sln project that takes advantage of ASP.NET Membership Services samples from the Windows Azure SDK March 2009 CTP.

§ Clemens Vasters continues on his .NET Service Bus roll with the .NET Services March 2009 CTP: Host a Public Website At The Kitchen Table or from a Coffee Shop! No Kidding post of 4/5/2009 (repeated from the “.NET Services: Access Control, Service Bus and Workflow” section. 

Azure Infrastructure

•• Joe Weinman’s 6 Half-Truths About the Cloud of 4/11/2009 is a guest-post to the GigaOM blog. Here are Joe’s points without the detail in his post:

  1. Economies of scale are the key to cloud benefits
  2. All IT will move to the cloud
  3. Clouds generate value by replacing capital expenditures with operating expenditures
  4. Private clouds are as effective as public clouds
  5. Cloud = virtualization
  6. Clouds are greener

It’s good to see a Strategy and Business Development V-P for AT&T Business Solutions debunk some cloud myths.

•• Pat Helland calls his new Above the Clouds: a Berkeley View of Cloud Computing PowerPoint presentation “kinda’ like a book report” on the UC Berkeley RAD Labs’s Cloud Computing white paper. The 53 slides are a superb graphical rendition of the paper’s primary points from the standpoint of a champion of distributed computing who’s “been there and done that” at Tandem Computers, HaL Computers, Microsoft, and Amazon Web Services. Don’t miss it!

Dare Obasanjo discusses Todd Hoff’s Are Cloud Based Memory Architectures the Next Big Thing? post in a Some thoughts on memory based architectures (aka why memcached isn't good enough) post of 4/11/2009. Dare writes:

The LinkedIn architecture is a great example of this trend. They have servers which they call The Cloud whose job is to cache the site's entire social graph in memory and then have created multiple instances of this cached social graph. Going to disk to satisfy social graph related queries which can require touching data for hundreds to thousands of users is simply never an option. This is different from how you would traditionally treat a caching layer such as ASP.NET caching or typical usage of memcached.

I’m still waiting for the “scalable database” post, Dare.

Art Whittman’s Practical Analysis: Are We Sure This Isn't Clouded Judgment? InformationWeek article of 4/11/2009 carries this deck: “As enticing as cloud computing is, it doesn't change the rules of the game, which call for careful and thoughtful data management.” This week’s cover story is “Private Clouds.”

Dave Malcolm Surgient’s The five defining characteristics of cloud computing article of 4/9/2009 for ZD Net begins: “Interest in cloud computing is rampant across the entire IT industry and everyone has a different perspective and understanding of the technology” and continues with:

    • Characteristic 1: Dynamic computing infrastructure
    • Characteristic 2: IT service-centric approach
    • Characteristic 3: Self-service based usage model
    • Characteristic 4: Minimally or self-managed platform
    • Characteristic 5: Consumption-based billing

Surgient provides a detailed description of each characteristic. If you’re looking for a starter piece for a management or developer presentation, try this.

Eric Knoor and Galen Gruman analyze What cloud computing really means in a 4/7/2009 article for InfoWorld. The deck: “The next big trend sounds nebulous, but it's not so fuzzy when you view the value proposition from the perspective of IT professionals” and the lede:

InfoWorld talked to dozens of vendors, analysts, and IT customers to tease out the various components of cloud computing. Based on those discussions, here's a rough breakdown of what cloud computing is all about:

  1. SaaS
  2. Utility computing
  3. Web services in the cloud
  4. Platform as a service
  5. MSP (managed service providers)
  6. Service commerce platforms

• Tom Bittman, a Gartner Analyst, discusses The Spectrum of Private to Public Cloud Services in this 4/8/2009 post. Bittman writes:

Is it a private cloud service, or a public cloud service? It’s not quite so binary. I first explored this in my post Virtual Cloud Privacy is Gray a few months ago. There are two relative dimensions that determine how “private” or how “public” a cloud service really is:

Service Control/Ownership: There are two ends of a spectrum here – complete implementation ownership, and complete lack of ownership and control of implementation. But there will be many examples in between of partial control, shared ownership, etc.

Service Access: Also two ends to this spectrum – at one end, usage is extremely exclusive, while at the other end, anyone who chooses can access the service. Again, there will be many examples in between of limited access, industry-only access, controlled partner access, etc.

These two dimensions are coupled at the extremes, but there are many variations in between. Each has different security/privacy, cost, customization and elasticity attributes. …

• Microsoft UK’s Arc Magazine issues 1 and 2 provide “insight into the Microsoft 'Software + Services' strategy from an architectural perspective. The 4 issues explore the business case, the implications, why identity matters, Software + Services and the Cloud, supported by case studies,” according to this recent Architecture post.

Nolan M. Goldberg’s and Sharada Devarasetty’s The Cloud: Tomorrow’s EDD Challenge post of 4/9/2009 discuss the legal aspects of electronic data discovery (EDD) and electronically stored information (ESI) in the cloud. (Goldberg is a senior associate in the patent group of New York-based Proskauer Rose LLP and a member of the Litigation Department's e-Discovery Task Force. Devarasetty is an associate in the firm’s patent group.)

• James Hamilton follows up on his posts from the recent Google DataCenter Efficient Summit with Data Center Efficiency Summit Videos Posted of 4/9/2009:

• Kevin Jackson analyzes the Network Centric Operations Industry Consortium (NCOIC)’s Cloud Computing Working Group and its focus on establishing a roadmap for providing value to the industry in his NCOIC and Cloud Computing: An Update post of 4/8/2009.

James Urquhart asks The new cloud infrastructure: Do you care? on 4/8/2009 but then says “At the very least, the future of hardware ought to touch the inner geek in all of us” and talks about Cisco’s Unified Computing Systems, Rackable Systems’ CloudRack C2, and Google servers’ self-contained backup battery.

Mark Wilson attended the inaugural meeting of UK Azure User Group at Microsoft’s London offices, which included a presentation from Microsoft’s James Conard about what Windows Azure really is. Mark’s So, what exactly is Windows Azure? post of 4/7/2009 is a detailed summary of Conard’s introductory session.

Colin McNamara’s Cisco’s Cloud Computing Offering post of 4/7/2009 concludes:

Cisco has to go to market with a Cloud offering to maintain long term viability as a company. When they do they will have the benefit of lower cost of building and operating the grids that their cloud offering will run on. They will be able to leverage millions of Cisco network devices in their current install base as well as provide application centric security integrated with these same devices. And most importantly they will be able to use the lessons learned from running WebEx to ensure flawless delivery of an upcoming cloud computing offering.

James Hamilton suggests using ambient air for datacenter cooling in his 32C (90F) in the Data Center post of 4/7/2009. James concludes:

I recently came across a wonderful study done by the Intel IT department (thanks to Data Center Knowledge): reducing data center cost with an Air Economizer.

In this study Don Atwood and John Miner of Intel IT take the a datacenter module and divide it up into two rooms of 8 racks each. One room is run as a control with re-circulated air the their standard temperatures. The other room is run on pure outside air with the temperature allowed to range between 65F and 90F. If the outside temp falls below 65, server heat is re-circulated to maintain 65F. If over 90F, then the air conditioning system is used to reduced to 90F. The servers ran silicone design simulations at an average utilization rate of 90% for 10 months.

I’m still not sure what’s a “silicone [sic?] design simulation.”

Robert L. Miller’s SaaS integration: Tricky, but manageable ComputerWorld article includes three interesting integration-related sidebars:

    • Tips for successful integration projects
    • Three ways integrations can get tangled up
    • Whose Burden?
    • Who's in Charge?

Miller concludes:

About 80% of integrations use basic technologies such as file transfers, and projects with SaaS applications tend to roll out faster than the 12-to-18-month window that's typical for traditional on-premises applications, says Annrai O'Toole, vice president of integration at Workday Inc., a provider of hosted applications in Pleasanton, Calif. Nonetheless, a typical integration project involving Workday systems, including the migration and cleaning of data, specification of business processes, and systems configuration, still takes around 70 days.

Thanks to David Linthicum for the heads-up on this article.

Tom Lounibos decrees Delivering Reliable Web Services Requires Web Scale Testing in this 4/7/2009 post. Of course, that statement isn’t surprising when you consider that Tom is President and CEO of SOASTA, which is the publisher of CloudTest.

Sam Ruby’s Open Cloud Principles post of 4/6/2009 analyzes Sam Johnston’s Open Cloud Principles (OCP) and the associated Open Cloud Initiative (OCI):

It is getting to be a crowded place in the clouds, what with the Open Cloud Manifesto, the Cloud Bill of Rights, and the Cloud Computing Interoperability Forum.  I’m sure I’ve missed countless others.

I like the OCP’s focus on open APIs, open formats, and open data.  Speaking as an open source person, I think the bullet on Open Source (optional) should simply be dropped.  Always bet on protocols and formats, as long as the focus is on ensuring that the the entire stack can be swapped out or ground up rewritten as the service owner sees fit, the rest will work out.

Sam (Ruby) then goes on to analyze the “concept of Interoperability” and finds it “significantly in need of expansion.”

I agree.

Mark Everett Hall posits Windows Azure: Microsoft Banks on Programmer Loyalty in this 4/7/2009 article for PC World magazine. Mark writes:

Still in beta, Azure features both proprietary tools that Windows developers will recognize and standard technologies that could appeal to programmers outside of Microsoft's orbit. Whether that strategy will work remains to be seen, since Microsoft trails Salesforce.com, Amazon.com, Google and others in entering the cloud, which Merrill-Lynch & Co. has estimated will be a $95 billion market by 2011.

Javier Soltero discusses the developer’s role in his The Cloud Dilemma for Developers post of 2/3/2009:

Developers like the cloud since it lets them bypass operations (i.e., the control agents) and serve their environment needs quickly. In the cloud, developers can build an application and launch it themselves, on their own, without waiting for hardware to be purchased, racked & stacked.  Without waiting for hardware or virtualization capacity planning, electricity consumption plans, cooling or green discussions to finish. If you’re a developer, the cloud offers speed! The cloud is way cool. You’re the man. But developers too often forget to ask themselves what happens afterwards?  Who will make sure the app is always available?  Apps in the cloud will still have performance issues and will still break.

Javier continues with a discussion of two dilemmas for cloud-computing developers.

§ Bernard Golden’s Power: One Cloud Cost Advantage That May Be Irresistible article of 4/6/2009 for CIO’s Virtualization and Cloud Observer blog analyzes Microsoft’s The Cost of a Cloud: Research Problems in Data Center Networks whitepaper and Steve Denegri’s Cloud Computing Dominance Through Renewable Energy paper:

From [Denegri’s] research, he concludes that Microsoft obtains a 22% discount on its property taxes (this is based on a discount extended to companies that make very large real property investments). With regard to power, Microsoft obtains a 45% discount, based on using enough electricity to fall into a "Super Large Power" user category. This advantage may be enhanced in the future, Denegri states, because of potential taxes to be applied to carbon-based power. Microsoft may be able to strike an arrangement to have its data center powered by clean energy sources (e.g., wind or solar), thereby avoiding these additional taxes.

§ Microsoft attempts to explain its ubiquitous Software as a Services strategy with an inspirational[?] intro video, a Ray Ozzie introduction, and pages for potential Xbox, Azure, Windows Live and Mobile, and Office Online services. (This site might have been around for a while; I just found it.)

§ Mary Jo Foley reports Microsoft links HealthVault service with Amalga software on 4/6/2009:

HealthVault is Microsoft’s consumer-focused health-records-management Software+Service platform, which the company unveiled officially in 2007. (The service component of HealthVault is one of a handful of Microsoft services that already is hosted on top of Azure.) Amalga UIS, (one of the products formerly under the Azyxxi brand), is one of the main elements of Microsoft’s enterprise health-information-system platform. [Emphasis and links added.]

§ Dimitry Sotknikov’s Can cloud make you MORE compliant? post of 4/6/2009 reviews a report by Scott Crawford from Enterprise Management Associates - “The Security Paradox of Cloud: Five Questions for Cloud Providers” and adds his comments on the paper.

§ David Pallman begins a new Azure series with Grid Computing on the Azure Cloud Computing Platform, Part 1 of 4/5/2009:

In this series of articles we're going to look at grid computing using the Azure cloud computing platform. In Part 1, we'll look at this from a design pattern and benefits perspective.

Cloud Computing Events

Guy Bunker will present The Darker Sides Of Cloud Computing: Security and Availability at the upcoming Cloud Computing Expo Europe (www.cloudexpo-europe.com) May 18-19, 2009, in Prague, Czech Republic. Here’s the abstract:

Cloud computing offers a fantastic opportunity to businesses of all sizes. However, there are pitfalls that no-one wants to talk about. This session will talk to some of the darker sides to cloud computing - those around security and availability. Understanding where the issues lie will help service providers to create better services and enable customers to ask the right questions of their providers.

• Mike Walker’s Microsoft Architect Insight Conference 2009 post of 4/9/2009 announces that the UK’s fourth annual Microsoft Architect Insight Conference conference will be held 5/8/2009 at Microsoft London.

• Reuven Cohen announces CloudCamp Austin, April 25th at Austin City Limits, 2504 Whitis Ave., Austin, TX 78705 in this 4/9/2009 post. The tentative schedule is Saturday, April 25th (10am - 4pm) to be followed by a Happy Hour at Little Woodrows.

SYS-CON Announces Government IT Conference & Expo, which is being held October 5-6, 2009 in Washington, DC, in this 4/9/2009 post. According to SYS-CON:

Cloud Computing will be one of the main tracks. According to the Washington Post this week, the U.S. Census Bureau is using Salesforce's cloud to manage the activities of about 100,000 partner organizations across the country. And the Defense Department's technology arm has already set up a cloud to let the military rent storage space or use remote software programs. Companies like online application provider NetSuite have shifted their focus to federal sales, on the basis that what works for Enterprise IT can also work for Government.

David Pallman’s Upcoming Orange County Azure User Group April Meeting: "What's New in Azure" post of 4/8/2009 announces that the next meeting of the Orange Couny Azure User Group is Thursday, April 23rd at QuickStart Intelligence.

The Economist memorializes the Open Cloud Manifesto in its Clash of the clouds article of 4/2/2009:

Deck: A familiar-sounding industry spat breaks out over standards.

Just as predictably, the leaders in cloud computing are absent from the list of supporters: Amazon, an online retailer that has successfully branched out into computing services; Google, which is not only a huge cloud unto itself but has built a cloud-computing platform for use by others; Salesforce.com, the biggest provider of software-as-a-service; and Microsoft. Indeed, it was an executive at the world’s biggest software firm, Steven Martin, who first leaked the manifesto, complaining that it had been drawn up in secret. “It appears to us that one company, or just a few companies, would prefer to control the evolution of cloud computing,” he wrote in a blog.

This insignificant “apple pie and motherhood” manifesto provided grist for more that its share of blog mills and even makes The Economist and Financial Times. Seems to me to indicate slow news days.

Other Cloud Computing Platforms and Services

•• Bill McNee’s Saugatuck Trip Report: On the Road in Early 2009 (PDF, requires site registration) reports “What’s Happening”:

Three key recurring themes were evident during the past two months as Saugatuck took to the road at a number of customer and industry events in the US and Western Europe. First and foremost is that interest in On Demand services remains strong despite the tough economic climate that we are in. Second, industry messaging around Cloud Computing is clearly taking center stage over SaaS, which is a good thing in Saugatuck’s opinion. Third, SaaS and Cloud providers are clearly battening down the hatches and slowing key investments that will result in slightly lower growth than they would have otherwise achieved. [Emphasis added.]

•• Jorge Escobar starts the process of Building A Social Application on the Cloud on 4/10/2009 with a description of his objectives and a roadmap to the five steps in his project:

This post will be divided in five parts. As I complete them, they will be hyperlinked below:

  1. Why build it on the cloud?
  2. Amazon EC2
  3. Amazon SimpleDB
  4. Facebook Connect
  5. Next steps

•• William Vambenepe debunks Dave Worthington’s Cloud providers vow interoperability SDTimes article (below) in his Reality check on Cloud portability post of 4/10/2009. Bill begins his post with:

SD Times recently published an interesting article about “cloud interoperability”. It has some well-informed opinions. But, like all Cloud-related discussions, it also suffers from mixing a bunch of things. The word “interoperability” is alternatively applied to the Cloud infrastructure services (in which case this “interoperability” is a way to provide application “portability”) and to the Cloud-hosted applications themselves.

Application-level interoperability (”look, my GAE-hosted app successfully sent an HTTP request to an Azure-hosted app, open the champagne”) is not very new or exciting anymore and is often used as an interoperability smokescreen (hello Salesforce.com). Many of these interop concerns are long solved and the others (like authentication and data migration) need to be solved in ways that don’t care whether the application is hosted in your Silicon Valley garage or near the Columbia river.

•• David Worthington analyzes the outcome of the Open Cloud Manifesto flap in his Cloud providers vow interoperability article of 4/10/2009 for SDTimes. If you missed the blow-by-blow action during the Cloud Computing Expo, you might find this article to be a useful summary:

In a series of interviews, Amazon, Hewlett-Packard, IBM, Microsoft and Salesforce.com detailed how developers can integrate their services, while acknowledging the challenges posed by constructing composite cloud applications.

•• Amazon Web Services introduced the Amazon Elastic WebReduce beta in early April. Amazon’s Hadoop implementation promises:

Using Amazon Elastic MapReduce, you can instantly provision as much or as little capacity as you like to perform data-intensive tasks for applications such as web indexing, data mining, log file analysis, machine learning, financial analysis, scientific simulation, and bioinformatics research. Amazon Elastic MapReduce lets you focus on crunching or analyzing your data without having to worry about time-consuming set-up, management or tuning of Hadoop clusters or the compute capacity upon which they sit.

•• David Dewitt’s MapReduce: A major step backwards post of 1/17/2009 to The Database Column argues that MapReduce is:

  1. A giant step backward in the programming paradigm for large-scale data intensive applications
  2. A sub-optimal implementation, in that it uses brute force instead of indexing
  3. Not novel at all -- it represents a specific implementation of well known techniques developed nearly 25 years ago
  4. Missing most of the features that are routinely included in current DBMS
  5. Incompatible with all of the tools DBMS users have come to depend on

and then goes on to describe MapReduce, as well as to add detail to the preceding arguments.

•• Craig Balding’s enStratus: Confidence in the Cloud (Plus: $100 off Under The Radar VIP Tickets) post of 4/10/2009 is a:

[S]ummary of a very interesting call I had with George Reese, CTO of enStratus and author of the forthcoming “Cloud Application Architectures” book.  Please note: this isn’t a comprehensive review of the full [enStratus] service, rather it reflects the pieces that we delved into based on some of the common concerns we have around Cloud Security (to give you some idea, we spoke for over 90 minutes…).

Filesystem encryption for Amazon Web Services Elastic Block Store (EBS) service is the most interesting aspect of Craig’s summary (at least to me.)

•• J. Nicholas Hoover reports that GE Puts 'Private' Cloud Computing To The Test on 4/11/2009 for Information Week. The deck reads: “It's starting a three-year effort aimed at better efficiency and flexibility.” Hoover writes:

GE is in the early stages of a three-year project to implement technologies that give it the flexibility, automation, and manageability [GE CTO] Simpson seeks. It's evaluating whether to have one expansive internal cloud or multiple discrete clouds dedicated to, say, Web serving or financial systems. Simpson's leaning toward the latter scenario, but either way, he wants to offer IT resources on demand and to charge business units for what they consume.

•• Kevin Jackson’s Cisco's Cloud Computing Strategy post of 4/10/2009 reviews Krishna Sankar’s A Hitchhiker's Guide to the Inter-Cloud presentation which lists the following as Cisco’s cloud computing strategy:

    • Build Right Products (Unified Fabric, Unified Compute, Virtualization Aware)
    • Technology (Enhanced IP core with tight coupling to software)
    • Multiphased (Standalone Clouds to Enterprise-Class to Inter-Cloud)
    • Open Standards (Accelerate Cloud deployment and federation through Cloud standards)
    • Services/References SW (Services-led Cloud blueprints with reference software stacks)

Jackson concludes:

The presentation also describes and end goal as a time "when enterprise applications can seamlessly move between their internal and external clouds leveraging the elasticity and multi-tenancy that a cloud infrastructure offers". An "Inter-cloud" standards and protocol roadmap is also offered.

Craig Balding analyzes Amazon’s new Access Control Policy for Simple Queue Services (SQS) in his Amazon AWS Introduces New Access Policy Language (SQS Today…) post of 4/9/2009.

Ben Kepes takes HP to task for equating the Application Service Provider (ASP) model with SaaS in his SaaS ≠ ASP2.0. A Treatise on FUD post of 4/9/2009.

• Jeff Barr’s Powerful New Amazon SQS Features post of 4/9/2009 discusses SQS’s new features:

  • New AddPermission and RemovePermission functions
  • At the lower level you can use the new Access Policy Language.
  • The new ChangeMessageVisibility function gives you the power to change the read timeout for an individual SQS message.

Craig Balding warns Missile, Chemical and Biological Weapons Developers: Google App Engine Is Not For You in this 4/8/2009 post. Craig writes:

Clause 2.2 just had some text added to [GAE’s] terms of service:

“You agree not to use the Service in the design, development, production, or use of missiles or the design, development, production, stockpiling, or use of chemical or biological weapons.”

I’m glad they cleared that up - now all the bad guys know to use Amazon AWS or Microsoft Azure.

However, there’s no restriction against it’s use for nuclear weapons.

Craig Balding asks Is Amazon AWS Really HIPAA Compliant Today? and then describes these security gaps:

    • There is no customer accessible AWS API call audit log
    • There is no way to restrict the source IP address from which the sacred AWS API key can be used from
    • Each AWS account is limited to a single key - exposure results in total security failure

Hopefully we all know by now that “compliance” does not equal “security”, but HIPAA compliance not withstanding, would you really want your medical data in a Cloud without some or all of these fundamental control gaps resolved or mitigated?  I can’t find anything in this new whitepaper or the old AWS Security Whitepaper (‘Creating HIPAA-compliant Medical Data Applications with AWS’) that speaks directly to these issues. [Whitepaper link added.]

Google App Engine Team announces the Google Secure Data Connector on 4/8/2007. Features include:

  • Access your corporate data in the browser. SDC lets you access your data from within Google Gadgets, Google App Engine, and Google Spreadsheets. SDC provides an agent to connect your Google Apps domain to your behind-the-firewall data sources.
  • Control the use of your data. SDC lets you restrict which users and applications can make requests to your internal services. You can use our partners or your own internal authentication systems to validate and authorize those requests.
  • Build custom apps for your business. SDC lets you extend your enterprise systems into Google Apps. You can easily build gadgets or
    Google App Engine applications that make use of both private and public data.

and CSV bulk data import in the Uploading Data post of the same date. The Scheduled Tasks With Cron for Python post reports that GAE now supports scheduled tasks. Finally, Seriously this time, the new language on App Engine: Java™ of 4/7/2009 squelches the April 1 “announcement” of Fortran for GAE.

Reuven Cohen summarizes the new GAE features in his Google's Cloud Now Bridges To Your Data Center thread of 4/8/2009 in the Cloud Computing Interoperability Forum (CCIF) group and this later, illustrated Google's Cloud Bridges your Data Center post. The App Engine Team’s Google App Engine’s Next Iteration post of 4/8/2009 is the official summary.

Cast Iron Systems announces their support for SDC in this Google Apps charges ahead with improved data security and long-awaited Java support post of 4/8/2009.

§ Larry Dignan analyzes the ramifications of Sun following the IBM deal collapse: Customer confusion en route for ZDNet on 4/6/2009:

[A]ny customer buying from Sun will have to consider the ramifications of a purchase. For instance, if you’re about to buy Sun hardware and HP is in the running why wouldn’t you opt for the latter just to eliminate some uncertainty. After all, HP could buy Sun. What about cloud services? Will you trust your cloud to a company that has a tug-of-war underway over a buyout?

§ Miko Matsumura posits Sun IBM Collapse Heralds the Return of McNealy. Jonathan Schwartz is Toast in this 4/5/2009 post, which includes a link to Steve Gillmor’s Open Source Ponytail Video. Miko concludes:

Mark my words, Schwartz is toast, IBM deal or no deal. If the IBM deal fails completely (most likely outcome), look for Scott McNealy to pull a Michael Dell (or a Jerry Yang, depending on how you look at it) and to appoint himself CEO again. The board of Sun wouldn’t allow such a thing if there were even one viable suitor left. But there isn’t.

§ James Hamilton’s Data Center Efficiency Summit (Posting #4) continues his efficiency analysis series with this 4/5/2009 post. Preceding posts from Google’s Data Center Efficiency Summit are:

  1. Data Center Efficiency Summit
  2. Rough Notes: Data Center Efficiency Summit
  3. Rough Notes: Data Center Efficiency Summit (posting #3)

§ James Urquhart analyzes Internal cloud's big test: Amazon vs. Cloudera on 4/4/2009:

The announcement on Thursday of Amazon's new Hadoop-based Elastic MapReduce service, combined with the introduction of a commercial Hadoop distribution from start-up Cloudera, means that we finally have a reasonable means of watching which directions enterprise IT prefers.

§ Chris Fleck’s Amazon EC2 Reserved Pricing Changes the Equation post of 4/5/2009, subtitled “Cloud Computing Economics Part Three,” analyzes on-premise or colocation versus Amazon EC2 conventional or reserved instance pricing for five quad-core servers.