Showing posts with label Blob Storage Services. Show all posts
Showing posts with label Blob Storage Services. Show all posts

Wednesday, December 07, 2011

A First Look at HP Cloud Services

imageOn 12/7/2011 I received an invitation to test a Private Beta version of HP Cloud Services (@HPCloud). Following is an illustrated description of the sign-up and compute/object storage provisioning processes:

Setting Up an Account

1. I set up an account with the access code provided by e-mail and clicked the Dashboard button to open the following page:

image

2. I clicked the Activate Now button for Compute Services in the US West 2 - AZ1 Availability Zone, which opened a Setup Up a Payment Method (credit card) information form:

image

HP says the credit card info is for “testing the billing system only” and you won’t incur charges when you use the Private Beta version.

Configuring Compute Instances

3. Completing the form and clicking the Submit Payment Method button opened the following Compute US West 2 - AZ1 page. The invitation requested that I configure no more than 2 VMs, so I selected a standard.medium image with 2 vCPUs, 4 GB RAM and a 160 GB hard drive:

image

Note: The Welcome to HP Cloud Services page stated: “During private beta, you can sign up for up to 10 compute instances (contact us if you need more).”

4. In the Install Image list, I selected the latest Ubuntu version:

image

Notice the lack of Windows Server images.

5. I accepted the defaults for Security Group, Key Pair, Public IP, and Instances. Security Group and Key Pair only offer default values and clicked Create. After about 4 minutes, the instance entered Scheduling status, showed a Running Instances list and displayed a mysterious AdminRequired error message:

image

6. Clicking the Instance ID link opened a detail page:

image

7. Clicking View Console Log returned an HTTP 404 error.

8. Clicking Connect to Server opened this dialog:

image

9. Clicking Attach Public IP did nothing evident.

10. Clicking Reboot Server and Confirming the request resulted in an HTTP 500 error.

11. Clicking the Get Compute API Keys link (see step 5) opened the Account page’s API Keys tab:

image

OpenStack appears to have provided the EC2 Compatibility endpoint option.

Configuring Object Storage

12. Clicking the Activate Now button for Object Storage (see step 1) opens a page for creating containers and adding files. Typing a container name and clicking Create adds a link to the container. Clicking the Information icon opens and Options and Info dialog:

image

13. Clicking the container (TestContainer for this exampe) link enables uploading files from your computer:

image

14. Clicking Select files opens a Select File(s) to Upload by manage.hpcloud.com dialog:

image

15. Clicking Open displays an Upload Objects list. Clicking Upload Files adds the selected files to the container:

image

16. Clicking a filename opens an Options and Info list with a Download button and public URL for the file:

image

The Public URL appears as the result of clicking the Make Public button in step 12. Note that you can create a net directory by replacing the New Directory Name in the text box and clicking Create.

The invitation requests that Public Beta users use a maximum of 20 GB of object storage.

17. Pasting the Public URL to IE’s Address Bar returns the image:

image

The design of HP Cloud’s UI for object (blob) storage management is very straightforward and intuitive.

HP provides a OpenStack C# Object Storage binding from Rackspace on GitHub:

image

Other object storage bindings include Ruby, Java, Python and PHP.

Digging into HP Cloud Compute Services

18. Clicking the Build menu item opens a Getting Started with HP Cloud Services page with an embedded introductory video:

image

Here’s the text below the video element:

HP Cloud Services consists of:

For detailed REST API information, dig into those links above. In order to interact with the services, you'll need your API Keys.

For direct interactivity with HP Cloud Services, you can use the following officially supported tools:

For creating your own applications, take a look at our Bindings section.

Take a look at all the documentation available inside Build or if you have a question, feel free to post something over on our forums. We'd love to help.

Stay tuned for details of managing HP Cloud compute instances.

Sunday, January 03, 2010

Windows Azure and Cloud Computing Posts for 12/31/2009+

Windows Azure, SQL Azure Database and related cloud computing topics now appear in this weekly series.

 
• Update 1/3/2010: AndrĂ© van de Graaf: Main differences between SQL Azure and SQL Server 2008; Anders Trolle-Schultz: Is the Cloud Misleading Enterprises, Customers - Even Politicians?; Admin of Tune Up Your PC: Azure Service Bus – Eventing in the App Fabric – Project Weather Cloud – Creating the Weather Stations; Brandon Watson: 2010 Personal Predictions; Khash Sajadi: Microsoft Azure is not ready for prime time yet; James Urquhart: Application packaging for cloud computing: A proposal; Me: Windows Azure Feature Voting.

• Update 1/2/2010: James Hamilton: MapReduce in CACM; Panagiotis Kefalidis: Windows Azure Queues - Getting 400 Bad Request when creating a queue; Maureen O’Gara: Rackspace Teams with MySQL-Toting DaaS Start-up; Kevin L. Jackson: Most Influential Cloud Bloggers for 2009; Amazon Web Services: EC2 connectivity issues

• Update 1/1/2010: George Huey and Wade Wegner: Huey and Wegner Migrate Us to SQL Azure; Gary Orenstein: Forecast for 2010: The Rise of Hybrid Clouds; Mamoon Yunus: Virtues of Service Virtualization in a Cloud; Mark O’Neill: Who do you trust to meter the Cloud?; Brian Ales: On Microsoft’s Azure; Maarten Balliauw: Deploying PHP in the Clouds - Windows Azure; Gaurav Mantri: Cerebrata Cloud Storage Studio; Ryan Dunn, Zach Skyles Owens, DavidAiken and Vittorio Bertocci: Windows Azure Platform Training Course

Note: This post is updated daily or more frequently, depending on the availability of new articles in the following sections:

To use the above links, first click the post’s title to display the single article you want to navigate.

Cloud Computing with the Windows Azure Platform published 9/21/2009. Order today from Amazon or Barnes & Noble (in stock.)

Read the detailed TOC here (PDF) and download the sample code here.

Discuss the book on its WROX P2P Forum.

See a short-form TOC, get links to live Azure sample projects, and read a detailed TOC of electronic-only chapters 12 and 13 here.

Wrox’s Web site manager posted on 9/29/2009 a lengthy excerpt from Chapter 4, “Scaling Azure Table and Blob Storage” here.

You can now download and save the following two online-only chapters in Microsoft Office Word 2003 *.doc format by FTP:

  • Chapter 12: “Managing SQL Azure Accounts, Databases, and DataHubs*”
  • Chapter 13: “Exploiting SQL Azure Database's Relational Features”

HTTP downloads of the two chapters are available from the book's Code Download page; these chapters will be updated for the November CTP in January 2010. 
* Content for managing DataHubs will be added as Microsoft releases more details on data synchronization services for SQL Azure and Windows Azure.

Off-Topic: OakLeaf Blog Joins Technorati’s “Top 100 InfoTech” List on 10/24/2009.

Azure Blob, Table and Queue Services

•• Panagiotis KefalidisWindows Azure Queues - Getting 400 Bad Request when creating a queue post of 1/2/2010 explains why you might receive 400 Bad Request messages:

You’re trying to create a queue on Windows Azure and you’re getting a “400 Bad Request” as an inner exception. Well, there are two possible scenarios:

  1. The name of the queue is not valid. It has to be a valid DNS Name to be accepted by the service.
  2. The service is down or something went wrong and you just have to re-try, so implementing a re-try logic in your service when initializing is not a bad idea. I might say it’s mandatory.
The naming rules
  • A queue name must start with a letter or number, and may contain only letters, numbers, and the dash (-) character.
  • The first and last letters in the queue name must be alphanumeric. The dash (-) character may not be the first or last letter.
  • All letters in a queue name must be lowercase.
  • A queue name must be from 3 through 63 characters long.

More on that here.

Gaurav Mantri announced on 1/1/2010 that Cerebrata Cloud Storage Studio v2010.01.00.00, a Windows (WPF) based client form managing Windows Azure storage, is available for download after six months in private/public beta.

The application comes in the following three editions:

  • Free 30 day Trial
  • Free Developer Edition (for Development Storage only)
  • $49.99 Professional Edition (for Development and Production storage)

According to Gaurav Mantri’s Announcing the launch of Cloud Storage Studio - A WPF Application to manage your Windows Azure Storage & Hosted Services post:

Cloud Storage Studio is a WPF application to manage your Windows Azure Storage and Hosted Applications. Using Cloud Storage Studio, you can manage your tables, queues & blob containers as well as manage your hosted applications (deploy, delete, upgrade etc.). Using one interface you can connect to the development storage running on your computer as well as cloud storage.

Cerebrata Cloud Storage Studio/e, the browser-based version of Cloud Storage Studio hosted by Cerebrata, remains available for public use:

… Cloud Storage Studio/e is completely browser based. To access your data repositories hosted in Microsoft's Cloud platform, all you need is a browser with Silverlight 2 plugin installed.

Cloud Storage Studio/e allows you to access and manage your data stored in Microsoft Cloud platform using just your browser. That means you need not install any special software to access this data. Cloud Storage Studio/e makes use of the same REST API which are made available by Microsoft to access Azure Storage repository; however we have encapsulated those APIs in our application and presented them to you in an intuitive and easy to use user-interface. …

Here’s a screen capture of the Northwind Customers table uploaded to an OakLeaf storage account (click image for 1024x768-px screen capture):

You can add new or edit existing entities in this dialog:

Use of Cloud Storage Studio/e currently is free.

Jerry Huang asserts “You can map multiple Azure Blob Storage Account as side-by-side virtual folders” with Gladinet Cloud Desktop v 1.4.232 in his Manage Azure Blob Storage With Ease post of 12/31/2009.

Jerry highlights these features:

1. Map a Network Drive Letter to the Azure Blob Storage

You can map multiple Azure Blob Storage Account as side-by-side virtual folders in the same network drive. You can do drag-and-drop between local drive and the Azure drive.

image

2. Schedule Automatic Backup of Files-by-Type.

You can backup documents, pictures, music or videos to Azure Blob Storage.

image

3. Schedule Automatic Backup of Local Folders

You can pick local folders to backup to Azure Blob Storage or multiple Azure Blob Storage accounts. You can even backup to Azure Blob Storage + Amazon S3 + AT&T Synaptic Storage + Nirvanix Storage + EMC Atmos Online Storage all at the same time.

image

4. Cloud-to-Cloud Backup

You can backup Google Docs to Microsoft Azure Blob Storage or backup important documents from Amazon S3 to Azure Blob Storage.

image

5. Ad hoc Backup and Transfer

Since you can do drag and drop in Windows Explorer with the Azure Drive, you can turn each drag and drop into a scheduled backup task or download task. The following dialog will appear after a drag-drop unless you set a default action and choose don’t show next time.

image

The added details from Jerry’s article are due to the unusually few technically oriented, how-to articles in this post.

<Return to section navigation list> 

SQL Azure Database (SADB, formerly SDS and SSDS)

••• AndrĂ© van de Graaf describes the Main differences between SQL Azure and SQL Server 2008 in his 1/3/2010 post:

SQL Azure is a service which makes the administration slightly different.  Unlike administration for an on-premise instance of SQL Server, SQL Azure abstracts the logical administration from the physical administration; As an database administrator you continue to administer databases, logins, users, and roles, but Microsoft administers the physical hardware such as hard drives, servers, and storage. Because Microsoft handles all of the physical administration, there are some differences between SQL Azure and an on-premise instance of SQL Server in terms of administration, provisioning, Transact-SQL support, programming model, and features.

He continues with the details of:

  • Logical Administration vs. Physical Administration
  • Transact-SQL Features Supported on SQL Azure
  • Transact-SQL Features Unsupported on SQL Azure

•• Maureen O’Gara’s Rackspace Teams with MySQL-Toting DaaS Start-up post of 1/2/2010 reports:

The Rackspace Cloud, Rackspace Hosting’s cloud computing unit, has added FathomDB, a MySQL-based Database-as-a-Service (DaaS) start-up, to its ecosystem.

FathomDB is now built on Rackspace Cloud’s standards-based API.

FathomDB claims to have helped start the DaaS industry by offering an interactive user interface and analytics engine to support relational databases in the cloud initially on EC2 and S3.

The service is supposed to be a time-saver by providing automated backups, routine maintenance, analytic tools, real-time monitoring and performance graphs for optimizing code and easy point-and-click configuration.

Developers can run databases on FathomDB and the Rackspace Cloud starting at two cents an hour. Pricing varies by server size and disk space. It can run to $1.20 [per hour] for a 16GB server with 640GB of disk.

FathomDB was seeded by Y! Combinator.

• George Huey and Wade Wegner discuss the latest version of George’s SQL Azure Migration Wizard with Carl Franklin and Richard Campbell for 52 minutes on Huey and Wegner Migrate Us to SQL Azure (.NET Rocks! show #512):

George Huey and Wade Wegner from Microsoft talk to Carl and Richard about George's creation, the SQL Azure Migration Wizard, a free tool that will save you countless hours when migrating SQL Server databases to SQL Azure.

Cory Fowler explains Synchronizing a Local Database with the Cloud using SQL Azure Sync Framework in this 12/31/2009 tutorial:

I’ve been looking at different aspects of Windows Azure over the past few months, and have been having a lot of fun getting a grip on Cloud Computing and Microsoft's Cloud Computing Platform. One of my past posts gives a step-by-step tutorial on how to connect to SQL Azure using Microsoft SQL Server 2008 R2 (November CTP). If you haven’t already done so I would suggest reading Making Data Rain Down from the Cloud with SQL Azure to follow along with this tutorial.

Once you have your SQL Azure Account, you will need to provision a new database in the cloud and change the firewall settings so the local computer can connect to and modify the database.  These steps are provided in Making Data Rain Down from the Cloud with SQL Azure. Now that we’ve got our SQL Azure firewall database set up we’re ready to sync a local database into the cloud.

Cory continues with illustrated instructions for synchronizing a local SQL Server ASP.NET membership database with an SQL Azure version.

<Return to section navigation list> 

AppFabric: Access Control, Service Bus and Workflow

••• The Admin of the Tune Up Your PC blog posted a detailed Azure Service Bus – Eventing in the App Fabric – Project Weather Cloud – Creating the Weather Stations tutorial on 1/3/2010 that’s even longer than most of ScottGu’s posts:

This is an ongoing blog entry for Project Weather Cloud. At the end we’ll have a thoroughly documented and functional cloud application. [Following are Bruno Terkaly’s posts about AppFabric eventing:]

Weather Stations – Reporting the weather to listening endpoints

This next section is important. We are going to work on weather stations. After all, the weather stations are the source of the data that is floating around.

Weather Stations will need to manage security credentials. More specifically, we are using shared secret, as opposed to SAML Tokens or Simple Web Tokens.

Note that weather stations simply forward weather reports to WeatherCentral, which will then broadcast weather data to listening billboards.

image_thumb1

Admin continues with several feet of detailed instructions, source code and illustrations. The source code is available for download from a link at the end of the blog.

<Return to section navigation list>

Live Windows Azure Apps, Tools and Test Harnesses

••• Khash Sajadi asserts Microsoft Azure is not ready for prime time yet in this 1/2/2010 post:

My recent project was hosted on a virtual server in GoGrid. The server was a Windows 2008 running IIS7 and SQL 2008 Express. The application was in .NET 3.5 SP1 and was running as a ASP MVC front end and a Windows Service as a back end. NHibernate as ORM, Spring.net for IoC and DI, Log4Net for logging and a few other open source tools and frameworks.

With my BizSpark partnership approved, I tried to move the system to Windows Azure and now after spending 2 weeks on that I am moving it back to a dedicated server and trying to recover from the time wasted on this.

In my opinion, Azure is a brilliant framework but it is not ready for prime time yet. It can become a great cloud development environment within a year or so, but not now. …

Khash continues with details to support his conclusion. However, it should be noted that Windows Azure is a Community Technical Preview (CTP) until tomorrow (1/4/2010)

••• Montreal developer Ntmisael deployed a Silverlight-powered Online Music Catalog to the Windows Azure Platform on 1/2/2010. The catalog includes user registration and login features.

I wonder how many Azure demonstration projects will remain alive on 2/1/2010 when Microsoft begins charging for compute, storage and bandwidth. I’m in the process of combining all my demo projects into a single solution with multiple Web and worker roles.

• Maarten Balliauw’s Deploying PHP in the Clouds - Windows Azure article was published in the December 2009 issue of php | architect magazine:

The IT guys are being difficult about deploying your application? Want to grow infrastructure as your application grows? If you feel any of these questions are appropriate for your situation, deploying your application in the cloud may be an affordable and extremely scalable solution. Why not have a look at Microsoft's Windows Azure platform? Join me as I take you through Windows Azure in this two-part article.

You can download a free copy here.

Ryan Dunn, Zach Skyles Owens, DavidAiken and Vittorio Bertocci authored the Windows Azure Platform Training Course, which is available for download from Channel9 as of 1/1/2010:

The Windows Azure Platform Training Course includes a comprehensive set of technical content including samples, demos, hands-on labs, and presentations that are designed to expedite the learning process for the set of technologies released as part of the Windows Azure Platform.

Following are links to the eight individual course units:

  1. Overview
  2. Windows Azure
  3. Windows Azure Storage
  4. Windows Azure Deployment
  5. SQL Azure
  6. Microsoft Codename “Dallas”
  7. Windows Azure Service Bus
  8. Identity and the Windows Azure Platform

As you can see, this is not another drop of the Windows Azure Training Kit.

David Blumenthal, MD, MPP claims 12/30/2009 was A Defining Moment for Meaningful Use:

The Centers for Medicare & Medicaid Services (CMS) issued its draft definition for the “meaningful use” of electronic health records (EHRs) today as part of its notice of proposed rulemaking (NPRM).  The NPRM describes the proposed implementation of incentives to providers for the adoption and meaningful use of certified EHRs.  This NPRM from CMS kicks off a 60-day public comment period to help inform its development of the final 2011 meaningful use criteria.

Closely linked and also issued today from the Office of the National Coordinator for Health Information Technology (ONC) is an interim final rule (IFR) on Standards & Certification Criteria.  The IFR provides details on requirements for “certified” EHR systems, and what technical specifications are needed to support secure, interoperable, nationwide electronic exchange and meaningful use of health information.  The standards and certification criteria in the IFR are specifically designed to support the 2011 meaningful use criteria.

As part of the rulemaking process, the Standards & Certification Criteria IFR will go into effect 30 days after publication.  There will be an opportunity for public comment for 60 days from publication, after which the rule will be finalized. …

Your perspectives are important as we all play a different role in the delivery of care.  Whether you are a provider, technologist, administrator, caregiver, researcher, patient, consumer, or other member of the health care community, your input is valuable as we all work together to provide patient-centered, quality health care.

We also hope you will use this blog to start a dialogue about meaningful use, and how we can leverage this important concept, and the specific incentives, to strengthen patient care.

Dr. Blumenthal is the National Coordinator for Health Information Technology for the Obama administration.

Health Information Technology (HITECH, HIT) and, especially, Personal Health Records (PHR, such as HealthVault), will take increasing advantage of cloud computing technology in the new decade. Therefore, this post will devote greater-than-usual attention to the topic.

Glenn Laffel, MD’s Meaningful Use Quick Reference Guide of 12/31/2009 summarizes CMS’s draft criteria for meaningful use of electronic health records:

Yesterday, the Centers for Medicare and Medicaid Services (CMS) released draft criteria for the “Meaningful Use” of electronic health records (EHRs). Physicians that want to qualify for incentive payouts through CMS in 2011 must meet all of the so-called Stage 1 criteria listed below. CMS will probably add additional criteria beginning in 2013.

The following list has been excerpted from pages 47-65 of the CMS document. EHR vendors and providers should read the original document as part of any formal planning exercise and certainly in advance of any EHR purchasing decision. …

  1. Improving Quality, Safety and Efficiency, and Reducing Health Disparities …
  2. Engaging Patients and Families in their Health Care …
  3. Improving Care Coordination …
  4. Improving Population and Public Health …
  5. Ensuring Adequate Privacy and Security Protections for Personal Health Information …

He adds detailed requirements for each group.

Dr. Laffel is a physician with a PhD in Health Policy from MIT and serves as Practice Fusion's Senior VP, Clinical Affairs. Practice Fusion is a free, Web-based Electronic Health Record solution.

John Moore’s Meaningful Use Rules Hit the Streets post of 12/31/2009 summarizes the two EHR-related documents released on 12/30/2009:

… The first document, at 136 pgs, titled: Health Information Technology: Initial Set of Standards, Implementation Specifications, and Certification Criteria for Electronic Health Record Technology is targeted at EHR vendors and those who wish to develop their own EHR platform.  This document lays out what a “certified EHR” will be as the original legislation of ARRA’s HITECH Act specifically states that incentives payments will go to those providers and hospitals who “meaningfully use certified EHR technology.”  This document does not specify any single organization (e.g. CCHIT) that will be responsible for certifying EHRs, but does provide some provisions for grandfathering those EHRs/EMRs that have previously received certification from CCHIT.

The second document at 556 pgs titled: Medicare and Medicaid Programs; Electronic Health Record Incentive Program addresses the meaningful use criteria that providers and hospitals will be required to meet to receive reimbursement for EHR adoption and use.  Hint, if you wish to begin reviewing this document, start on pg 103, Table 2.  Table 2 provides a fairly clear picture of exactly what CMS will be seeking in the meaningful use of EHRs.  In a quick cursory review CMS is keeping the bar fairly high for how physicians will use an EHR within their practice or hospital with a focus on quality reporting, CPOE, e-Prescribing and the like.  They have also maintained the right of citizens to obtain a digital copy of their medical records.  An area where they pulled back significantly is on information exchange for care coordination.  Somewhat surprising in that this was one of the key requirements written into the original ARRA legislation.  But then again not so surprising as frankly, the infrastructure (health information exchanges, HIEs) is simply not there to support such exchange of information.  A long road ahead on that front. …

John Moore is an IT analyst focusing on consumer-facing HIT for Chilmark Research.

The Fox Group, LLC finds “The first draft of the Meaningful Use Criteria [was] a surprise” in its EHR - Meaningful Use, Meaning What? summary of 12/31/2009:

ehr certification

With the exception of e-prescribing, very few systems address these new basic criteria, let alone the more detailed definition of meaningful use under development.

This FOCUSED update is quite complete, even though these matters are anticipated to be modified, and possibly significantly.


The first draft of the meaningful use criteria was published in June 2009 by the Meaningful Use Workgroup of the Health Information Technology Policy Committee, the advisory committee established to propose regulations and policies to implement the HITECH Act. …

The Fox Group provides healthcare consulting and executive management services.

The first draft of the Meaningful Use Criteria were a surprise. There was less emphasis on the traditional functions of an EMR system, e.g., provider documentation and electronic claims submission.

The criteria are driven by Health Outcomes Policy Priorities and Care Goals.

Return to section navigation list> 

Windows Azure Infrastructure

••• James Urquhart’s Application packaging for cloud computing: A proposal post to C|Net’s The Wisdom of Clouds blog of 1/2/2010 proposes standardizing how cloud-computing applications are packaged for inventory and deployment:

A few weeks ago I completed a series of posts describing the ways that cloud computing will change the way we utilize virtual machines and operating systems. The very heart and soul of software systems design is being challenged by the decoupling of infrastructure architectures from the software architectures that run on them.

Over the last few weeks, I've been slowly trying to get a grip on what the state of the union is with respect to software "packaging" architectures in cloud computing environments. Specifically, I've been focusing on infrastructure-as-a-service (IaaS) and platform-as-a-service (PaaS) offerings, and the enabling infrastructure that will handle application deployment to these services in the future. How will they evolve to make deployment and operations as simple as possible? …

The diagram below describes my vision in a nutshell:

(Credit: James Urquhart)

The package could be an archive file of some kind, or it could be some other association of files (such as a source control file system). The four elements displayed above are:

  1. Metadata describing the manifest of the package itself, and any other metadata required for processing the package such as the spec version, application classification, etc. The manifest should describe enough that the receiving cloud infrastructure could decide if it was an acceptable package or not.
  2. The bits that make up the software and data being delivered. This can be in just about any applicable format, I think, including an OVF file, a VHD, a TAR file or whatever else works. Remember, the manifest would describe the format the bits are delivered in--e.g. "vApp" or "RoR app" or "AMI" or "OVF," or whatever--and the cloud environment could decide if it could handle that format or not.
  3. An appropriate deployment and/or configuration description, or pointers to the appropriate descriptions. I've always thought of this as a Puppet configuration, a Chef recipe, or something similar, but it could simply be a pointer to a JEE deployment descriptor in a WAR file provided in the "bits" section. …
  4. Orchestration and service level policies required to handle the automated run-time operation of the application bits. Again, I would hope to see some standards appear in this space, but this section should allow for a variety of ways to declare the required information.

James continues with examples of his four elements.

••• Brandon Watson’s 2010 Personal Predictions of 1/2/2010 don’t include prognostications about cloud computing but make interesting reading.

The lack of cloud prediction(s) is unexpected, because Brandon is Director of Microsoft's Azure Services Platform Ecosystem. It’s to be noted that he has both an engineering degree and an economics degree from the University of Pennsylvania, as well as an MBA from The Wharton School of Business

••• My Windows Azure Feature Voting record as of 1/3/2010 has votes and comments for four Windows Azure requests:

  1. Provide me with full text search on table storage
  2. Continue Azure offering free for Developers
  3. Add UpToDate Patient Health Data Services to Codename "Dallas"
  4. Provide alternatives to Atom for Azure Storage data format

Don’t forget to add your votes for new and/or improved Windows Azure features.

••• Anders Trolle-Schultz asks Is the Cloud Misleading Enterprises, Customers - Even Politicians? in this 12/15/2009 post to Sandhill.com’s Software in the Cloud/Utility Computing topic where “Executives and analysts examine the adoption of cloud computing and how it impacts the software industry:”

Has the revolution left us all blinded by the light and groping in the dark? Private clouds on-premises (Dell), Azure-in-a-box for Enterprises, Oracle/Sun kept away by EU to move ahead and disruption and confusion among the traditional partner/reseller/distributor channel. Amazon, Opsource, Google, Microsoft are all competing to offer the cheapest delivery in the cloud. Is Cloud Computing just hype? Yes, to some extent and one could be tempted to quote Hans Christian Andersen´s story "The Emperor's New Clothes."

Every day we see new and "improved" cloud offerings, but who are we kidding? Isn't Cloud computing just a packaged platform with a variety of layers of technology, delivered off-premises unable to address all the objections of the customers?

Cloud Computing Providers - perceived or declared - are all forcing the IT users/decision makers to climb too many mountains at the same time. 1) Move your IT to a cloud delivery 2) forget about your present database structure 3) Pay using your credit card 4) We will hold your data, but can't always tell you where 5) etc., etc….

When businesses are looking to improve their competitiveness and become more agile they often turn to the IT provided for their business. In today's economic climate businesses are looking for scalability, predictability in cost, fast implementation and proactive maintenance. All issues addressed and to be delivered by Cloud Computing, but as easily and more convincing delivered with IT services delivered on-premises using SaaS as a business model.

Microsoft's ability to offer "Azure-in-a-container" to enterprises could prove the point. Enterprises want the benefits of the scalable and affordable platforms with predictable cost and plug-and-play maintenance without losing control of the data. GIVE IT TO THEM, but don't force them into the Cloud unless you can address all their objections. [Emphasis added.] …

Anders goes on to outline other issues facing IT management when considering cloud computing. Clearly, SQL Azure eliminates the issue that requires IT users/decision makers to “… forget about your present database structure” and location-specific Microsoft Data Centers eliminate worries that “We will hold your data, but can't always tell you where.”

Sandhill.com’s Cloud/Utility Computing blog topic contains 17 other posts.

• Gary Orenstein offers his Forecast for 2010: The Rise of Hybrid Clouds in this 1/1/2010 post to GigaOm:

For companies protective of their IT operations and data, wholesale public cloud computing adoption can be a difficult pill to swallow. But cloud momentum is too strong a trend to ignore. Enter the hybrid cloud — a panacea of sorts, enabling companies to maintain a mix of on-premise and off-premise cloud computing resources, both public and private, managed through a common framework to simplify operations. This concept has steadily gathered steam over the last year and a half, and now appears poised to capture the minds, and wallets, of corporations in 2010. …

… Microsoft has focused its Azure cloud platform on enterprises that can use the same Windows and .NET development frameworks on services internally and on the cloud. See our posts “Microsoft Azure Walks a Thin Blue Line” and “Will Microsoft Drive Cloud Revenues in 2010?” Even Amazon has started to reach towards hybrid deployment models with its Virtual Private Cloud service positioned as “a secure and seamless bridge between a company’s existing IT infrastructure and the AWS cloud.” …

It appears certain that the newly formed Server & Cloud division under Bob Muglia will leverage Windows Server 2008 R2 sales with a formal hybrid cloud announcement for Windows Azure in early 2010.

• Mamoon Yunus continues to eulogize cloud gateway hardware, claiming “On-premise and Off-premise service Virtualization has significant benefits” in his Virtues of Service Virtualization in a Cloud post of 1/1/2010:

Service virtualization is the ability to create a virtual service from one or more predefined service files.  Service files are usually generated as a Web Service Description Language (WSDL, pronounced Wizdel, see tutorial for introduction to WSDL) file by service containers running business application developed in Java, .NET, PHP type programming languages.  Service virtualization combines and slices business services deployed independent of the operating systems, programming language or hosting location. The services may be off-premise cloud services (SaaS, PaaS, IaaS)  or on-premise services deployed in a corporate data center. An intermediary cloud gateway sits between the producer and the consumer and aggregates the WSDLs. Based on policies enforced on the cloud gateway, only authorized operations are exposed to the consumers. A sample topology is as follows:

Service Virtualization Cloud Computing

Mamoon continues with detailed descriptions of the putative benefits.

• Mark O’Neill uses Tom Rafferty’s analysis of Pacific Gas & Electric (PG&E) Co.’s disastrous US$2.2 billion smart-meter debacle in Bakersfield, CA to suggest that a cloud service broker should provide cloud services billing in his Who do you trust to meter the Cloud? post of 12/31/2009:

Customers of Cloud services right now depend on the "meters" being provided by the service providers themselves. Just like the PG&E customers in Bakersfield. This means that they depend on the service provider itself to tell them about usage and pricing. There isn't an independent audit trail of usage. The meter also locks the customer into the service provider.
A Cloud Service Broker addresses these issues. It is not a coincidence that much Cloud Service Broker terminology carries over from the world of utilities - it is solving the same problem:

“Data transfer to cloud computing environments must be controlled, to avoid unwarranted usage levels and unanticipated bills from over usage of cloud services. By providing local metering of cloud services' usage, local control is applied to cloud computing by internal IT and finance teams.”
http://www.vordel.com/solutions/cloud.html

The Cloud Service Broker analyzes traffic and provides reports as well as an audit trail. Reports include usage information in real-time, per hour, per day, and per service. Reports are based on messages and based on data. Visibility is key. This is all independent of an individual Cloud service provider. It is easy to imagine how useful this would be in conjunction with Amazon's spot pricing (see a great analysis of Amazon's spot pricing by James Urquhart here).

• Brian AlesOn Microsoft’s Azure essay of 12/31/2009 begins:

“Three screens and a cloud.”

msdatacenterThat’s how both Chief Software Ray Ozzie and CEO Steve Ballmer repeatedly described the future of computing in general over this past year.

Inside Microsoft’s crystal ball, traditional desktop computing is decreasing as applications move up into the internet, and a new generation of lightweight ‘screens’ (thin clients, mobile devices, and network-enabled televisions) become the three prevailing client-side hardware models.

It’s a good little slogan - and about as unambiguous an endorsement of the conventional wisdom on the bright future of cloud computing as one could imagine.

msservercontainersMicrosoft has had its share of advertising/PR issues over the last few years (think Jerry Seinfeld as a symbol of forward-thinking 21st century coolness, or the Windows 7 launch party infomercial).  It would be a shame if similar promotional missteps end up preventing the Microsoft Azure initiative from garnering the media buzz it deserves, though, because the company is every bit as dedicated to the cloud as the above quote would suggest – and they’re putting their money where Ray’s and Steve’s mouths are.

Consider the Chicago data center (pictured [above]), part of the massive global build-out of the Azure infrastructure that occurred over the past year.  Completed this past June, the facility occupies 700,000 sq. ft. - the size of 12 US football fields.  To populate a data center this size, 40 ft. shipping containers are packed full of servers and installed as power-efficient and easier-cooling modules (note to the firm handling Microsoft’s PR: that would make some pretty serviceable B-roll news segment footage).

Sadly, though, the remarkable physical build-out of Azure has been one of the more overlooked stories of 2009, and as the service is poised to go live for the enterprise tomorrow on New Years Day, there remains relatively little coverage in the general or trade media. …

Brian continues with comparisons between Windows Azure and Google App Engine/Amazon EC2.

Colinizer offers his 2010 New-Year Prediction: Silverlight + Azure = The New Windows on 12/31/2009:

It has probably not escaped many of you that Windows’ market share (and that of related editions) is being eroded and is potentially under threat to varying extents in some markets as we role into 2010. 

  • iPhone is whipping ‘Windows phones’ such that Windows Mobile 7 will likely be a do or die mission in in 2010 (or more realistically 2011)
  • Android is nibbling at Windows phones too
  • Zune is nowhere near iPhone
  • Netbooks with non-Windows OS installs are creeping into the remaining markets
  • Mac is constantly barking its commercials
  • LAMP is still thriving
  • Google is trying to satisfy basic user requirements will a wafer-thin OS or by being OS-independent

I think however, that Microsoft has the opportunity to really drive adoption of Windows, but not in the way it has before.  The real opportunity for Windows’ continued prosperity lies in the cloud.  Even though this may happen, I do not however think it will be seen as a success – at least not initially (and doomsayers for Windows will jump on this).  The resulting public attitude will probably really grate at Microsoft for some time. …

Hovhannes Avoyan summarizes IDC predictions in his Cloud Development Instrumental in IT Recovery for 2010 post of 12/31/2009:

Platform battles will accelerate. The field will get more crowded, and IDC expects IBM and Oracle to play new roles. And Google will make its own platform more attractive to large enterprises. Watch, too, for Amazon, to develop an application platform.

The next wave of hot public IT cloud services will rise and be centered around data/content (storage, distribution, and analytics), business applications (as adoption broadens for SaaS versions of enterprise applications), and personal productivity applications. These differ from today’s model of web hosting and collaboration services, for example, blogs, web conferencing and Twitter. Microsoft and IBM will play prominent roles in challenging today’s dominant player, Google Apps.

Security concerns will give rise to more private clouds – and from all major IT providers. Along with private clouds, there will be an explosion of “cloud appliances” as a “very simple-to-adopt” packaging approach. IT companies like Dell, IBM, HP, Sun, Fujitsu, Hitachi — and chipmakers Intel and AMD — will partner with software vendors to create cloud appliance versions of traditional versions of software.

Hybrid solutions will grow. IT product and service suppliers will develop tools to help customers “more cohesively and dynamically” manage their IT assets across internal servers, private clouds and their appliances, as well as public clouds.

Just as there’s a hot market for accessories for the iPod (cases, headphones), expect a hot market for cloud accessories to develop. These will focus on overcoming adoption barriers and will deliver predictable network quality of service and security. Later, other functions such as data indexing and cloud asset management will be introduced. All will aim to make public and private cloud services faster, safer, more reliable, and more useful.

Cloud players – in infrastructure, platform, application, and management/optimization cloud services categories – will develop API-based partner/solution ecosystems. API partners will add value to cloud providers’ offerings.

Charlie Burns, Bruce Guptil and Mark Koenig deliver IT Resolutions for New Decade, Old Theme of Constant Change in this 12/31/2009 Research Alert from Saugatuck Research (site registration required). Among the five resolutions, the follow two concern cloud computing:

… RESOLVED, that beginning in the year 2010, IT organizations will:

1. Approach Cloud Computing as a series of tactical forms of IT that can improve the elasticity & flexibility of the business …

5. Guide and facilitate enterprise adoption of Cloud Computing …

The authors flesh out their resolutions with additional detail.

Rob Enderle calls 2010: The Year and Decade of the Cloud in this 12/30/2009 Datamation article:

It is interesting that we tend to go through cycles. We started off with big centralized computers and relatively dumb terminals. Now with the rapid growth in Smartphones, the expected success of Smartbooks and Smart-Tablets (like the rumored iSlate), and the proliferation of devices like plug computers we appear to be facing a future that looks a lot like our past.

Like with any change, vendors that are in power this decade may not be in power in the next decade unless they significantly change how they think about the market. Companies that had their roots and beginnings in large systems like EMC, HP, and IBM may have advantages in terms of services, structure and systems. But they will still have to deal with the individual users who aren’t planning on giving up any power.

Companies like Apple and Microsoft, which started off more user focused, will need to better embrace the concepts of big centralized systems or be trivialized by them. This, of course, provides a unique opportunity for new companies - like Google – to come in and dominate what is coming because they can grow into the business. But they still have to roll over the other players. …

Rob concludes re Microsoft and Windows Azure:

… It is interesting to note that of all the companies Microsoft is likely the only one that has a full blend, with Azure, of all of the software elements and interoperability practices to become the major power for the next decade. It would require an effort like .Net or their original push to the Internet to do this. Perhaps this will be Steve Ballmer’s biggest test, can he, like Bill Gates did, turn the company on a dime. [Emphasis added.]

We’ll see, but one thing is sure, when this coming decade is over the surviving players won’t look anything like they do today. Even Apple, the shining star of this decade, will have to change to reflect the coming New World. …

Prognosticators should remember that the 2010 decade begins on 1/1/2011.

<Return to section navigation list> 

Cloud Security and Governance

Mamoon Yunus reports that Rob Berry asks Does Cloud Computing Exacerbate Security and File Transfer Issues? in this 12/31/2009 post:

Here is an interesting article by Rob Barry titled: "In SOA, cloud resources may exacerbate security and file transfers issues." It highlights significant requirements for Federated SOA especially around large file transfer using SOAP Attachments. The article makes the following interesting points:

With increasing cloud adoption, there is an increase of large file transfers to external cloud providers such as Amazon S3 or Rackspace CloudFiles or to a company's internally hosted cloud.  The file size increase is driven by the a low-hanging use case for S3 and CloudFiles:  securely archiving rarely used corporate data in the cloud.  The result of such archiving of batch data is an ever-growing file transfer over HTTP as a MIME of MTOM attachments.  Consider the opposite scenario:  if the data is real-time the transaction rate is higher but the files sizes are usually small.  According to Frank Kenny,  Gartner Research Director:  "As we start to use more cloud-based services, the problem is going to exacerbate itself because we're dealing with bigger data, bigger attachments," said Kenney. "But we want the same performance that we've always been able to maintain." …

Lori MacVittie recommends that you “Write It Like Seth” [Godin] in her WILS: What Does It Mean to Align IT with the Business post of 12/30/2009:

We’ve been talking about “aligning IT with the business” since SOA first took legs but you rarely see CONCRETE EXMAPLES OF WHAT THAT REALLY MEANS.

It sounds much more grand and lofty than it really is. To put it in layman’s terms, or at least take it out of marketing terms, aligning IT with the business is really nothing more than justifying or tying a particular IT investment or project to a specific business goal. What that means ultimately is that you, as an IT professional, must understand what those business goals are in the first place. Once you know the goals, you can translate them to an IT goal and then down into specific operational implementations supporting or enabling that goal. If that operational implementation requires an investment, you can then justify the investment based on support for that specific business goal. …

Lori continues with “a few examples of translation from business goal to operational implementation.”

<Return to section navigation list> 

Cloud Computing Events

Ryan Dunn will present a Building Cloud Services with Azure workshop at MIX10 in Las Vegas, NV:

Windows Azure allows you to deploy and scale your web applications transparently in the cloud. You can build Azure application with ASP.NET and SQL Server, or with open source components such as PHP and MySQL. Gain the skills to architect and develop real-world applications using Windows Azure. It is expected that attendees have some prior experience with Windows Azure, and the Azure Services Training Kit is a recommended prerequisite. During this half-day workshop, we show how to build basic Windows Azure applications on Microsoft and open source technologies, and introduce best practices for deploying, managing, and scaling your applications.

MIX10 takes place on 3/15/2009 through 3/17/2009, but the post doesn’t mention the date on which the workshop will occur.

James Hamilton’s Cloud Computing Economies of Scale is still MIX10’s only cloud-computing session. Strange!

<Return to section navigation list> 

Other Cloud Computing Platforms and Services

Kevin L. Jackson’s Most Influential Cloud Bloggers for 2009 includes what Ulitzer claims is a list of the “World’s 30 Most Influential Bloggers.” It’s actually a list of 30 Ulitzer contributors to their Cloud Computing blogs from the left pane of this page.

Conspicuous by their absence are Chris Hoff (@Beaker, Rational Survivability blog), James Urquhart (@jamesurquhart, The Wisdom of Clouds blog), John Willis (@Botchagalupe, IT Management and Cloud Blog), Jeff Barr(@jeffbarr, Amazon Web Services Blog and Jeff Barr’s Blog) and other well-respected, frequent bloggers of cloud-computing topics. Alan Irimie, who’s #12 on Kevin’s version of the list, last posted to his Azure Journal in mid-November 2009.

Ulitzer claims that only its contributors are the “Most Influential Cloud Bloggers” is epic chutzpah.

There was a good deal of controversy in 2009 about Ulitzer hijacking bloggers’ content without permission. Here are links to Sam Johnston’s Who's lying about the Ulitzer Cloud Security Journal? post of 9/26/2009 and Aral Balkan’s My Sys-Con Nightmare post of 7/27/2009.

• Amazon Web Services is reporting EC2 connectivity issues in the US-EAST-1 availability zone on 1/2/2010:

10:36 AM PST We are investigating intermittent connectivity issues for some instances in a single US-EAST-1 availability zone.

There were a few tweets about the problem. Guy Rosen (@guyro) is following the story, as is Carl Brooks (@eekygeeky).

•• James Hamilton’s MapReduce in CACM post of 1/2/2010 tackles the Great MapReduce Debate:

In this month’s Communications of the Association of Computing Machinery, a rematch of the MapReduce debate was staged. In the original debate, Dave Dewitt and Michael Stonebraker, both giants of the database community, complained that:

  1. MapReduce is a step backwards in database access
  2. MapReduce is a poor implementation
  3. MapReduce is not novel
  4. MapReduce is missing features
  5. MapReduce is incompatible with the DBMS tools

Unfortunately, the original article appear to be no longer available but you will find the debate branching out from that original article by searching on the title Map Reduce: A Major Step Backwards. The debate was huge, occasionally entertaining, but not always factual. My contribution was MapReduce a Minor Step forward. …

James continues with descriptions of additional MapReduce resources.

John Treadway lists important new features introduced by Amazon Web Services during 2009 in his Amazon Named “CloudBzz Innovator of the Year” post of 12/31/2009:

2009 has certainly been a cloudy year.  The sheer volume of real innovation somehow makes all of the hype worthwhile.

amazonnumber1-b

While there were many companies doing interesting and innovative things in the cloud – Microsoft Windows Azure could be a strong 2010 contender – the decision on who wins for 2009 is no contest.

Amazon gets the CloudBzz “Innovator of the Year” award with a never-ending stream of great stuff that only seemed to accelerate as the year progressed. …

John reported Amazon Adding Active Directory Support (mini-scoop) from PDC on 11/18/2009, but that’s not in his list. See Azure Owns the Enterpri$e of 11/17/2009 for John’s take on Windows Azure’s position in the cloud computing market.

Eric Engleman asks Amazon.com to sell call center service to other companies? in this 12/30/2009 post to the TechFlash blog:

Is Amazon.com planning to offer its call center technology to other companies? A new job posting from the online retailer seems to indicate so. Amazon is seeking engineers to work on its "internally developed Call Center Platform" who will help take the technology "to the next level, making it available to organizations outside of Amazon."

That would be an interesting addition to Amazon's growing suite of cloud computing services.

Update [12/31/2009]: The job posting was briefly taken down yesterday following this report but is back up now.

Amazon is specifically seeking VoIP/SIP engineers for the job. It doesn't give details about the platform, other than it "currently powers all of Amazon's call centers, supporting thousands of concurrent customer calls, and tens of thousands of agents."

Interestingly, Twilio, a startup that helps developers to build phone system applications in the cloud, just raised more than $3 million in new funding to build its business. Twilio was founded by Amazon Web Services alum Jeff Lawson.

<Return to section navigation list> 

Monday, September 14, 2009

Windows Azure and Cloud Computing Posts for 9/7/2009+

Windows Azure, Azure Data Services, SQL Azure Database and related cloud computing topics now appear in this weekly series.

•• Update 9/12/ and 9/13/2009: Live CloudDotNet sample project, Wade Wegner’s Azure presentation, NY Times and Hadoop, and more.
• Update 9/10/ and 9/11/2009: Sample Azure app down 25 minutes overnight, Dell offers migration from paper to cloud based medical record storage, NHibernate Shards, SQL Azure Reference Data (OGDI), Microsoft’s Chicago data center goes live. 
Note: Articles for 9/7/2009 have been duplicated from Windows Azure and Cloud Computing Posts for 9/3/2009+.

Note: This post is updated daily or more frequently, depending on the availability of new articles in the following sections:

To use these links, click the post title to display the single article you want to navigate.

Azure Blob, Table and Queue Services

Dare Obasanjo’s long-awaited (at least by me) Building Scalable Databases: Denormalization, the NoSQL Movement and Digg post of 9/10/2009 begins:

Database normalization is a technique for designing relational database schemas that ensures that the data is optimal for ad-hoc querying and that modifications such as deletion or insertion of data does not lead to data inconsistency. Database denormalization is the process of optimizing your database for reads by creating redundant data. A consequence of denormalization is that insertions or deletions could cause data inconsistency if not uniformly applied to all redundant copies of the data within the database.

His “The No-SQL Movement vs. Abusing Relational Databases for Fun & Profit” topic appears to denigrate SQL Azure:

If you’re a web developer interested in building large scale applications, it doesn’t take long in reading the various best practices on getting Web applications to scale such as practicing database sharding or eschewing transactions before it begins to sound like all the advice you are getting is about ignoring or abusing the key features that define a modern relational database system. Taken to its logical extreme all you really need is a key<->value or tuple store that supports some level of query functionality and has decent persistence semantics. Thus the NoSQL movement was borne.

Remember that Microsoft abandoned it’s Entity-Attribute-Value based SQL Server Data Services (SSDS), later SQL Data Services (SDS) in favor of a fully relational SQL Azure implementation.

Waiming Mok analyzes non-relational data storage formats in his Data Stores: No One Solution post of 9/7/2009:

As Michael Stonebraker points out in his blog on ACM:  there is no one database that solves all problems.

Same thing can be said of data stores:  it’s no longer a choice between direct attached disks, SAN block storage, NAS file systems.   Many of the developments came about because of the use of multiple servers to build web services, cloud computing, and grid computing.  The developers found that they can significantly improve system performance by locating data closer to the application or to the edge (where the data is accessed), that they could ease the complexity of development by relaxing consistency constraints (which are not needed) — see CAP Theorem, and that they could significant lower costs by avoiding or minimizing the use of expensive SAN storage or CDN data delivery.

Waiming concludes his post with a table that briefly describes Hadoop HDFS, Facebook Haystack and Yahoo! MObstor.

• Shawn Wildermuth’s ADO.NET Data Services 1.5 Feature: Projections post of 9/9/2009 begins:

If you've been following my blog, you should know that I am keeping a pretty close watch on ADO.NET Data Services. The team recently released a second CTP of the new version with some interesting features. This CTP has some pretty compelling additions, but I am going ot focus on one in particular.

I've been teaching and using ADO.NET Data Services for a long time and I like showing off exposing a LINQ-based provider (Entity Framework, NHibernate or others) to a Silverlight application. While ADO.NET Data Services does expose its API through a REST API, the magic for me is in its use in Silverlight. In case you haven't been following along, using the Silverlight client you can issue a LINQ query through the Silverlight client (though in fairness, the full power of LINQ is not supported in the client).

Shawn continues with C# examples.

<Return to section navigation list> 

SQL Azure Database (SADB, formerly SDS and SSDS)

Steven Forte discovers SQL Azure Does Stored Procedures in this 9/11/2009 post:

When SQL Data Services (now SQL Azure) released its first CTP it did not look anything like SQL Server: there were no tables, stored procedures, views, etc. With the new CTP, SQL Azure embraces SQL Server in the sky and supports the relational model, including stored procedures. This is good since there are millions of lines of stored procedures out there in production today and migrating them to SQL Azure is pretty easy.

He continues with a demonstration of creating a simple T-SQL stored proc in SADB.

• Simon Munro’s The Trouble With Sharding post of 9/10/2009 points out that:

Database sharding, as a technique for scaling out SQL databases, has started to gain mindshare amongst developers.  This has recently has been driven by the interest in SQL Azure, closely followed by disappointment because of the 10GB database size limitation, which in turn is brushed aside by Microsoft who, in a vague way, point to sharding as a solution to the scalability of SQL Azure.  SQL Azure is a great product and sharding is an effective (and successful) technique, but before developers that have little experience with building scalable systems are let loose on sharding (or even worse, vendor support for ‘automatic’ sharding), we need to spend some time understanding what the issues are with sharding, the problem that we are trying to solve, and some ways forward to tackle the technical implementation. …

Simon continues with an analysis of sharding techniques and issues, and concludes with:

I am disappointed that the SQL Azure team throws out the bone of sharding as the solution to their database size limitation without backing it up with some tools, realistic scenarios and practical advice.  Sharding a database requires more than just hand waving and PowerPoint presentations and requires a solid engineering approach to the problem.  Perhaps they should talk more to the Azure services team to offer hybrid SQL Azure and Azure Storage architectural patterns that are compelling and architecturally valid.  I am particularly concerned when it is offered as a simple solution to small businesses that have to make a huge investment in a technology and and architecture that they are possibly unable to maintain.

I’m disappointed, too, Simon. Perhaps the SQL Azure team will throw some light on recommended sharding patterns and practices at PDC09.

See Dare Obasanjo’s Building Scalable Databases: Denormalization, the NoSQL Movement and Digg post of 9/10/2009 in the preceding section.

• Michael Otey lists 7 Facts About SQL Azure in this 9/3/2009 article for SQL Server Magazine:

The move to the cloud has been a big trend for technology vendors this year. However, businesses haven’t been so fast to follow. Moving to the cloud entails making many application-related changes. Even so, the cloud promises scalability and cost savings that make it worth considering. The cloud in this case is SQL Azure, formerly SQL Data Services, Microsoft’s SQL Server-based database cloud offering. Let’s look at seven things you need to know about SQL Azure.

Ayende Rahien proposes completing the NHibernate Shards project with volunteers in his SQL Azure, Sharding and NHibernate: A call for volunteers post of 10/6/2009. Ayende says:

Sharding is a term that was invented by Google, and a few years ago several Google engineers decided that they want to use Sharding with Hibernate. Thus, the Hibernate Shards project was born, bringing transparent sharding support to Hibernate.

The equivalent project for NHibernate was started, but porting was never complete. This is a call for volunteers to help continue the port of Hibernate Shards to NHibernate. You now have a very clear goal for why you would want that.

My fully illustrated Using the SQL Azure Migration Wizard with the AdventureWorksLT2008 Sample Database post of 9/7/2009 describes how to use George Huey’s schema migration utility to duplicate schemas of on-premises SQL Server databases in SQL Azure Database tables in Microsoft Data Centers and the problems I encountered when using the Wizard with the AdventureWorksLT2008 sample database to populate the tables with data.

Ayende Rahien (a.k.a., Oren Eini) reports in his NHibernate on the cloud: SQL Azure - Ayende Rahien post of 9/7/2009:

I just finished running the NHibernate test suite against SQL Azure. I am very happy to say that It Just Works*.

Hat tip for Microsoft for managing to create an environment so similar to that of SQL Server under a drastically different conditions.

* The only caveat is that some Schema Export scripts fails on SQL Azure, it seems like drop table has some slightly different behavior with SQL Azure, it does not drop the table immediately, but there seems to be some delay before it actually happens (especially if you use a different connection to check for the existence of the table).

<Return to section navigation list> 

.NET Services: Access Control, Service Bus and Workflow

Nigel Watling explains What are .NET Services? in the 00:07:01 Channel9 video of 9/10/2009:

This brief video gives an introduction to .NET Services. We'll explore its components, what they do and what value they provide.

The .NET Services Team reports .NET Services Scheduled Maintenance (September 8th, 2009) – COMPLETE on 9/8/2009. If the “Routine maintenance on the storage layer of the Access Control Service” actually took down ACS for the scheduled 6 hours, that would result in .NET services uptime for September being 99.17% (6/720), not 99.5% or 99.95%.

<Return to section navigation list> 

Live Windows Azure Apps, Tools and Test Harnesses

cirrious offers CloudDotNet, a Windows Azure project that lets you browse all projects by keyword. However, only the app displays only the first two OakLeaf sample projects when searching with OakLeaf as the keyword.

Jean-Christophe Cimetiere’s Viewing public government data with Windows Azure and PHP: a cloud interoperability scenario using REST post of 9/10/2009 to the Interoperability@Microsoft blog demonstrates a government data and Platform Interoperability scenario in the cloud:

This week Microsoft is participating in the first Gov 2.0 Summit produced by O'Reilly Media, Inc. and TechWeb in Washington D.C., to explore how technology can enable transparency, collaboration and efficiency in government. Today, we're pleased to present a cloud interoperability scenario which takes advantage of the recently announced Toolkit for PHP with ADO.NET Data Services to view public government data with Windows Azure and PHP.

As you may recall, few weeks ago, Microsoft announced the Toolkit for PHP with ADO.NET Data Services, a new bridge enabling PHP developers to connect to .NET using a RESTful architecture. Today, we've published a cloud interoperability scenario where a Windows Azure application exposes data in a standard way (XML / Atom) and how you can simply “consume” this data from a PHP web application. This scenario takes advantage of the Open Government Data Initiative (OGDI), another piece of Microsoft's Open Government effort, built on the foundation of transparency, choice and interoperability.

The Open Government Data Initiative (OGDI) is a project launched in May by our colleagues from the Microsoft Public Sector Developer Platform Evangelism team

In a nutshell, Open Government Data Initiative (OGDI) is a cloud-based collection of software assets that enables publicly available government data to be easily accessible. Using open standards and application programming interfaces (API), developers and government agencies can retrieve the data programmatically for use in new and innovative online applications, or mashups.

Reuven Cohen adds his US$0.02 to the preceding project in his Governmental Cloud Interoperability on The Microsoft Cloud post of 9/11/2009.

• Glenn Laffel, MD takes the Office of the National Coordinator (ONC) for Health IT to task for its failure to adhere to a January 2010 timeframe for a definition of “meaningful use” of Electronic Health Records (EHR) in his ONC: A Call to Action post of 9/11/2009:

ONC had planned to have finalized meaningful use criteria by this January, but after receiving far more public feedback than expected, ONC punted the sign-off date all the way to spring.

In itself, the delay appears innocuous, but seen in the context of ONC’s complex agenda and recent developments in the marketplace, the delay could spell trouble (as we describe below).

Meanwhile, the EHR vendor certification process remains in a planning stage. ONC’s HIT Policy Committee announced a few weeks back that would recommend that 10-12 entities be empowered to certify EHR systems but so far as we know, ONC has not signed off on this, much less begun to screen and select the entities.

Entity selection itself will take time, yet it is a relatively small step in the deployment of a full-blown certification process. …

My Electronic Health Record Data Required for Proposed ARRA “Meaningful Use” Standards post of 9/5/2009 explains the Personal Health Record (PHR) objectives of the “meaning use” criteria to qualify for ARRA provider subsidies and bonus payments. PHR is expected to a major market for cloud computing services in the 2010 decade.

John ?’s CCHIT Town Hall Meeting on Preliminary ARRA Certified EHR post of 9/11/2009 takes a dim view of CCHIT “meaningful use” certification of EHRs:

I’ll be honest with you. For my own health I took off the last month from reading about CCHIT. I guess the birth of my third child made a difference as well. However, I’d been getting some comments and emails lately about CCHIT’s new certification programs and so I had to go and take a look at what was going on. Well, let’s just say that CCHIT has yet to disappoint me. They are so full of CCHIT that it’s not even funny. The conclusions they come to are crazy. Ok, now that I’ve made my bias clear, take a look at some of the things they’re saying. …

John Chilmark says that today’s “Personal Health Record” definition is outmoded and PHRs should be replaced by Personal Health Platforms in his Time to Kill the PHR Term: Part 1 and Time to Kill the PHR Term: Part 2 posts of 9/9 and 9/10/2009:

Yesterday, we outlined why the PHR term has the potential to stunt future advances in consumer health and engagement via HIT.  Our thesis is that the PHR term is rooted in a dated concept of simply providing the user/citizen a virtual file cabinet for their health records.  Since the initial introduction of Internet-based PHRs nearly a decade ago, adoption has been by and large abysmal.  Our belief is that adoption, or lack thereof, is symptomatic of PHRs not having a sufficient value proposition for the vast majority of potential users.

But where we really get concerned with the PHR term is that in the meaningful use recommendations that were accepted in July.   Under meaningful use guidelines, those obtaining Stimulus (ARRA) funding for adoption of a certified EHR must provide a PHR to their patients by 2013.  Trouble here is how will HHS define what that PHR is?  Last year, HHS paid a princely sum to have the PHR term defined (see below).  This term, we have been told, is what will be used within the context of meaningful use rule making.  If this is indeed true, adoption of PHRs will continue to be lackluster.

The “princely sum” was the US$500,000 that HHS paid Bearing Point to define six health-related acronyms.

• Bill Peterson’s Risk Management and BI Cloud Computing – Will It Work and Who’s in Charge? post of 9/11/2009 to Tibco’s Spotfire blog briefly discusses risk management for cloud-based business intelligence projects:

As Cloud Computing matures, will it evolve into a viable platform used by financial services organizations, including Risk Management?  If so, are Business Intelligence (BI) tools the best mechanism to access, navigate, manipulate, and report on the Cloud-based data and content?  If we oversimplify and look at Cloud Computing as simply picking up our data centers and placing them in the Cloud, then our existing BI tools would likely follow. However, if we look at financial services, and specifically Risk Management, the questions become:

  • Who is in charge of minimizing risk when BI happens in the Cloud?
  • Should any of the risk extend to the Cloud provider? …

• Jamie Thomson released his RESTful Northwind on SQL Azure sample application to public access on 9/10/2009:

I recently gained access to SQL Azure, the hosted database part of Microsoft’s Azure cloud offering. I don’t currently have a reason to use SQL Azure in my day-to-day work so I set myself a small project that would enable me to prod and poke at the service and hopefully learn a bit about it. I decided to implement a RESTful service on top of the venerable Northwind database using SQL Azure (for data storage), ADO.Net Data Services (for service enabling the data) and Windows Azure (for hosting the service). The resultant service is available at: http://northwindazure.cloudapp.net/Northwind.svc/

Following are a few of Jamie’s sample queries (make sure feed reading is turned off in your browser):

Customer ALFKI http://northwindazure.cloudapp.net/Northwind.svc/Customers('ALFKI')
Order Details items with a price > US$250 http://northwindazure.cloudapp.net/Northwind.svc/Order_Details?$filter=UnitPrice%20gt%20250
All orders by customer ANATR http://northwindazure.cloudapp.net/Northwind.svc/Customers('ANATR')?$expand=Orders
All order details of all orders by customer ANATR http://northwindazure.cloudapp.net/Northwind.svc/Customers('ANATR')?$expand=Orders/Order_Details
All order details for the first 3 customers http://northwindazure.cloudapp.net/Northwind.svc/Customers?$top=3&$expand=Orders/Order_Details
All products in all orders for the first 3 customers http://northwindazure.cloudapp.net/Northwind.svc/Customers?$top=3&$expand=Orders/Order_Details/Products

Jamie continues with a description of the project. Source code is available from CodePlex.

• Sopima announces its “Online Contract Bank – A Contract Management Software-as-a-Service from the Microsoft Azure Cloud” in this Sopima Demystifies Contract Management post of 9/10/2009:

Sopima is a new online service for Contract Creation, Deal Making and Contract Management. The service consists of (1) a smart secure contract bank, (2) online negotiation and signature tools, and (3) contract management best practices.

Sopima makes content of the contracts smart and interactional. This includes automated reminders on tasks and deadlines. The service ensures collaboration and true business productivity for financial and administrative managers and legal consultants. The value is brought to the customer by shortening the time to negotiate deals, saving time in daily tasks, and enabling transparency with extensive search and reporting on all contract assets. Sopima also takes risk management to a new level with no more expensive lessons in neglected or forgotten commitments.

Sopima is a Finnish member of Microsoft’s BizSpark program. Not surprisingly, its Web site is regionalized in Finnish.

Maarten Balliauw released PHP Azure CPT 3 (v0.3.0) to CodePlex on 9/10/2009. I can’t find a description of the changes to CPT 2 on CodePlex or from Maarten’s Tweets on the topic.

My Lobbying Microsoft for Azure Compute, Storage and Bandwidth Billing Thresholds for Developers post of 9/8/2009 proposes that Microsoft offer developers a Microsoft Azure Platform instance at a monthly charge of $9.95 for compute, 1GB of storage, and 1GB of ingress and egress bandwidth for development or public-facing demo applications.

Anand Iyer shows you how to Exchange Business Cards on Twitter – @TwtMyCard in this 9/8/2009 post:

First off, my friend Kevin Marshall (@ksmarshall) deserves a HUGE pat on the back for this. I first had this idea first at SxSW and had created an ugly-as-sin prototype several months later. I’d coded it using WebForms in ASP.NET and C# and hosted it on Windows Azure. I shared the idea with Kevin, who basically threw away all my code and rewrote the ENTIRE thing in ASP.NET MVC and of course made it look ridiculously pretty.

There’s a front-end Windows Azure web role that you get to see, and a background worker role (we call it the ‘bot’) that wakes up every few minutes, reads all the direct messages (since the last time it read DMs), parses the message, and sends @ messages to the recipient with a link to the sender’s profile.

All the profile data is hosted on Azure Table Storage.

Bill Crounse, MD requests that you Please take care in selecting an EMR for your practice in this 9/8/2009 post to the Microsoft HealthBlog:

As reported by HDM on-line, the Office of the National Coordinator for Health Information Technology has published additional information on a $598 million grant program to fund the creation of about 70 Health Information Technology Regional Extension Centers.  The centers will help hospitals and physicians select, acquire and use electronic health records systems.

No doubt some serious education and hand-holding will be needed as more physicians and hospitals take the plunge into electronic medical record systems and “meaningful use”.  If taking the plunge is anything like what I saw and heard during a visit to my own doctor last week, doing your EMR homework before you buy is an important step if you hope to swim rather than sink. …

With SQL Azure coming on line, the Windows Azure Platform becomes a more attractive candidate for hosting Electronic Medical Records (EMR), in addition to Personal Health Records (PHR).

Robert Rowley MD calls Electronic Medical Records a Disruptive innovation in healthcare in this 9/8/2009 post:

… [A]n Electronic Health Record (EHR) system needs to be able to create data that is standardized, such that data from different sources can be exchanged transparently, and used to create reports and decision-support at the point of care.

In a setting where large, legacy vendors (the “health IT mainframes”) have created a landscape of separate, locally-installed, proprietary and closed systems, the only way to achieve these national health goals is to enforce a set of standards for data exchange – this means that specific pieces of clinical data need to be identified as being “important” (like medications, allergies, immunizations, demographics, and lab values), a standard format for import/export of these pieces of data needs to be required of all vendors (the CCD and CCR standards), and some data-interchange platforms need to be created where this standardized data can be uploaded to and downloaded from (regional Health Information Exchanges, or HIEs, and the National Health Information Network, or NHIN). This is especially important if one believes that “the future will be a bigger version of the past,” and that the landscape will continue to be local, segregated and proprietary. …

Reuven Cohen reports on CloudLoop - Universal Cloud Storage API in this 9/8/2009 post:

… The CloudLoop project is described as a universal, open-source Java API and command-line tool for cloud storage, which lets you store, manage, and sync your data between all major providers.

According to the announcement Cloudloop aims to solve cloud storage related problems by putting a layer in between your application and its storage provider. It gives you one simple storage interface that supports a full directory structure and common filesystem-like operations (e.g. mv, cp, ls, etc).

The project currently supports Amazon S3, Nirvanix, Eucalyptus Walrus, Rackspace CloudFiles, Sun Cloud, with support coming soon for Microsoft Azure, EMC Atmos, Aspen, Diomede storage clouds. … [Emphasis added.]

Alan Smith has created "a Windows Azure Hosted community site featuring webcasts from the Microsoft development community” according to the MVP Releases Windows Azure Community Site post of 9/2/2009 to The Microsoft MVP Award Program blog:

CloudCasts.net aims to cover a wide range of Microsoft technologies and provides a learning resource for developers whilst providing an option for community members to make their ideas available to a wider audience. The About page contains contact information for anyone wishing to have their webcasts added, along with tips for producing your own webcasts.

The site already has some famous names from the MVP community and Microsoft, and it would be great to hear from other MVPs or individuals who are producing webcasts or screencasts. You can contact Alan through his blog, or the CloudCasts Twitter.

My illustrated Using the SQL Azure Migration Wizard with the AdventureWorksLT2008 Sample Database post of 9/7/2009 describes how to use George Huey’s schema migration utility to duplicate schemas of on-premises SQL Server databases in SQL Azure Database tables in Microsoft Data Centers and the problems I encountered when using the Wizard with the AdventureWorksLT2008 sample database. [Repeated from SQL Azure Database (SADB).]

Magnus MĂ¥rtensson’s Extensible Windows Azure projects using MEF post of 9/7/2009 explains how to extend Azure project and contains links to earlier testability and persistence ignorance projects:

Here is how to enable a rich extensibility model for Windows Azure projects and how to run create jobs on Windows Azure Storage only once in your Windows Azure Projects. This sample and related AzureContrib release leverages Managed Extensibility Framework (MEF) – an upcoming .NET Framework component in .NET Framework 4.0.

The[re have] been three releases of AzureContrib, each one aimed to make the basic Windows Azure project template a bit more rich and intelligent.

The new release to AzureContrib adds a couple of important services (AzureContrib.ServiceHosting.ServiceRuntime.Services); the IWorkService And the IOneTimeWorkService. Also it adds a bit more intelligence to a Windows Azure Page, UserControl and most importantly to the Windows Azure WorkerRole.

Here are links to 23 videos about Microsoft HealthVault.

<Return to section navigation list> 

Windows Azure Infrastructure

Sam Johnston’s An obituary for Infrastructure as a Product (IaaP) post of 9/13/2009 begins:

There's been an interesting discussion in the Cloud Computing Use Cases group this week following a few people airing grievances about the increasingly problematic term "private cloud". I thought it would be useful to share my response with you, in which I explain where cloud came from and why it is inappropriate to associate the term "cloud computing" with most (if not all) of the hardware products on the market today.

All is not lost however - where on-site hardware is deployed (and maintained by the provider) in the process of providing a service then the term "cloud computing" may be appropriate. That said, most of what we see in the space today is little more than the evolution of virtualisation, and ultimately box pushing.

Jim Liddle’s Cloud Computing Best Practices post of 9/12/2009 describes what to be aware of “when putting your application on the cloud.” Topics include:

  • Licensing
  • Data transfer costs
  • Latency
  • State
  • Data regulations
  • Dependencies
  • Standardisation
  • Security
  • Compliance
  • Quality of Service
  • System hardening

• Bob Evans reports on the Central US (Chicago) data center in his Global CIO: Microsoft Opens $500M Data Center Mothballed In January post of 9/9/2009 for InformationWeek: “Now that Microsoft's massive Chicago data center has been delayed, mothballed, purchased, and finally opened, it's time for the $500 million drama queen to grow up.”

You want your data center to be many things, but drama queen is not one of them. And while Microsoft (NSDQ: MSFT)'s brand-new, colossal, $500 million data center near O'Hare Airport will probably turn out to be as outwardly dull as a pantomime in the fog, it's had a turbulent gestation period: in January, Microsoft delayed its opening indefinitely as part of the company's plan to cut $700 million dollars in costs, including the phased layoff of 5,000 workers. …

• Pingdom reported on 9/10/2009 that My OakLeaf Systems Azure Table Services Sample Project was down 23 minutes during the early morning:

Pingdom DOWN alert: Azure Tables (oakleaf.cloudapp.net) is down since 09/10/2009 02:03:21AM.

Pingdom UP alert: Azure Tables (oakleaf.cloudapp.net) is UP again at 09/10/2009 02:28:21AM, after 25m of downtime.

25 minutes of downtime =  25 / (60 * 24 * 30) =  99.942% uptime with <Instances count="2" />. This is just barely under the Service Level Agreement’s guarantee with two instances = 99.95%.

Kevin L. Jackson claims 1 Billion Mobile Cloud Computing Subscribers !! by 2014 in this 9/9/2009 post:

Yes. That's what I said! A recent EDL Consulting article cites the rising popularity of smartphones and other advanced mobile devices as the driving force behind a skyrocketing mobile cloud computing market.

According to ABI Research, the current figure for mobile cloud computing subscribers worldwide in 2008 was 42.8 million, representing 1.1 percent of all mobile subscribers. The 2014 figure of 998 million will represent almost 19 percent of all mobile subscribers. They also predicted that business productivity applications will take the lead in mobile cloud computing applications, including collaborative document sharing, scheduling, and sales force automation.

"The major platform-as-a-service providers - Force.com, Google and Amazon - are expected to start "aggressively" marketing their mobile capabilities starting in 2010. An earlier study from ABI Research reported that mobile cloud computing will generate annual revenues of more than $20 billion by 2014."

Lori MacVittie describes the Impact of Load Balancing on SOAPy and RESTful Applications: “A load balancing algorithm can make or break your application’s performance and availability” in this 9/9/2009 post:

It is a (wrong) belief that “users” of cloud computing and before that “users” of corporate data center infrastructure didn’t need to understand any of that infrastructure. Caution: proceed with infrastructure ignorance at the (very real) risk of your application’s performance and availability. Think I’m kidding? Stefan’s SOA & Enterprise Architecture Blog has a detailed and very explanatory post on Load Balancing Strategies for SOA Infrastructures that may change your  mind.

George Moore spells out the business folks’ view in his Windows Azure Business Model for Developers - An Introduction Chanel9 interview of 9/8/2009:

21 year Microsoft veteran and Software Architect George Moore is involved in defining and implementing an effective strategy for taking Windows Azure from technology preview to enterprise business ready. Specifically, George is responsible for all integration of all Azure services (Windows Azure, SQL Azure, .NET Services) to other systems at Microsoft. This includes the billing system integration across all Azure services, the business owner portal, and the developer portal for all Azure services.

Here, we get to know a bit more about the thinking behind the commercialization of Windows Azure (which you will learn more about in great detail at PDC 09).

Steve Lessem claims Cory Doctorow Misses the Point of Cloud Computing in his 9/8/2009 rejoinder:

With all due respect to Cory Doctorow, he's wrong.
In his article Not every cloud has a silver lining (Guardian) he states:

“There's something you won't see mentioned by too many advocates of cloud computing - the main attraction is making money from you.”

And I suppose all the vendors of physical storage, the hard drives, etc., are interested in your spiritual well being!

Here's the heart of Doctorow's beef with cloud computing:

“Rather than buying a hard-drive once and paying nothing - apart from the electricity bill - to run it, you can buy cloud storage and pay for those sectors every month. Rather than buying a high-powered CPU and computing on that, you can move your computing needs to the cloud and pay for every cycle you eat.”

The point he misses is that cloud computing exists because it answers a real need. … [Emphasis Steve’s.]

B. Guptil and B. McNee authored An Endless Cycle of Innovation: Saugatuck SaaS Scenarios Through 2014, a $1,295 Sawgatuck Research Report that covers SaaS and Cloud Computing scenarios:

This report includes analysis, insights and guidance developed from Saugatuck’s fourth annual SaaS research program, which was comprised of a web survey including 1,788 qualified user enterprise executives; interviews with 30 user enterprise executives with SaaS experience; and briefings with 25 SaaS vendors/providers.

“The research shows us a combination of changing SaaS acquisition and adoption, both as a result of the global recession, and as a result of the changing nature of SaaS itself. How users do business with SaaS is changing how providers develop and deliver SaaS, and is changing how ISVs and other players will need to compete over the next several years,” according to Saugatuck founder and CEO Bill McNee, one of the study’s lead authors. “Failure to recognize and adapt to these changes will make it extremely difficult, and much more costly than it should be, for anyone to benefit from SaaS.”

The following is from the Research Summary topic:

    • Despite impressive investments in SaaS development and adoption in different parts of the world, SaaS (and Cloud Computing) will not become the primary IT standard and practice by YE 2012. SaaS will instead be primarily an important “agent of change” through this time period.
    • By YE 2014, however, SaaS (and Cloud Computing) will become integral to infrastructure, business systems, operations and development within all aspects of user firms, with variations in status and roles based on region and business culture.
    • While SaaS has favored both startups and established firms with a variety of management styles and pocketbooks, the current economic challenges will weed out all but the better-funded and better-managed SaaS providers by YE 2012 (especially those that are not cash-flow positive).

Anthony Ha asks Is it time for businesses to embrace the cloud? in this 9/7/2009 post to Venture Beat’s “Conversations on Innovation” section that’s sponsored by Microsoft:

This is part of a series of posts about cutting-edge areas of innovation. The series is sponsored by Microsoft. Microsoft authors will participate, as will VentureBeat writers and outside experts.

Cloud computing has become a magic phrase over the last year or so. Everyone agrees it’s a hot trend, but people are still arguing about what it is, and who should be using it.

Over next few days, we’ll look at the cloud as part our Conversations on Innovation series (sponsored by Microsoft). The big question we’re tackling: What needs to come together, such as policy standards and programming models, to reach the cloud’s true potential?

To kick things off, I’ll look at where cloud computing stands, and the challenges it faces. …

<Return to section navigation list> 

Cloud Security and Governance

McGarr Solicitors describe potential pitfalls of cloud computing in the EC in the firm’s Cloud Computing: European Data Protection Dangers post of 9/11/2009:

Cloud computing is rapidly becoming a buzzphrase in IT-reliant businesses. Its proponents include some of the largest technology companies in the world. But while enterprises may be able to save money by moving into the cloud it is difficult to see how they can do so with their customer’s personal information without breaching EU data protection law. [Emphasis added.] …

Krishnan Subramanian’s Context Is Important While Talking About Cloud Security post of 9/10/2009 begins:

Recently, I was talking to a group of people about cloud computing and its plan for world domination. One of the issues that surprised me is the way people take a binary approach while talking about cloud security. The debate usually goes on with one side making a blanket statement that cloud computing is totally insecure and the other side claiming that it is very secure. In fact, I have been a participant in these kind of debates in the past but I am more enlightened now. There is no size fits all solution when it comes to security. It applies to cloud computing too.

All sides in this debate forget a few important points while letting their emotions run high. Some of them are

  • There is no fool proof security in the traditional computing environment either
  • We can take most of the stuff from our traditional security toolkit and apply it to the cloud
  • We need some rethinking in the way we approach cloud security, especially the public clouds. One aspect is the cloud scale itself and the other is the multi-tenancy
  • Cloud Computing is a, relatively, new field and it needs time to mature both in terms of its technological capabilities and in terms of its security. Security always follows any new technological advance with a time lag. …
  • The needs of all people (well, businesses) are not created equal

Tim Wilson posits “'Cross-VM attacks' could threaten sensitive data in shared environments, researchers say” in his University Research Exposes Potential Vulnerabilities In Cloud Computing post of 9/8/2009:

Users of cloud computing infrastructures should be aware that their sensitive data could be potentially leaked, a group of university researchers say.

In a new research paper (PDF), several computer scientists from the University of California at San Diego (UCSD) and the Massachusetts Institute of Technology (MIT) say they have discovered soft spots in the cloud computing concept that could leave data vulnerable to attack.

"Overall, our results indicate that there exist tangible dangers when deploying sensitive tasks to third-party compute clouds," the paper says.

In a nutshell, the researchers argue that by taking the right steps, an attacker could place a malicious virtual machine (VM) in close proximity to a target server in a shared, "cloud" environment. From there, it would be possible to launch a "cross-VM attack" using a variety of different hacking strategies, they say. …

Greg Ness highlights some of Chris Hoff’s best blog posts in The Infrastructure 2.0 Young Turks: Hoff of 9/9/2009:

Chris Hoff (@Beaker) asks is DDoS – A Moose On Cloud’s Table Or A Pea Under The Mattress? in this 9/7/2009 post:

… Depending upon where you stand, especially if we’re talking about Public Clouds — and large Public Cloud providers such as Google, Amazon, Microsoft, etc. — you might cock your head to one side, raise an eyebrow and focus on the sentence fragment “…and in particular the biggest threat facing cloud computing.”  One of the reasons DDoS is under-appreciated is because in relative frequency — and in the stable of solutions and skill sets to deal with them — DDoS is a long tail event.

With unplanned outages afflicting almost all major Cloud providers today, the moose on the table seems to be good ol’ internal operational issues at the moment…that’s not to say it won’t become a bigger problem as the models for networked Cloud resources changes, but as the model changes, so will the defensive options in the stable …

<Return to section navigation list> 

Cloud Computing Events

Wade Wenger offers on 9/13/2009 slides and videos from the Windows Azure in the Real World session he presented with Joseph Paradi to the Wisconsin .NET Users Group earlier in the week. From the abstract:

Does this sound familiar? Your boss is asking about cloud computing and Windows Azure, but you’re not sure how to separate the hype from the reality. Or perhaps you’ve heard about Windows Azure and had a chance to try it out, but you still don’t quite understand how or why to use it. Or maybe you’ve been using Windows Azure since PDC in 2008, but you’d like a clearer picture of the roadmap and pricing. If any of these points resonate with you, or if you have different questions and concerns, please join Wade Wegner, Architect Evangelist with Microsoft, and Joseph Paradi, Innovation Lead with Accenture, as they provide you with an update on the Windows Azure Platform and show you how companies like Accenture are using the cloud today. Additionally, Wade and Joseph will discuss the migration of existing internal applications to Windows Azure, securing applications through claims-based authentication and passive federation with Geneva Server, using relational databases in the cloud with SQL Azure, migrating data to the cloud through tools like SSIS, and more.

• Vivek Kundra, the Obama administration’s chief information officer “will hold a news conference Tuesday [9/15/2009] in Silicon Valley to ‘outline his vision for a new federal government cloud computing initiative,’” according to Rich Miller’s Federal Cloud Announcement Due Tuesday post of 2/11/2009:

The event is being held at NASA’s Ames Research Center at 10 a.m. Pacific on Tuesday, Sept. 15. The event will be streamed live on the NASA TV web site.

The event will be attended by NASA Deputy Administrator Lori Garver and “top Silicon Valley information technology leaders.” Who might be there? The NASA Ames facility is around the block from the Googleplex, as well as Microsoft’s Silicon Valley office

Robert MacMillan shed more light on the event in his White House CIO to disclose cloud computing plans post of 9/10/2009.

When: 9/15/2009 10 AM PDT  
Where: National Aeronautics and Space Administration, Ames Research Center, Mountain View, CA, USA

Mike Taulty recommends the Architect Forum. Cloud: An Architectural View event taking place 9/25/2009 at Microsoft Cardinal Place, London:

Change is the one constant in IT and today is no exception. In a time when economic necessities dictate that we do more with less, faster and cheaper than ever before we are still seeing projects fail at an alarming rate. The not so new buzz is cloud computing that the analysts are falling over themselves to convince us is the next big thing. Well there is no doubt that it is becoming ever more tangible as the main vendors like Microsoft seek to ready their propositions in the cloud space. Since its announcement at PDC08, Windows Azure has set itself apart from the infrastructure as a service crowd offering a full compute platform capability as a service. With another PDC due this year that will herald the launch of Azure with increased features and services, pricing and SLAs we will see the cloud become ever more real! Undoubtedly this is the platform of choice for start-ups and ISVs but is it ready for Enterprise time? What are the opportunities and barriers for forward thinking organisations, is it too early to take to the skies? What is the architecture of the enterprise going to look like? Is it all about private/public clouds, virtualised infrastructures? Or are these just the vestiges of an already overloaded and constrained architecture? Will the cloud really allows us to break up the silos and truly realise service oriented dream? Time will tell

When: 9/25/2009 8:45 AM to 4:30 PM GMT  
Where: Microsoft Cardinal Place, Auditorium 2, 100 Victoria Street, Cardinal Place, London SW1E 5JL, United Kingdom

<Return to section navigation list> 

Other Cloud Computing Platforms and Services

Savio Rodrigues asks What's the New York Times doing with Hadoop? in this 9/11/2009 post to InfoWorld’s Open Sources blog that’s subtitled “A Times software engineer talks about how Hadoop is driving business innovation at the newspaper and Web site”:

With Hadoop World NYC just around the corner on Oct. 2, 2009, I thought I'd share two pieces of news.

First, I've received a 25 percent discount code for readers thinking about attending Hadoop World. Hurry because the code expires on Sept. 21.

Second, check out this Q&A with New York Times software engineer and Hadoop user, Derek Gottfrid. Derek's doing some very cool work with Hadoop and will be presenting at Hadoop World. …

Howard Anderson reports Dell Tries to Make an EHR Splash in his 9/10/2009 post to the Health Data Management blog. The article appears to be based on Steve Lohr’s article with some additional background material.

• Steve Lohr’s Tech Companies Push to Digitize Patients’ Records article of 9/10/2009 for the NY Times reports that cloud computing will aid small physician groups to migrate from paper to electronic medical records (EMR) and Dell will “act as the hardware supplier and general contractor” to automate the process:

EClinicalWorks has added four data centers in the last year, bringing the total to 10, for hosting electronic health records as a service over the Internet. The company offers its records both as conventional PC software and as a Web service. “The software as a service is where the biggest growth is,” said Girish Kumar Navani, president of eClinicalWorks.

On Thursday, Dell, the personal computer maker, plans to join the scramble in earnest, announcing its plan to form a partnership with hospital groups around the country to offer electronic health records — hardware, software, consulting services and financing — to their affiliated physicians. Dell, like the other players, sees the big opportunity as being in offices with 10 doctors or fewer, where three-fourths of the nation’s physicians practice medicine.

Dell plans to act as the hardware supplier and general contractor, working with partners like eClinicalWorks, a maker of electronic health record software, and Perot Systems for data-center hosting, if the medical groups outsource that task.

Dell already has pilot projects under way with a few hospital groups, including Memorial Hermann Healthcare System in Houston and Tufts Medical Center in Boston. This year, Dell announced it was teaming up with Sam’s Club, a division of Wal-Mart, to offer the hardware, software and services for electronic health records to doctors in small practices.

“The technology has to be a simplified, affordable package for physicians,” said Jamie Coffin, general manager of Dell’s health care business. “We’re really going after this market in a concerted way.”

Dell’s press release of 9/10/2009 on the topic is New Dell Solution Helps Hospitals Open Up Benefits of EMR to More Physicians and Patients. Following are a few cloud-related US job openings at Dell as of 9/10/2009:

Sounds to me like Perot Systems and eClinicalWorks are HealthVault competitors.

Lance Whitney supplements the preceding story by adding a Dell service to help hospitals with digital records post of 1/10/2009 to CNet’s HealthTech blog:

One key component of U.S. health care reform is the move toward digital medical records. Dell is hoping to play a role in that move.

Dell announced Thursday a new service to help doctors and hospitals more easily switch to electronic medical records (EMR).

Already in use by certain hospitals, the new EMR service--a combination of hardware, software, and support--is designed to make the transition from paper to digital records more affordable and practical for the average physician or medical staff.

Dell said its EMR system will also connect doctors and their sponsoring hospitals so they can share patient information, helping coordinate care, and slash administrative costs.

As part of its EMR package, Dell will go on site to a hospital to determine its needs and readiness. The company will install all hardware and software, offer training to the hospital staff, and provide 24-7 hardware and software support. The EMR application can be hosted either by the hospital or with a Dell EMR partner in a secure data center.

Dell said hospitals can integrate the service into their own information systems and offer it to affiliated doctors for their local practices. Dell's EMR system is modular, so hospitals can tailor it to their specific needs. …

Jason Massie describes his company’s new Disaster Recovery in the Cloud approaches hosted by Terremark in his 9/9/2009 post:

… With IaaS, you can keep an online copy of your data in the cloud with minimal latency. The main advantage is cost and the savings can be huge. You do not have to invest in the infrastructure that goes along with a DR site like cabinets, network gear, and support services like AD, DNS, backups, etc. There is also the CapEX that goes with the actual server hardware.

The speed of implementation can also allow you to have many less virtual machines than you would have to have if they were physical machines. You can just keep a master copy of a web and each kind of app server. If you fail over to the DR cloud, you can spin up 10 or 20 of these really fast. Of course to have low latency with your data, your DB tier will have to be fully implemented. …

Lauren McKay’s Salesforce.com's Second Stab at Service post of 9/9/2009’s subtitle reads “The company releases Service Cloud 2 with innovation around Knowledge, Answers, and Twitter.” Lauren continues:

It's been nine months since Salesforce.com introduced its Service Cloud, an integration of in-the-cloud customer service information including third-party data from services such as microblogging marvel Twitter. (That launch was a significant factor in CRM magazine's April 2009 decision to name Salesforce.com a Rising Star in customer service.) Since then, the company says that more than 8,000 customers have signed on to the Service Cloud, and the software-as-a-service (SaaS) pioneer seems to have no interest in slowing down, as its announcement today of Service Cloud 2 indicates.

Jeremy Geelan claims Unisys & Cloud Computing: Cloud-in-a-Box Is On Its Way: “Security is a big concern as well as privacy of the data once it leaves a client's data centers”:

Unisys recently announced a four-part cloud computing strategy that will enable clients to move their enterprise application workloads securely to tailored cloud environments and give them confidence in maintaining the integrity of their critical information.

In this Exclusive Q&A for Cloud Computing Journal with SYS-CON's Cloud Computing Expo Conference Chair, Jeremy Geelan, Rich Marcello - Unisys President, Systems & Technology - introduces the Unisys Secure Cloud and sets the scene for the upcoming Unisys Cloud-in-a-box to be delivered later this year.

James Urquhart posits Enterprise cloud computing coming of age in this 9/8/2009 post to CNet New’s The Wisdom of Clouds blog:

One of the most interesting aspects of the weeks leading up to and including this year's VMWorld was the incredible innovation in cloud-computing service offerings for enterprises--especially in the category of infrastructure as a service. A variety of service providers are stepping up their cloud offerings, and giving unprecedented capabilities to their customer's system administrators.

In this category, enterprises are most concerned about security, control, service levels, and compliance; what I call the "trust" issues. Most of the new services attempt to address some or all of these issues head on. Given that this is the infancy of enterprise cloud computing, I think these services bode well for what is coming in the next year or two.

James then goes on to analyze:

John WillisAWS Latest News (Update) post of 9/7/2009 summarizes Amazon Web Service’s e-mail to its developers of the same date. Topics include:

    • Introducing Amazon Virtual Private Cloud
    • Announcing the AWS Solution Providers Program
    • AWS Multi-Factor Authentication (AWS MFA)
    • Seamlessly Rotate Your Access Credentials
    • AWS Import/Export Enters Unlimited Beta, Adds Export for Amazon S3
    • AWS Management Console Adds Support for Amazon CloudWatch
    • New Lower Prices for Amazon EC2 Reserved Instances
    • AWS Start-Up Challenge Deadline Extended to September 25, 2009

Sam Dean reports Eucalyptus Systems Bridges Private and Public Clouds in this 9/9/2009 post:

On the heels of the launch and funding of open source cloud computing player Eucalyptus Systems, the company has now announced its first commercial product. The Eucalyptus Enterprise Edition (EEE) enables customers to implement an on-premise Eucalyptus cloud with VMware'VSphere virtualization platform, and ESX hypervisor.

VSphere is VMware's cloud operating system. Not only will Eucalyptus' EEE solution allow on-premise Eucalyptus clouds on VMware's platform, but it also supports other hypervisors, including Xen and KVM. With EEE, users can leverage all of these environments, and additonally develop applications compatible with Amazon's EC2.

“Eucalyptus Systems’ mission has been to support the open source Eucalyptus on-premise cloud platform while also delivering solutions for large-scale enterprise deployments,” said Dr. Rich Wolski, Eucalyptus Systems co-founder, CTO and former director of the Eucalyptus research project at the University of California, Santa Barbara (UCSB). …

Ryan Howard’s Practice Fusion Announces Investment from Salesforce.com and Cloud Computing Initiative press release of 9/7/2009 claims:

Practice Fusion offers a revolutionary application and delivery model – cloud computing – enabling physician practices to deliver superior care to their patients. Practice Fusion provides free, web-based electronic medical records (EMR), practice management, patient scheduling and more.

Practice Fusion is launching its patient health record on Force.com, salesforce.com’s enterprise cloud computing platform. Force.com provides everything companies need to quickly build and deliver business applications in the cloud, including the database, unlimited real-time customization, powerful analytics, real-time workflow and approvals, programmable cloud logic, integration, real-time mobile deployment, programmable user interface and Web site capabilities. Applications built on Force.com benefit from the proven security, reliability and scalability of salesforce.com’s real-time global service infrastructure. …

Ryan Howard is CEO of Practice Fusion.

Free Personal Health Record management applications, such as HealthVault and PassportMD (free to Medicare recipients), are common but not EMR and practice management (PM) software for physicians.

Alan Williamson reports in Amazon SimpleDB + SQS : Simple Java POJO Access of 9/6/2009 that he has updated his two Java classes that let you access Amazon Web Services’ Simple DB and Simple Queue Services (SQS):

SimpleDB features

  • No external dependencies
  • Single POJO
  • Full API support; CreateDomain, DeleteDomain, DomainMetaData, select, GetAttributes, PutAttributes, BatchPutAttributes, DeleteAttributes
  • NextToken support
  • Signature2 authentication
  • Error Reporting
  • Last Request ID and BoxUsage reporting

SimpleSQS features

  • No external dependencies
  • Single POJO
  • Full API support; CreateQueue, DeleteQueue, ListQueues, DeleteMessage, SendMessage, ReceiveMessage, GetAttributes, ChangeMessageVisibility, AddPermission, RemovePermission
  • Signature2 authentication
  • Error Reporting
  • Public Domain license

Jo Maitland says VMware vCloud Express: Right move, wrong focus in this 9/4/2009 essay for IT Knowledge Exchange’s Troposphere blog:

VMware is right to introduce a cloud computing service that competes with Amazon EC2. But wrong to focus on the aspect of buying these services with a credit card. We know of at least one company where the act of punching in a credit card number to buy servers is immediate grounds for dismissal.

vCloud Express, unveiled at VMworld in San Francisco this week, lets companies running VMware software hook up to a hosting provider running a public cloud also based on VMware, for additional compute resources on demand.

vCloud Express competes with Amazon.com’s EC2, now infamous for the speed at which users can buy and turn on servers, the low cost point for entry and the ability to use only what you need, when you need it. But chasing Amazon.com’s value proposition of “fast and cheap”, which is how VMware CEO Paul Maritz referred to vCloud Express in his keynote, is the wrong focus for enterprise IT.

Yes, IT managers want more agility and lower costs, but most of them won’t touch cloud services with a 10-foot pole, from VMware or anyone else, until they are sure of the security and reliability of these services. That’s where VMware should be putting its effort and focus, not on a simplistic web interface for entering credit card numbers. …

<Return to section navigation list>