Creating a Windows Azure AppFabric Labs Account, Project, and Namespace

To take advantage of the new Windows Windows AppFabric Access Control Services preview features announced by the Azure AppFabric team on 8/5/2010, you must create an AppFabric Labs account, then add a named AppFabric project and namespace. Here’s how…

1. Log into the Windows Azure AppFabric Portal with your Windows LiveID credentials to open the Summary page:

Click the screen capture to open a full-size (~955 px wide) version.

2. Click the Create a Project link to open the Sign Up page:

3. Type a unique project name and click OK to open the Add Service Namespace page:

Windows Azure AppFabric Labs projects don’t require a subscription (or credit card).

4. Click the Add Service Namespace link to open the Create New Service Namespace page:

You can’t add ServiceBus Connection Packs to an AppFabric Labs account. There is no charge for services provided by the Windows Azure AppFabric Labs.

5. Click Create to open the Project: ProjectName page with will show Status as “Activating” for a few seconds, then “Active”:

6. Click the Access Control link to open the Access Control Settings: ProjectName page:

7. Click Manage to open the Access Control Service page:

8. Future tutorials will address the Getting Started section’s five steps.

Update 8/8/2010: You’ll need to download the following additional items to take full advantage of the new Access Control Services preview features:

• Windows Azure platform AppFabric Labs SDK This SDK provides tools and samples for working with Access Control and Service Bus.
• Windows Identity Foundation (WIF) runtime.
• Windows Identity Foundation SDK Windows Identity Foundation is a framework for implementing claims-based identity in your applications (requires the above runtime).

For WIF, you might want to download the following:

• ADFS 2.0
• CardSpace 2.0
• Windows Identity Foundation for Windows 2003

Technorati Tags: Windows Azure,Azure,Windows Azure AppFabric,Azure AppFabric,AppFabric,Windows Azure AppFabric Labs,AppFabric Access Control Services,Azure Access Control Services,Access Control Services,ACS,Windows LiveID,OpenID,OAuth,OAuth WRAP,Yahoo,Facebook,Cloud Computing Windows Identity Framework,WIF,SAML

Windows Azure and Cloud Computing Posts for 5/27/2010+

Windows Azure, SQL Azure Database and related cloud computing topics now appear in this daily series.

 
• Updated 5/28/2010: Steve Marx explains how he coded and debugged his live Python Azure music demo (Swingify) described in the Live Windows Azure Apps, APIs, Tools and Test Harnesses section and Microsoft sends Platform Ready message to Front Runner users.

Note: This post is updated daily or more frequently, depending on the availability of new articles in the following sections:

• Azure Blob, Drive, Table and Queue Services
• SQL Azure Database, Codename “Dallas” and OData
• AppFabric: Access Control and Service Bus
• Live Windows Azure Apps, APIs, Tools and Test Harnesses
• Windows Azure Infrastructure
• Cloud Security and Governance
• Cloud Computing Events
• Other Cloud Computing Platforms and Services

To use the above links, first click the post’s title to display the single article you want to navigate.

Cloud Computing with the Windows Azure Platform published 9/21/2009. Order today from Amazon or Barnes & Noble (in stock.)

Read the detailed TOC here (PDF) and download the sample code here.

Discuss the book on its WROX P2P Forum.

See a short-form TOC, get links to live Azure sample projects, and read a detailed TOC of electronic-only chapters 12 and 13 here.

Wrox’s Web site manager posted on 9/29/2009 a lengthy excerpt from Chapter 4, “Scaling Azure Table and Blob Storage” here.

You can now download and save the following two online-only chapters in Microsoft Office Word 2003 *.doc format by FTP:

• Chapter 12: “Managing SQL Azure Accounts and Databases”
• Chapter 13: “Exploiting SQL Azure Database's Relational Features”

HTTP downloads of the two chapters are available from the book's Code Download page; these chapters will be updated in June 2010 for the January 4, 2010 commercial release. 

Azure Blob, Drive, Table and Queue Services

No significant articles today.

<Return to section navigation list> 

SQL Azure Database, Codename “Dallas” and OData

ETH Zurich’s Systems Group gave the performance and cost nod to SQL Azure in its End-To-End Performance Study of Cloud Services (SQL Azure, Amazon EC2 and S3, and Google App Engine) posted on 5/26/2010 to the High Scalability blog:

Cloud computing promises a number of advantages for the deployment of data-intensive applications. Most prominently, these include reducing cost with a pay-as-you-go pricing model and (virtually) unlimited throughput by adding servers if the workload increases. At the Systems Group, ETH Zurich, we did an extensive end-to-end performance study to compare the major cloud offerings regarding their ability to fulfill these promises and their implied cost.

The focus of the work is on transaction processing (i.e., read and update work-loads), rather than analytics workloads. We used the TPC-W, a standardized benchmark simulating a Web-shop, as the baseline for our comparison. The TPC-W defines that users are simulated through emulated browsers (EB) and issue page requests, called web-interactions (WI), against the system. As a major modification to the benchmark, we constantly increase the load from 1 to 9000 simultaneous users to measure the scalability and cost variance of the system.  Figure 1 shows an overview of the different combinations of services we tested in the benchmark.

Figure 1: Systems Under Test

The main results are shown in Figure 2 and Table 1 - 2 and are surprising in several ways. Most importantly, it seems that all major vendors have adopted a different architecture for their cloud services (e.g., master-slave replication, partitioning, distributed control and various combinations of it). As a result, the cost and performance of the services vary significantly depending on the workload. A detailed description of the architectures is provided in the paper.

Furthermore, only two architectures, the one implemented on top of Amazon S3 and MS Azure using SQL Azure as the database, were able to scale and sustain our maximum workload of 9000 EBs, resulting in over 1200 Web-interactions per second (WIPS).  MySQL installed on EC2 and Amazon RDS are able to sustain a maximum load of approximate 3500 EBs. MySQL Replication performed similar to MySQL standalone with EBS, so we left it off the picture. Figure 1 shows that the WIPS of Amazon’s SimpleDB grow up to about 3000 EBs and more than 200 WIPS. In fact, SimpleDB was already overloaded at about 1000 EBs and 128 WIPS in our experiments. At this point, all write requests to hot spots failed. Google AppEngine already dropped out at 500 emulated browsers with 49 WIPS. This is mainly due to Google’s transaction model not being built for such high write workloads. [Emphasis added.]

When implementing the benchmark, our policy was to always use the highest offered consistency guarantees, which come closest to the TPC-W requirements. Thus, in the case of AppEngine, we used the offered transaction model inside an entity group. However, it turned out, that this is a big slow-down for the whole performance. We are now in the process of re-running the experiment without transaction guarantees and curio[u]s about the new performance results.

Figure 2: Comparison of Architectures [WIPS] …

Table 1 shows the total cost per web-interaction in milli dollar for the alternative approaches and a varying load (EBs). Google AE is cheapest for low workloads (below 100 EBs) whereas Azure is cheapest for medium to large workloads (more than 100 EBs).  The three MySQL variants (MySQL, MySQL/R, and RDS) have (almost) the same cost as Azure for medium workloads (EB=100 and EB=3000), but they are not able to sustain large workloads.

Table 1: Cost per WI [m$], Vary EB

The success of Google AE for small loads has two reasons.  First, Google AE is the only variant that has no fixed costs. There is only a negligible monthly fee to store the database. Second, at the time these experiments were carried out, Google gave a quota of six CPU hours per day for free.  That is, applications which are below or slightly above this daily quota are particularly cheap.

Azure and the MySQL variants win for medium and large workloads because all these approaches can amortize their fixed cost for these workloads. Azure SQL server has a fixed cost per month of USD 100 for a database of up to 10 GB, independent of the number of requests that need to be processed by the database.  For MySQL and MySQL/R, EC2 instances must be rented in order to keep the database online.  Likewise, RDS involves an hourly fixed fee so that the cost per WIPS decreases in a load situation.  It should be noted that network traffic is cheaper with Google than with both Amazon and Microsoft.  

Table 2 shows the total cost per day for the alternative approaches and a varying load (EBs). (A "-" indicates that the variant was not able to sustain the load.)  These results confirm the observations made previously:  Google wins for small workloads;  Azure wins for medium and large workloads.  All the other variants are somewhere in between.  The three MySQL variants come close to Azure in the range of workloads that they sustain. Azure and the three MySQL variants roughly share the same architectural principles (replication with master copy architectures). SimpleDB is an outlier in this experiment. With the current pricing scheme, SimpleDB is an exceptionally expensive service.  For a large number of EBs, the high cost of SimpleDB is particularly annoying because users must pay even though SimpleDB drops many requests and is not able to sustain the workload.

Table 2: Total Cost per Day [$], Vary EB

Turning to the S3 cost in Table 2, the total cost grows linearly with the workload.  This behavior is exactly what one would expect from a pay-as-you-go model.  For S3, the high cost is matched by high throughputs so that the high cost for S3 at high workloads is tolerable. This observation is in line with a good Cost/WI metric for S3 and high workloads  (Table 1). Nevertheless, S3 is indeed more expensive than all the other approaches (except for SimpleDB) for most workloads.  This phenomenon can be explained by Amazon's pricing model for EBS and S3. For instance, a write operation to S3 is hundred times more expensive than a write operation to EBS which is used in the MySQL variant.  Amazon can justify this difference because S3 supports concurrent updates with an eventual consistency policy whereas EBS only supports a single writer (and reader) at a time.

In addition to the here presented results, the paper also compares the overload behavior and presents the different cost-factors leading to the here presented numbers. If you are interested in these results and additional information about the test-setup, the paper will be presented at this year's SIGMOD conference and can also be downloaded here.

Be sure to read the comments for readers’ issues with the research methodology.

Alan Shimel claims “Complex legacy databases are just not built to scale in the cloud, Terracotta enables scalability” in his Databases Are The Bottleneck In The Cloud. Terracotta Is The Open Source Answer article (cum advertisement) of 5/27/2010 for NetworkWorld’s Open Source Fact and Fiction blog:

So you think you can just take that MySQL or Oracle database with all of that data that you have been using for 4 years or more and transfer it up to the cloud? Cloud don't work like that. But Terracotta does. Terracotta provides scale using open source.

In fact most public cloud infrastructure doesn't give you the ability to customize much in the way of database configurations. The databases available are rather rudimentary. On the other hand, keeping your database at your own data center is never going to give you the scalability and redundancy the cloud can offer you.

The answer at least according to Terracotta is caching. Over the past few years they have become the standard for elastic caching, hibernate and distributed caching. This allows your application and data instant scalability, outgrowing your database and even your own hardware limits.

I had a chance to speak with Mike Allen, head of product at Terracotta about this.  Terracotta was not originally an open source project or business when they launched in 2004. Recognizing that open source was a better distribution method, they open sourced their product in 2006 and that is when things started to take off for the company. This is a bit unusual, as most companies start open source and then go to sort of a dual license model.

Terracotta did another out of the ordinary move, when in 2009 they "bought" an open source project/product called Ehcache. Ehcache was the brainchild of Greg Luck who besides selling the IP to Terracotta, now works there. Ehcache was a de facto standard in Java enterprise environments. Its API was also the standard for hibernate which allows for elastic and distributed caching.

Allen says that complex databases are not going to be able to move up to public cloud providers anytime soon. The money put into their development to date and what it would cost to replace them with "no SQL" solutions like Cassandra are prohibitive. Therefore using Terracotta's solutions are the only viable alternative for the foreseeable future.

Terracotta already has 100,000 deployments with over 250 paying customers. As the swing to the cloud accelerates, they anticipate that to rise dramatically.  This is one open source company poised to capitalize on the cloud.

Alan’s post appears to fall in the fiction category. SQL Azure’s performance ratings in the preceding post belie Alan’s assertion that “Complex legacy databases are just not built to scale in the cloud.” 

Walter Wayne Berry explains Testing Client Latency to SQL Azure in this 5/27/2010 post to the SQL Azure Team blog:

SQL Azure allows you to create your database in datacenters in North Central US, South Central US, North Europe, and Southeast Asia. Depending on your location and your network connectivity, you will get different network latencies between your location and each of the data centers.

Here is a quick way to test your Network latency with SQL Server Management Studio:

1) If you don’t have one already, create a SQL Azure server in one of the data centers via the SQL Azure Portal.

2) Open the firewall on that server for your IP Address.

3) Create a test database on the new server.

4) Connect to the server/database with SQL Server Management Studio 2008 R2. See our previous blog post for instructions.

5) Using a Query Window in SQL Server Management Studio, turn on Client Statistics. You can find the option on the Menu Bar | Query | Include Client Statistics, or on the toolbar (see image below.)

6) Now execute the query:

SELECT 1

7) The query will make a round trip to the data center and fill in the client statistics.

8) Execute the same query several times to get a good average against the data center.

9) If you are just using this server for testing, drop your server, choose another data center and repeat the process with a new query window.

Reading the Results

The first two sections (Query Profile Statistics and Network Statistics) are not interesting and should be very similar to mine in the image above. The third section, Time Statistics, is what we want to study.

Client processing time: The cumulative amount of time that the client spent executing code while the query was executed. Alternatively, is the time between first response packet and last response packet.

Total execution time: The cumulative amount of time (in milliseconds) that the client spent processing while the query was executed, including the time that the client spent waiting for replies from the server as well as the time spent executing code.

Wait time on server replies: The cumulative amount of time (in milliseconds) that the client spent while it waited for the server to reply. Alternatively, the time between the last request packet left the client and the very first response packet returned from the server.

You want to find out which data center has a low average Wait time on server replies, this will be the least amount of network latency and with the best performance network for your location.

If you are reading this before June 7^th 2010, you have a chance to attend Henry’s Zhang’s talk at TechEd, called: “COS13-INT: Database Performance in a Multi-tenant Environment”. This talk will cover this topic and more.

Brian Swan shows you How to Get the SQL Azure Session Tracing ID using PHP in this 5/27/2010 post:

The SQL Azure team recently posted a blog about SQL Azure and the Session Tracing ID. The short story about the Session Tracing ID is that it is a new property (a unique GUID) for connections to SQL Azure. The nice thing about it is that if you have a SQL Azure error, you can contact Azure Developer Support and they can use it to look-up the error and help figure out what caused it. (If you are just getting started with PHP and SQL Azure, see this post: Getting Started with PHP and SQL Azure.)

Getting the Session Tracing ID is easy with PHP…just execute the following query: SELECT CONVERT(NVARCHAR(36), CONTEXT_INFO()). Here’s the PHP code for doing this:

$server = "tcp:YourServerID.database.windows.net,1433";
$user = "YourUserName@YourServerID";
$pass = "YourPassword";
$database = "DatabaseName";
$connectionoptions = array("Database" => $database, "UID" => $user, "PWD" => $pass);
$conn = sqlsrv_connect($server, $connectionoptions);

if($conn === false)
{
    die(print_r(sqlsrv_errors(), true));
}

$sql = "SELECT CONVERT(NVARCHAR(36), CONTEXT_INFO())";
$stmt = sqlsrv_query($conn, $sql);
$row = sqlsrv_fetch_array($stmt);
print_r($row);

Of course, the code above assumes you have the SQL Server Driver for PHP installed. And, if you are watching closely, you’ll notice that I didn’t have to include the “MultipleActiveResultSets”=> false in my connection options array…because SQL Azure now supports Multiple Active Result Sets (MARS).

The MSDN Library appears to have updated its Transact-SQL Reference (SQL Azure Database) topic recently:

Microsoft SQL Azure Database supports Transact-SQL grammar that you can use to query a database and to insert, update, and delete data in tables in a database. The topics in this section describe the Transact-SQL grammar support provided by SQL Azure. 

Important: The Transact-SQL Reference for SQL Azure is a subset of Transact-SQL for SQL Server.

This section provides a series of foundational topics for understanding and using the Transact-SQL grammar with SQL Azure. To view details about data types, functions, operators, statements, and more, you can browse through the table of contents in these sections or search for topics in the index.

Mafian911 gets the answers to his OData Service and NTLM problems in this thread on the Restlet Discuss forum:

Can anyone tell me how to access an OData service using NTLM security? I have crawled all over the web trying to find out how to do this, and the Tutorial site mentions something about a connector and throws out some source code, but I have no idea what to do with it. …

<Return to section navigation list> 

AppFabric: Access Control and Service Bus

Yavor Georgiev reports Updated WCF samples for Azure on 5/27/2010:

Our samples over at http://code.msdn.com/wcfazure had gotten pretty stale, so I just put out an update that gets everything working on Visual Studio 2010, Silverlight 4, and the latest Azure tools.

Yavor is a Program Manager for WCF

Vittorio Bertocci (a.k.a. Vibro) explains how to put Your FedAuth Cookies on a Diet: IsSessionMode=true in this 5/26/2010 post:

More occult goodness for your programming pleasure! The Session Mode is a great feature of WIF which is not known as widely as it should be.

Sometimes you will be in situations in which it is advisable to limit the size of the cookie you send around. WIF already take steps for being parsimonious with the cookie size. By default, the cookie will contain just the layout defined by the SessionSecurityToken: more or less the minimal information required for being able to reconstruct the IClaimsPrincipal across requests (as opposed to a verbatim dump of the entire incoming bootstrap token, with its logorrheic XML syntax, key references & friends).

Let’s see if we can visualize the quantities at play here. If you take the FedAuth cookie generated from the default token issued from the default STS template implementation in the WIF SDK, the one with just name & role claims hardcoded in a SAML1.0 assertion, you get the following:

FedAuth
77u/PD94bWwgdmVyc2lvbj0iMS4wIiBlbmNvZGluZz0idXRmLTgiPz48U2VjdXJpdHlD b250ZXh0VG9rZW4gcDE6SWQ9Il83NTNmMzFiYi01N2QxLTQ2YzAtOWY5ZS02MTNj YTBhY2VmYWQtQkQzN0YzRTdGQUJCMzg5NTYzMEExNDUzQkEyQTlCOEUiIHhtbG 5zOnAxPSJodHRwOi8vZG9jcy5vYXNpcy1vcGVuLm9yZy93c3MvMjAwNC8wMS9vYX Npcy0yMDA0MDEtd3NzLXdzc2VjdXJpdHktdXRpbGl0eS0xLjAueHNkIiB4bWxucz0iaH R0cDovL2RvY3Mub2FzaXMtb3Blbi5vcmcvd3Mtc3gvd3Mtc2VjdXJlY29udmVyc2F0aW 9uLzIwMDUxMiIPElkZW50aWZpZXIXJuOnV1aWQ6OWQ2MzE5YmYtZTg3MC00Yz Q4LWIxNmYtNWU1MjhhYzVmMjU5PC9JZGVudGlmaWVyPjxJbnN0YW5jZT51cm46dXVpZD
o3NjdmNjBmZC1jYzZmLTQ2ZWEtYjI3OC0zZGQ2MmIxYTg5NjE8L0luc3RhbmNlPjxDb2
9raWUgeG1sbnM9Imh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20vd3MvMjAwNi8wNS
VFBQUFOQ01uZDhCRmRFUmpIb0F3RS9DbCtzQkFBQUFxYzlGQWs2YlBVRzVHY0JP bUJKTWJRQUFBQUFDQUFBQUFBQURaZ0FBd0FBQUFCQUFBQUROZndoSGJsZDJrbU g3UWcvUENPQlFBQUFBQUFTQUFBQ2dBQUFBRUFBQUFJQVF2ZCt1bGNnOFIyRXZS MytjUllHWUFnQUExNTYvR0ovLzNNNVd0Y1RNT243N0pDYlFpTHkzdkRnTjVTbzBCd XIzaVlTaUUxUnFSWjJHWVJaRGQ1UWc1YktlS0JGTjhDZi82VXhHbG1SY2Z5eU5oejlNM lY3WUFTV1lvWDl6NTZ0cnpORnVJbk9kWUJaYXhaZFF4SGs5MHZEakd1cWN1ZEdCU2 NjSGJFbmNuTHVDT01HTWJ3TEhOdzhJbEwwcDM0TlYvRS9CbGRUWWZDUkViVWd2 cU5xS3NJV2locnZHbzZYMzA1ajBMWVdqSDY0bnI4bENiU1ZiTnJEVHhJNGsvTGhOan ovZExNN3c3YkkyNGdTWHhEMXFyaEpsZDZIRVFtWTkybVJUY0Z2eGFPamlpbm1lSEN mWDJXbFB1anZEMldvcW5pb0tNZ0c4K0laL0REMlhQVjBsRU5USjlwK0R4RXdwU3htW jJCR1U1eGs3MlNZYjIxc2ovQXdNNmZGc1dacWEyUlJYK2FEZkozVzN6WUJlV1N5U3dv eSt1MjFNRUxiaDVJaTFRamJTVUxaa3IyTG1OenA4ZkpzMC94ZWNReHA0c1ovbnpsT2x CVng1ZVlHMEV5MDBVMHZDQ0poVDBHeEU3Y3JtbXFiTm00UDg1di8rSWkzNGQ2Qjh TVWkwTjFrL001aFpiRGFaejg0a2wxcXF5SzRLcmQ4eXdoT1ZtZGFsUnNpWUFUSzdTdkd xRFNxdlBYRjN2cGJ6d0d4Y0NLeGFReTdUY2hkeFNNakNEdUdLcmExNGY1U00vZUszcH JCTDlxNSsxaXVRcXpXK1JQWlIvVEMyVTdjdjRNTGhwaEhsT1FFVVlOTzYyYWljQXppQ3B qODRrOThHUW5EYWJsdlp2Rm1aaFg1TE5WUkt3QjNpZUxreGFsaiswVmJSejZoQnpTM 2JxQTB3ZHNHakpLS3Q4VjQzNXZuN2RjaVVNWk9mVlpTcWxOd1N2WnBzdHZBSTVVe XUvbVRKWit0bnM5M0ZBaXVxRHBJOXdOV3MyeE5LNXhjUDNyNms5TENEL1lHdkdhb UdDWWVPWXpjcnA1ei82b2g2K2ZSRThBSXVEOWNURHdsV2VYUVQyM3pZVU14aEFN OGtzQUttU1kyQmVmaGJM  FedAuth1
U1ZBVnJFbTJ5SnhmaGtLQlQzbnJTM0pYaXNMMUx5SmFHWUxLQXlXejEwMGRoUUF BQUQ4a2l4K3Q4V0EyaVFZVkVDeGdPdk85VUVxaXc9PTwvQ29va2llPjwvU2VjdXJpdHlD b250ZXh0VG9rZW4

Slightly more than 2K. Not the nimblest thing you’ve ever seen, but not a cetacean cookie either. On the other hand we have just two claims here; what happens if we have more than those, or we have big claims such as base64’ed images or similar? Moreover: sometimes we do need to include the bootstrap token in the session, for example when we call a frontend which needs to invoke a backend acting as the caller.

Let’s pick this last case: keeping the same token we used above, let’s save it in the session (by adding saveBootstrapTokens="true" to the microsoft.identityModel/service element on the RP) and see how big a cookie we get:

Vibro continues with more examples and concludes with a much shorter cookie when IsSessionMode = True.

Michelle Leroux Bustamante describes her WCF and the Access Control Service article for DevProConnections magazine’s June 2010 issue as providing “Custom components and code for securing REST-based WCF services.”

Unfortunately, the publisher outsources the online version to ZMags, who overuses Flash and makes the content difficult to navigate and read.

<Return to section navigation list>

Live Windows Azure Apps, APIs, Tools and Test Harnesses

• Steve Marx explains how he coded (and debugged) his live Windows Azure Swingify demo app (see below) with Python in this 00:33:08 Cloud Cover Episode 13 - Running Python - the Censored Edition Channel9 video of 5/28/2010:

Join Ryan and Steve each week as they cover the Microsoft cloud. You can follow and interact with the show at @cloudcovershow
In this special censored episode:  

• We show you how to run Python in the cloud via a swingin' MP3 maker
• We talk about how Steve debugged the Python application
• Ryan and Steve join a boy band

Show Links:
SQL Azure Session ID Tracing
Windows Azure Guidance Part 2 - AuthN, AuthZ
Running MongoDb in Windows Azure
We Want Your Building Block Apps

Steve Marx created his live Windows Azure Swingify demo app on 5/27/2010:

Browse for and upload an *.MP3 file, click the Swingify! button and make the music swing:

 

According to Steve:

This application is powered by Tristan's "The Swinger" application, which is built on the wonderful music APIs of EchoNest.

Steve Marx then put the whole thing into a Windows Azure application, which is what you see here.

Paul Lamere posted The Swinger and a collection of Swingified tracks to his Music Machine blog on 5/21/2010:

One of my favorite hacks at last weekend’s Music Hack Day is Tristan’s Swinger.  The Swinger is a bit of python code that takes any song and makes it swing.  It does this be taking each beat and time-stretching the first half of each beat while time-shrinking the second half.  It has quite a magical effect.

Swinger uses the new Dirac time-stretching capabilities of Echo Nest remix. Source code is available in the samples directory of remix.

I agree that the Jefferson Airplane’s Swingified White Rabbit is hypnotic, but the lead doesn’t really sound like the Gracie Slick I remember from the Fillmore Auditorium days.

• Steve Marx’ Making Songs Swing with Windows Azure, Python, and the Echo Nest API post of 5/27/2010 begins:

I’ve put together a sample application at http://swingify.cloudapp.net that lets you upload a song as an MP3 and produces a “swing time” version of it. It’s easier to explain by example, so here’s the Tetris theme song as converted by Swingify.

Background

The app makes use of the Echo Nest API and a sample developed by Tristan Jehan that converts any straight-time song to swing time by extended the first half of each beat and compressing the second half. I first saw the story over on the Music Machinery blog and then later in the week on Engadget.

I immediately wanted to try this with some songs of my own, and I thought others would want to do the same, so I thought I’d create a Windows Azure application to do this in the cloud.

How it Works

We covered this application on the latest episode of the Cloud Cover show on Channel 9 (to go live tomorrow morning – watch the teaser now). In short, the application consists of an ASP.NET MVC web role and a worker role that is mostly a thin wrapper around a Python script.

The ASP.NET MVC web role accepts an MP3 upload, stores the file in blob storage, and enqueues the name of the blob:

[HttpPost]
public ActionResult Create()
{
    var guid = Guid.NewGuid().ToString();
    var file = Request.Files[0];
    var account = CloudStorageAccount.FromConfigurationSetting("DataConnectionString");
    var blob = account.CreateCloudBlobClient().GetContainerReference("incoming").GetBlobReference(guid);
    blob.UploadFromStream(file.InputStream);
    account.CreateCloudQueueClient().GetQueueReference("incoming").AddMessage(new CloudQueueMessage(guid));
    return RedirectToAction("Result", new { id = guid });
}

The worker role mounts a Windows Azure drive in OnStart(). Here I used the same tools and initialization code as I developed for my blog post “Serving Your Website From a Windows Azure Drive.” In OnStart():

var cache = RoleEnvironment.GetLocalResource("DriveCache");
CloudDrive.InitializeCache(cache.RootPath.TrimEnd('\\'), cache.MaximumSizeInMegabytes);

drive = CloudStorageAccount.FromConfigurationSetting("DataConnectionString")
    .CreateCloudDrive(RoleEnvironment.GetConfigurationSettingValue("DriveSnapshotUrl"));
drive.Mount(cache.MaximumSizeInMegabytes, DriveMountOptions.None);

Then there’s a simple loop in Run():

while (true)
{
    var msg = q.GetMessage(TimeSpan.FromMinutes(5));
    if (msg != null)
    {
        SwingifyBlob(msg.AsString);
        q.DeleteMessage(msg);
    }
    else
    {
        Thread.Sleep(TimeSpan.FromSeconds(5));
    }
}

Steve continues with code for the implementation of SwingifyBlob(), which calls out to python.exe on the mounted Windows Azure drive and suggests running “the Portable Python project, which seems like an easier (and better supported) way to make sure your Python distribution can actually run in Windows Azure.”

Tony Bailey suggests Intuit Developers – Learn about Windows Azure in this 5/27/2010 post to msdev.com:

This series of Web seminars is designed to quickly immerse you in the world of the Windows Azure Platform. You’ll learn what Azure is all about, including the fundamental concepts of cloud computing and Windows Azure. You’ll learn why you should target Windows Azure, and see the tangible business benefits you can gain by deploying your apps to the cloud.

Tony is a Senior Marketing Manager for Microsoft.

Microsoft Case Studies reported Real World Windows Azure: Interview with Markus Mikola, Partner at Sopima on 5/27/2010:

Software Firm Launches Business Contract Service with Lean Staff, Low Investment

Sopima, creator of an online solution for managing business contract life cycles, needed to minimize its capital investment to deliver a viable offering. It also wanted to offer an affordable monthly subscription service to gain new customers quickly. Using the Windows Azure™ platform , the company hosts its application in Microsoft® data centers, providing customers with fast response times and high scalability.

With the solution, Sopima has removed barriers that would have otherwise prohibited its entry into competitive markets. The company limited its investment in infrastructure and can focus on development rather than hardware administration. Sopima estimates that, without the Windows Azure platform, it would have had to hire additional full-time staff members at an annual cost of approximately U.S.$500,000. Its status as a Microsoft Partner will lend Sopima credibility in a competitive marketplace.

Situation

Sopima, a software development firm based in Helsinki, Finland, set out to simplify and streamline the processes of creating, managing, and storing business contracts for companies of all sizes.

Many companies manage hundreds to thousands of contracts each year for business arrangements with customers, clients, suppliers, and other external partners. With many stakeholders involved, including administrative assistants, sales associates, account managers, engineers, and legal representatives, collaboration through the contract creation process can be time-consuming and inefficient. The process requires close collaboration among individuals and departments, as well as with external business partners. Antti Makkonen, Research and Development Lead at Sopima, says, “Getting a contract signed can mean months and months of ‘back and forth’ between companies, often involving complex negotiations among legal teams. …

Eric Nelson answers “In the main, yes” to his Q&A: Can you develop for the Windows Azure Platform using Windows XP? post of 5/27/2010:

Longer answer:

The question is sparked by the requirements as stated on the Windows Azure SDK download page.

Namely:

Supported Operating Systems: Windows 7; Windows Vista; Windows Vista 64-bit Editions Service Pack 1; Windows Vista Business; Windows Vista Business 64-bit edition; Windows Vista Enterprise; Windows Vista Enterprise 64-bit edition; Windows Vista Home Premium; Windows Vista Home Premium 64-bit edition; Windows Vista Service Pack 1; Windows Vista Service Pack 2; Windows Vista Ultimate; Windows Vista Ultimate 64-bit edition

Notice there is no mention of Windows XP. However things are not quite that simple.

The Windows Azure Platform consists of three released technologies

Windows Azure

SQL Azure

Windows Azure platform AppFabric

The Windows Azure SDK is only for one of the three technologies, Windows Azure. What about SQL Azure and AppFabric? Well it turns out that you can develop for both of these technologies just fine with Windows XP:

SQL Azure development is really just SQL Server development with a few gotchas – and for local development you can simply use SQL Server 2008 R2 Express (other versions will also work).

AppFabric also has no local simulation environment and the SDK will install fine on Windows XP (SDK download)

Actually it is also possible to do Windows Azure development on Windows XP if you are willing to always work directly against the real Azure cloud running in Microsoft datacentres. However in practice this would be painful and time consuming, hence why the Windows Azure SDK installs a local simulation environment. Therefore if you want to develop for Windows Azure I would recommend you either upgrade from Windows XP to Windows 7 or… you use a virtual machine running Windows 7.

If this is a temporary requirement, then you could consider building a virtual machine using the Windows 7 Enterprise 90 day eval. Or you could download a pre-configured VHD – but I can’t quite find the link for a Windows 7 VHD. Pointers welcomed. Thanks.

“In the main …” reminds me of “In the long run …” about which Lord Keynes reminds “In the long run, we are all dead.”

The Microsoft Partner Network sent the following message by e-mail to Front Runner users on 5/27/2010:

 

 

We are making it easier for you to get your software products compatible with the newest Microsoft technologies. On June 1^st, Green Light is changing to Microsoft Platform Ready.

Microsoft Platform Ready, built on Azure, simplifies access to the information you need to develop, test and market your Windows based applications to millions of potential customers. [Emphasis added.]

In the coming months you will also find free integrated testing tools, starting with Windows Server 2008 R2, making app certification and Microsoft Partner competency attainment easier to manage.

Don't worry - All of your existing information will be migrated to the new site so you will not have to create new logins or re-profile your applications.

Simply login at www.microsoftplatformready.com on June 1^st with your Live ID to access all of your benefits and experience the ease of Microsoft Platform Ready.

Thank you for your continued support of the Microsoft Platform. If you have any questions or comments please contact mprsupport@microsoft.com.

Microsoft Green Light program is the equivalent of Front Runner for non-US partners. Clicking the Green Light link leads to the Front Runner landing page. It appears to me that the Platform Ready team got their links mixed up.

• Microsoft sent the same message on 5/28/2010 with Front Runner substituted for GreenLight and different graphics.

You can learn more about Microsoft’s new partner competency offerings in the The Value of Earning a Microsoft® Competency white paper of May 2010 and at the Worldwide Partner Conference (WPC) 2010 on 7/11 to 7/15/2010.

Reuben Krippner added VIDEO: PRM PORTAL Step-by-Step Installation Guide for Windows Azure documentation on 5/26/2010 to his Partner Relationship Management (PRM) Accelerator for Microsoft Dynamics CRM project on Codeplex.

Step-by-Step Installation Video for Windows Azure. This video provides full guidance on how to deploy the Partner portal to a Windows Azure portal. For deployment on your own servers you can follow all the steps up to editing the web.config file in the web portal project. A separate video will be posted for setting up the portal on your own IIS Windows Server. Also note that this solution will work with Microsoft Dynamics CRM Online, On-Premise and Partner-Hosted!

For more about Reuben’s project, see Windows Azure and Cloud Computing Posts for 5/26/2010+.

Alex Williams’ Open API Madness: The Party Has Just Begun for Cloud Developers post of 5/26/2010 to the ReadWriteCloud blog begins:

It's like an API festival here at Gluecon. I tweeted that this afternoon. But it's not just Gluecon, though - they're one of the hottest topics in discussions about cloud computing.

In his presentation today at Gluecon, John Musser of Programmable Web illustrated how hot APIs have become and how they've matured.

Perhaps most illustrative is his "API Billionaire's Club." Members of the club include Google and Facebook with 5 billion AP calls per day. Twitter has 3 billion per day. Ebay has 8 billion per month. NPR gets 1.1 billion calls per month for its API-delivered stories. Saleforce.com gets 50% of its traffic through its API.

According to Musser, it took eight years to get to 1,000 API's but just 18 months to get to 2,000. This year, the number of API's are double what they were last year on a month-per-month basis.

Internet/platform as a service (PaaS) API's are now number one. That's illustrative of the increased usage of services like Amazon S3 and all its competitors. Maps are the number three API, dropping from the number one spot last year. Social API's are number two.

REST API's are far surpassing SOAP.

There's a real energy here at Gluecon around the discussions about APIs. The room was packed for the presentations on the topic.

We'll pour more into the topic in later posts.

Return to section navigation list> 

Windows Azure Infrastructure

Chris Czarnecki asks Does Working Effectively with Azure Require New Skills? in this 5/27/2010 post to the Learning Tree International blog:

Recently I wrote a post that discussed developing applications for Microsoft’s Azure. This article was stimulated by an interview with Steve Balmer. My views drew a strong healthy response from Microsoft developers, insisting ASP.NET applications can be moved directly to the Azure cloud.

Related to my post an article on Information Week had Bob Muglia, president of Microsoft’s server and tools division saying “There are few people in the world who can write cloud applications. Our job is to enable everybody to be able to do it.”

I think the quote raises a number of interesting points. Companies will move existing applications to the cloud, or develop new cloud based applications for a variety of reasons. Cost savings in infrastructure are a primary motivation of course. But the scalability, reliability, rich media, reduced administration are also potentially equally or more significant. It is when the aspects of scalability, reliability, rich media are considered that new skills are required by developers to enable them maximize the benefits the cloud provides. With Azure, Microsoft have provided a rich environment for developing cloud based applications, much of which they have announced will find its way into their next generation of Windows Server and System Center management software. This raises the exciting prospect of running cloud applications on private networks or on the public Azure cloud together with hybrids integrating the two.

Developers for Azure can utilize their existing .NET development skills. However, the Azure platform features, application architecture and libraries to build true cloud applications are the areas in which developers require new skills. Microsoft have provided the tools, developers now need to know what these are and how to apply these. That’s where the training need for Azure arises, and effective training courses can provide a kick start to developers wanting to exploit the cloud. These new skills, combined with developers existing knowledge base open up a wide range of new business and technical opportunities.

Brenda Michelson’s @ Forrester IT Forum: James Staten, How much of your future is in the Cloud? covers James’ Keynote Speech: How Much Of Your Future Will Be In The Cloud? Strategies For Embracing Cloud Computing Services:

Cloud computing has shifted from being a question of “if” to one of “when” and “where” in your IT future and portfolio. Is it best to stick with SaaS, or should you be deploying new services directly to the public clouds like Amazon EC2 or Windows Azure? What applications are candidates for the cloud, and which should remain in-house? And for how long? This session will explore the enterprise uses of cloud computing thus far and synthesize the thinking across Forrester on this issue to present you with a road map and a strategy for embracing the cloud that benefits both your business and the IT function. Cloud can be a catalyst for the IT-to-BT transition so long as you harness it effectively.

Session attendees can expect to learn:

• How to tell a true cloud solution and its relative maturity from simple cloud washing.
• The truth behind the economics of cloud computing.
• The best places to start and strategies to build your own path to cloud efficiency.

Prior to the conference, James wrote a positioning/discussion piece, which is published on ZDNet.  From what I saw on Twitter, the most controversial idea was the “Pay per use or metered consumption” requirement to be consider cloud computing.

James opens with “Cloud computing isn’t an if, it’s a when and a how”.  He says it won’t change your entire world (Nick Carr), nor is it complete hype (Ellison).  But, you will use it, situationally.

Definition: A standardized IT capability (services, software or infrastructure) delivered in a pay-per-use and self-service way.  On the pay-per-use, you should be able to go to zero.  That’s the economic power, according to Staten.  On self-service, the request is immediately processed, in an automated manner.  [This eliminates all the “managed service” cloud players].

Brenda continues liveblogging James’ keynote.

The Microsoft Partner Network opened their new Windows Azure Platform Partner Hub on 5/13/2010 and added a link to the OakLeaf blog on 5/17/2010:

OakLeaf's Windows Azure-pedia

Monday, May 17, 2010

The OakLeaf crew is helping the world stay on top of the Windows Azure Platform.  Check out this evolving blog post. http://oakleafblog.blogspot.com/2010/05/windows-azure-and-cloud-computing-posts_17.html.

<Return to section navigation list> 

Cloud Security and Governance

Lori MacVittie asserts IT organizations that fail to provide guidance for and governance over public cloud computing usage will be unhappy with the results… in her Why IT Needs to Take Control of Public Cloud Computing post of 5/27/2010:

While it is highly unlikely that business users will “control their own destiny” by provisioning servers in cloud computing environments that doesn’t mean they won’t be involved. In fact it’s likely that IaaS (Infrastructure as a Service) cloud computing environments will be leveraged by business users to avoid the hassles they perceive (and oft times actually do) exist in their quest to deploy a given business application. It’s just that they won’t themselves be pushing the buttons.

There have been many experts that have expounded upon the ways in which cloud computing is forcing a shift within IT and the way in which assets are provisioned, acquired, and managed. One of those shifts is likely to also occur “outside” of IT with external IT-focused services, such as system integrators like CSC and EDS HP Enterprise Services.

ROBBING PETER to PAY PAUL

The use of SaaS by business users is a foregone conclusion. It makes sense. Unfortunately SaaS is generally available only for highly commoditized business functions. That means more niche applications are unlikely to be offered SaaS because of the diseconomy of scale factors involved with such a small market. But  that does not mean that businesses aren’t going to acquire and utilize those applications. On the contrary, it is just this market that is ripe for Paul the SI to leverage.

For example, assume a business unit needed application X, but application X is very specific to their industry and not offered as SaaS by any provider today – and is unlikely to be offered as such in the future due to its limited addressable market. But IT is overburdened with other projects and may not have the time – or resources – available until some “later” point in time. A savvy SI at this point would recognize the potential of marrying IaaS with this niche-market software   and essentially turning it into a SaaS-style, IaaS-deployed solution. An even savvier SI will have already partnered with a select group of cloud computing providers to enable this type of scenario to happen even more seamlessly. There’s quite a few systems’ integrators that are already invested in cloud computing, so the ones that aren’t will be at a distinct disadvantage if they don’t have preferred partners and can provide potential customers with details that will assuage any residual concerns regarding security and transparency.

Similarly, a savvy IT org will recognize the same potential and consider whether or not they can support the business initiative themselves or get behind the use of public cloud computing as an option under the right circumstances. IT needs to understand what types of applications can and cannot be deployed in a public cloud computing environment and provide that guidance to business units. An even savvier IT org might even refuse to locally deploy applications that are well-suited to a public IaaS deployment and reserve IT resources for applications that simply aren’t suited to public deployment. IT needs to provide governance and guidance for its business customers. IT needs to be, as Jay Fry put it so well in a recent post on this subject, “a trusted advisor.”

“So what things would IT need to be able to do in order to help business users make the best IT sourcing choices, regardless of what the final answer is? They’d need to do less of what they’ve typically done – manually making sure the low-level components are working the way that are supposed to – and become more of a trusted adviser to the business.”

[From] Thinking about IT as a supply chain creates new management challenges [by] Jay Fry (formerly VP of Marketing for Cassatt, now with CA)

IT needs to be aware that it may be advantageous to use IaaS as a deployment environment for applications acquired by business units when it’s not possible or necessary to deploy locally. Because if Peter the CIO doesn’t, Paul the SI will.  

<Return to section navigation list> 

Cloud Computing Events

tbTechNet announced Windows Azure Virtual Boot Camp V June 1st – June 7th 2010 in a 5/27/2010 post:

                             

Announcing… Virtual Boot Camp V !

Learn Windows Azure at your own pace, in your own time and without travel headaches.

Windows Azure one week pass is provided so you can put Windows Azure and SQL Azure through their paces.

NO credit card required.

You can start the Boot Camp any time during June 1st and June 7th and work at your own pace.

The Windows Azure virtual boot camp pass is valid from 5am USA PST June 1st through 6pm USA PST June 7th

Follow these steps:

1. Request a Windows Azure One Week Pass here

2. Sign in to the Windows Azure Developer Portal and use the pass to access your Windows Azure account.

3. Please note: your Windows Azure application will automatically de-provision at the end of the virtual boot camp on June 7th

   1. Since you will have a local copy of your application, you will be able to publish your application package on to Windows Azure after the virtual boot camp using a Developer Accelerator Offer to test and dev on Windows Azure. See the Azure Offers here

4. For USA developers, no-cost phone and email support during and after the Windows Azure virtual boot camp with the Front Runner for Windows Azure program

5. For non-USA developers - sign up for Green Light at https://www.isvappcompat.com/global
   

6. Startups - get low cost development tools and production licenses with BizSpark - join here
   

7. Get the Tools

   1. To get started on the boot camp, download and install these tools:

   2. Download Microsoft Web Platform Installer

   3. Download Windows Azure Tools for Microsoft Visual Studio

8. Learn about Azure

   1. Learn how to put up a simple application on to Windows Azure

   2. Learn about PHP on Windows Azure

   3. Take the Windows Azure virtual lab

   4. Read about Developing a Windows Azure Application

   5. View the series of Web seminars designed to quickly immerse you in the world of the Windows Azure Platform

   6. Why Windows Azure - learn why Azure is a great cloud computing platform with these fun videos

9. Dig Deeper into Windows Azure

   1. Download the Windows Azure Platform Training Kit

<Return to section navigation list> 

Other Cloud Computing Platforms and Services

Paul Krill claims “Business-oriented enhancements lead to increased developer interest, though cloud caution still rules” in the preface to his Google App Engine gains developer interest in battle with EC2, Azure NetworkWorld article of 5/27/2010:

While the Google App Engine cloud platform has trailed Amazon and Microsoft clouds in usage, it is nonetheless gaining traction among developers. That interest was bolstered by Google's recent extension to its cloud, dubbed Google App Engine for Business, which is intended to make the cloud more palatable to enterprises by adding components such as service-level agreements and a business-scale management console.

Built for hosting Web applications, App Engine services more than 500,000 daily page views, but App Engine's 8.2 percent usage rate, based on a Forrester Research survey of developers in late 2009, trails far behind Amazon.com's Elastic Compute Cloud (EC2), which has nearly a 41 percent share. Microsoft's newer Windows Azure cloud service edges out App Engine, taking a 10.2 percent share. Forrester surveyed 1,200 developers, but only about 50 of them were actually deploying to the cloud. [Emphasis added.]

Developer Mike Koss, launch director at Startpad.org, which hosts software development companies, is one of those using App Engine. "[The service is] for developers who want to write pure JavaScript programs and not have to manage their own cloud; they can write their app completely in JavaScript," Koss says. He adds that he likes cloud capabilities for data backup and availability.

Restraints on App Engine separate it in a good way from Amazon.com's cloud, Koss says: "App Engine abstracts away a lot of the details that developers need to understand to build scalable apps and you're a little bit more constrained on App Engine, so you kind of can't get into trouble like you can with an EC2." Amazon gives users a virtual box in which they are responsible for their own OS and security patches, whereas App Engine is abstracted at a higher level, he notes.

But not everyone believes App Engine is ready for prime time. "I think it's got a ways to go," says Pete Richards, systems administrator at Homeless Prenatal Program. "The data store technology for it is not very open, so I really don't know about getting information and out of that," he notes, referring to data access methods deployed in App Store. Still, "it's a promising platform," Richards says.

Cloud computing "is in the middle of something of a hype cycle," says Randy Guck, chief architect at Quest Software. But he thinks the cloud hype might be less than the hype a decade ago for SaaS (software as a service), something his company is now looking at developing using a cloud platform. "Right now, we're Microsoft-centric, so we're looking at Azure," Guck says, but he notes that Quest may have a role for App Engine in the future.

The question of whether the cloud is really ready for enterprise usage remains a key one for developers. As the Forrester study found, few are willing to commit now. InfoWorld's interviews echoed that caution. For example, Ryan Freng, a Web developer from the University of Wisconsin at Madison, says cloud computing is interesting but not something he would use anytime soon. "Right now, it's important that we maintain all our data and that we don't send it to the cloud," Freng says.

Paul continues his analysis on page 2.

<Return to section navigation list> 

Technorati Tags: Windows Azure,Windows Azure Platform,Azure Services Platform,Azure Storage Services,Azure Table Services,Azure Blob Services,Azure Drive Services,Azure Queue Services,SQL Azure Database,SADB,Open Data Protocol,OData,Azure AppFabric,Server AppFabric,Cloud Computing,Green Light,Front Runner,Platform Ready,Worldwide Partner Conference 2010,WPC 2010,EchoNest,Tristan,The Swinger,Amazon Web Services,Amazon EC2,Amazon S3,Amazon RDS,SimpleDB,MySQL,Intuit Partner Platform

Windows Azure and Cloud Computing Posts for 8/6/2009+

Windows Azure, Azure Data Services, SQL Azure Database and related cloud computing topics now appear in this weekly series.

• Update 8/7 - 8/9/2008: Electronic Health Records, Personal Health Records, other additions

Note: This post is updated daily or more frequently, depending on the availability of new articles in the following sections:

• Azure Blob, Table and Queue Services
• SQL Azure Database (SADB)
• .NET Services: Access Control, Service Bus and Workflow
• Live Windows Azure Apps, Tools and Test Harnesses
• Windows Azure Infrastructure
• Cloud Security and Governance
• Cloud Computing Events
• Other Cloud Computing Platforms and Services

To use these links, click the post title to display the single article you want to navigate.

Azure Blob, Table and Queue Services

Cloudera, Inc.’s Building a Data Intensive Web Application with Cloudera, Hadoop, Hive, Pig, and EC2 tutorial of 8/6/2009 will:

[S]how you how to use Amazon EC2 and Cloudera's Distribution for Hadoop to run batch jobs for a data intensive web application. During the tutorial, we will perform the following data processing steps:

• Configure and launch a Hadoop cluster on Amazon EC2 using the Cloudera tools
• Load Wikipedia log data into Hadoop from Amazon Elastic Block Store (EBS) snapshots and Amazon S3
• Run simple Pig and Hive commands on the log data
• Write a MapReduce job to clean the raw data and aggregate it to a daily level (page_title, date, count)
• Write a Hive query that finds trending Wikipedia articles by calling a custom mapper script
• Join the trend data in Hive with a table of Wikipedia page IDs
• Export the trend query results to S3 as a tab delimited text file for use in our web application's MySQL database …

<Return to section navigation list> 

SQL Azure Database (SADB, formerly SDS and SSDS)

The SQL Azure Team has posted documentation for SQL Azure CTP1 on the following topics:

• Introducing SQL Azure Database - Provides an overview and describes the key benefits of the service.
• SQL Azure Database Concepts - Describes what SQL Azure Database is and how it works.
• Developer's Guide (SQL Azure Database) - Demonstrates how to connect to SQL Azure and provides an overview of Transact-SQL support.
• Guidelines and Limitations (SQL Azure Database) -  Provides specific guidelines and limitations for tools and driver support, authentication, logins and users
• Transact-SQL Reference (SQL Azure Database) - Provides reference documentation describing the Transact-SQL that is supported SQL Azure.

See John Oltsik proposes A Prudent Approach for Storage Encryption and Key Management in the Cloud Security and Governance section. Storage Encryption and Key Management are important topics for “SQL Server in the Cloud.”

<Return to section navigation list> 

.NET Services: Access Control, Service Bus and Workflow

• The Geneva Team made three Identity Samples available on Code Gallery on 8/7/2009, but they don’t involve Windows Azure. The team describes the samples:

• FabrikamShipping. This is a fairly complete example of how to use the Windows identity Foundation for addressing common tasks in the development of web solutions: accepting identities from an external identity provider, driving the UI using claims, invoking back-end WCF services via delegated authentication, handling claims based authorization and so on. The sample is based on the scenario described in Kim’s Cameron PDC08 session. You can download the sample from here; a detailed description is available here.
• ClaimsDrivenModifierControl. This is a sample ASP.NET control that demonstrates how you can take advantage of claims for driving the behavior of your web UX without the need of writing any code! You can download the sample from here; a detailed description is available here; finally, if you want to see the control in action a screencast is available here.
• SecurityTokenVisualizerControl. This a very simple ASP.NET control that can help you to debug your websites secured with the Windows identity Foundation, by allowing you to inspect identity information in the current context such as claims list, raw XML of the incoming token, signing certificates and more. You can download the sample from here; a detailed description is available here

They’re included in this post because any application that demonstrates Geneva technologies aids in understanding federated identity services and the like.

Vittorio Bertocci (a.k.a. Vibro) posted a Windows Identity Foundation and Windows Azure passive federation guide on the MSDN Code Gallery on 7/4/2009:

This guide provides a step-by-step guide for hosting in Windows Azure a web application which accepts identities from an external identity provider by taking advantage of Windows Identity Foundation.

This is a provisional sample whose purpose is giving you a chance to experiment with federated scenarios in WA today, by using publicly available bits (Windows Azure July CTP, Geneva Framework Beta 2 codename beta release of Windows Identity Foundation). The code shown here is NOT production ready and contains various temporary compromises: you can expect many of those to become unnecessary in future releases of the products.

There’s more detail about integrating Geneva features with Windows Azure in Vibro’s A Guide for Enabling Federated Authentication on Windows Azure WebRoles… using Windows identity Foundation post of 8/4/2009.

<Return to section navigation list>

Live Windows Azure Apps, Tools and Test Harnesses

• Steve Marx asks if Agility Makes Up for Bad Preparation? in this 8/7/2009 post following the live chat in the Windows Azure Lounge.

I’d say “Absolutely.” After retrenching, reprogramming, and restarting an hour later to get rid of the trolls, I believe all participants were more than satisfied with the chat session. Looks like the next chat is scheduled for Friday, 8/21/2009 at 12:00 noon PDT:

Steve promises to post on Monday or later a copy of the complete chat session for those of us who didn’t allow popups before logging into the chat session and lost the ability to save it.

• Simon Munro’s Windows Azure Chat Nuggets post of 8/7/2009 offers a brief summary of the topics covered in the first chat session.

• Steve Marx describes his Live Feedback Mashup: Tinychat + PollDaddy + Windows Azure in a post of 8/7/2009 that introduces the Windows Azure Lounge at http://wazl.cloudapp.net.

• Laith Noel Yousif posts on 8/7/2009 the source code for Building Twtmug, which runs in Windows Azure, looks up your public photos on SmugMug and then posts them to Twitter  with a short link.

• Jim Nakashima’s Windows Azure Tools and Visual Studio 2010 post of 8/7/2009 says:

The May and July 2009 CTPs of the Windows Azure Tools both support Visual Studio 2010 Beta 1.

As far as support for Visual Studio 2010 Beta 2 -- we won't have a release of Windows Azure Tools that supports Visual Studio 2010 Beta 2 until around the time that Beta 2 officially ships publicly. 

Stay tuned.

Bill McColl’s The Intercloud: Coming to a Desktop or Mobile Device Near You post of 8/6/2009 claims the “Cloudscale platform can handle all types of realtime data, and is as easy to use as a spreadsheet” with Windows Azure and Amazon EC2:

At Cloudscale we're preparing for the public launch, later in the year, of the first Intercloud service, a platform for the world's realtime apps. In response to a number of requests for information, here is a brief overview of what we have been developing.

The Cloudscale platform can handle all types of realtime data, and is as easy to use as a spreadsheet. Complex analytics can be run continuously, with automatic scaling and fault tolerance to ensure realtime responsiveness. The platform offers users seamless integration from standard desktop or mobile clients to realtime intercloud apps.

As a self-service platform aimed at mass market adoption, there is no database software and administration to deal with, and no IT department delays and complexity to get in the way of delivering immediate value to users. The platform will drive the democratization of data, unleashing creativity and “turning data into action” everywhere. Like the iPhone platform, Cloudscale’s AppStore will provide a commercial marketplace for the many exciting new apps developed on the platform.

<Return to section navigation list> 

Windows Azure Infrastructure

• Bob Gourley’s Cloud Computing vs. SOA: Look For a Cross-over in Hype post of 8/9/2009 observes that:

Cloud Computing is one of the many things enterprise CIOs, CTOs and other engineers will master in delivering capability.  I believe in the power of new Cloud Computing technologies and concepts and think we should all continue our focus there.

I have said, and still say, the same thing about design approaches like Service Oriented Architecture (SOA).  The constructs, methods and models of SOA are good practices that result in good designs for enterprises.   It is smart to separate data from application logic and smart to enable agility and mashups the way good SOA design does.

And then goes on to plot the declining volume of Web searches for “SOA” versus an increasing volume for “cloud computing,” and concludes:

… Your defense against this [flood of hype] will be the strength of your own position in Cloud Computing.  Therefore, I strongly recommend you personally think through what Cloud Computing means to your enterprise.  Also, think through your definition of cloud computing.  Hopefully the NIST definition will suit your use, since the more people who form up on that the better.

• Chris Hoff (@Beaker) points out that There’s A Difference Between Application/OS Multitenancy and Data(base) Multitenancy in this essay of 8/8/2009 about a cloud provider with a multitenant backend database and a multiuser front-end application.

• Dana Blankenhorn reports Google, Microsoft demand place at medical stimulus table in this 8/8/2009 article for ZD Net’s Healthcare blog:

Google and Microsoft are demanding Web access to electronic medical records and took their complaints right to the top this week.

Google chairman Eric Schmidt and Microsoft chief strategy officer Craig Mundie both hammered NCHIT David Blumenthal on the issue during an advisory committee meeting Thursday.

What’s most interesting is that both Blumenthal and U.S. Chief Technology Officer Aneesh Chopra pushed back. The HITECH stimulus money goes to hospitals that automate records and deliver the functional requirements of a recently-passed plan on meaningful use.

The resulting Electronic Health Records (EHRs) are covered by the HIPAA law, in terms of how they can be shared. What Schmidt and Mundie want is that EHRs respond to Web standards so the records can be turned into Personal Health Records (PHRs) controlled by patients.

For other takes on the committee meeting, see iHealthBeat’s Google, Microsoft Question Government's Health IT Plans article of 8/7/2009 and Bob Brewin’s Google, Microsoft executives criticize Obama's e-health records plan post of 8/6/2009.

According to Mary Jo Foley’s Microsoft links HealthVault service with Amalga software post of 4/6/2009, reported in Windows Azure and Cloud Computing Posts for 7/13/2009+:

HealthVault is Microsoft’s consumer-focused health-records-management Software+Service platform, which the company unveiled officially in 2007. (The service component of HealthVault is one of a handful of Microsoft services that already is hosted on top of Azure.) Amalga UIS, (one of the products formerly under the Azyxxi brand), is one of the main elements of Microsoft’s enterprise health-information-system platform.

See also Scott Shreeve, MD’s Microsoft Vaults Ahead into the Personal Health Information Space post of 8/5/2009 to the Crossover Health site:

I am flying home from the HealthVault Connected Care Conference in Seattle. I left with two big takeaways which will be addressed in two separate posts. It was a great trip, in fact refreshing in many ways, coming on the heels of a wonderful but intellectually strenuous series of meetings for the X PRIZE. In fact, I have never been to Seattle when it was so beautiful – perfectly warm and sunny days with intermittent cumulus clouds and light breezes whose temperature was nearly imperceptible. My favorite evening in town was spent watching sailboats glide effortlessly around the Sound in the fading sunlight of a perfect day. Magic.

Perhaps the setting got me in a good mood, but I walked away very clearly impressed with what Microsoft is attempting to do with their health care strategy. I have to be clear – as an ardent and passionate open source advocate (recovering zealot) – I was very ambivalent about stepping clearly into and over “enemy” lines during my sojourn in Redmond. I was quickly put at ease by the West Coast flavor of the meeting (ie, casual business dress with a young-ish crowd, high energy music, and overall good karma) and the impressive lineup of speakers and attendees. Furthermore, this was the first time I was actually able to figure out what the heck HealthVault really is and how all these various partnerships I keep reading about even begin to make sense. …

So kudos to Peter Neupert and crew for the progress to date. I was impressed.

But I was also puzzled at the same time – Where (on earth ) Is Google Health?

His CLEAR! Shocking Google Health Back to Life post of the same date compares the investments and projects the chances of success of Google Health and Microsoft HealthVault.

John Moore’s Is Google Health Irrelevant? post of 8/6/2009 agrees with Shreeve’s post about Google Health and contends:

… Google Health has been nothing more than a distraction to the broader market.  A distraction in that Google Health has really done very little to create a truly compelling platform, yet due to its size, market presence and media and market pundits belief that Google is the be all to end all, Google Health gets far more press and attention than it rightfully deserves …

John is managing director of Chillmark Research which describes itself as “a healthcare technology industry analyst firm focusing on personal healthcare technology that will enable citizens to take more direct responsibility for their health and the health of loved ones.”

The HealthVault Connected Care Conference was held 6/10 to 6/12/2009 at the Meydenbauer Center in Bellevue, WA. Microsoft’s site offers PDF presentations and video segments of the sessions. The US$19 billion allocated to health information technology (HIT) by the American Recovery and Reinvestment Act (ARRA) of 2009 has greatly increased interest in HIT as well as EHR and PHR implementations. Alice Lipowicz’s Is the nation's health network healthy? article of 8/7/2009 in FederalComputerWeek throws more light on the ARRA incentives and the National Health Information Network (NHIN), the Health and Human Services Departments replacement for the Internet.

HealthVault and Practice Fusion, which was the recipient of a recent investment by Salesforce.com (see last item in this post), appear to be competitors. However, Practice Fusion offers free EHR services primarily to physicians while HealthVault provides PHR storage for patients.

Richard MacManus analyzes the Salesforce investment in his Practice Fusion Partners With Salesforce-But Is Cloud Computing Suitable For Healthcare? article of 8/7/2009 for the NY Times.

• Philip Longmann’s Code Red: How software companies could screw up Obama’s health care reform cover story in Washington Monthly’s August 2009 issue discusses the issue of proprietary health IT systems versus the Veterans Administration’s VistA system.

• Chris Hoff (@Beaker) goes off the deep end with his Introducing the “Cloud For Clunkers Program” post of 8/8/2009:

As compelling as the offer of Cloud may be, in order to pull off incentivizing large enterprises to think differently, it requires an awful lot going on under the covers to provide this level of abstracted awesomeness; a ton of heavy lifting and the equipment and facilities to go with it. [Emphasis added.] …

To get ready for the gold rush, most of the top-tier IaaS/PaaS Cloud providers are building data processing MegaCenters around the globe in order to provide these services, investing billions of dollars to do so…all supposedly so you don’t have to.  Remember, however, that service providers make money by squeezing the most out of you while providing as little as they need to in order to ensure the circle of life continues.  Note, this is not an indictment of that practice, as $deity knows I’ve done enough of that myself, but just because it has the word “Cloud” in front of it does not make it any different from a business case.  Live by the ARPU, die by the ARPU. …

• Datacenter Dynamics’ The American cloud’s weakest link post of 8/7/2009 has “Dark fiber developer brings the cloud back to the ground and shares his broadband stimulus experience” as its deck:

An essential element is often left out of excited industry discourse around cloud-computing. Is the physical network infrastructure in the country sufficient to support visions of the future cloud?

Allied Fiber CEO Hunter Newby offered a rather sobering view of reality at the DatacenterDynamics conference in Seattle, Wash., Thursday. The company specializes in building out dark fiber infrastructure.

“Without physical there is no virtual,” Newby said. “Without fiber there is no cloud.”

“Moving apps into the cloud is very dangerous if you don’t know your physical fiber route. You can be buying from three or four different providers but there’s only one path and everybody else is tied too on that path and you think you’re redundant and diverse, but in fact, you’re not. Those are very basic questions you need to ask before you do anything in higher layers. I believe that if you’re not aware of the basic fundamental things that are very simple to understand, your entire business that you build above it is in jeopardy.”

Fiber-rich patches, such as coastal areas, are sporadically spread around the country, enabling a healthy amount of competition in those areas but connectivity outside of those areas leaves a lot to be desired. “And no one company can afford to build out the proper infrastructure to make it all work and that’s the problem.”

Of $787 billion the U.S. government allocated to stimulating the economy, $7.2 billion was dedicated to developing the country’s broadband infrastructure. Newby feels that, while a lot can be accomplished with $7.2 billion, the amount is insufficient for satisfying the country’s broadband needs. …

• David Linthicum warns Don't be fooled: Cloud computing is not so simple on 8/7/2009: “Beware oversimplifications such as 'the cloud is like the electric grid' -- they're destined to make you fail.”

I enjoyed James Urquhart's post, "In cloud computing, data is not electricity," which points out some of the sillier analogies we're seeing in the emerging cloud computing space. Specifically, Urquhart refers to Nick Carr's classic vision of cloud computing, "The Big Switch," which compares traditional on-premise computing as generating your own power to cloud computing as using the standard power grid.

"However, some have taken electricity as an analogy to cloud adoption to an extreme, and declared that there will be a massive and sudden shift from corporate datacenters to entirely external cloud computing environments -- public cloud utilities, if you will. They are wrong," Urquhart writes.

Hear, hear.

• John Foley chimes in with Microsoft's Drag-And-Drop Windows Azure Cloud, his analysis of 8/7/2009 of the Quincy, WA data center sales tax issue for InformationWeek. (See additional stories below):

Citing an unfavorable change in tax laws, Microsoft is moving its Windows Azure cloud from a data center in Washington state to one in Texas. It's an interesting new twist in the cloud computing market—moving a cloud across state lines in response to the regulatory climate.

Of course, the problem will be that there will only be a single US data center available for some time, which means that geolocation for disaster recovery won’t be an option for early Azure adopters.

• Miko Matsumura (a.k.a. @MikoJava) claimed SOA Arrogance is Dead when he followed Anne Thomas Manes’ (@atmanes) session at the Burton Group’s Catalyst Conference on 7/29/2009 and made the following point in his 8/7/2009 post:

First and foremost, the most stupid and ignorant reading of “SOA is DEAD” is that the perspective of SOA is no longer needed in the Enterprise. This point of view is stupid, particularly when SOA is so important for mash-ups, Cloud Computing, SaaS, PaaS, BSM, IT Governance, Portfolio management and most modern IT practices.

The problem of Enterprise IT Complexity (and Entropy) *DOES* need to be solved. SOA is one of many key architectural perspectives that can make this happen.

Everything is a service (SOA) is an incredibly powerful view.

But within appropriate bounds, everything can also be appropriately viewed as a Process, an Event, an Object, a database table, or other abstraction.

The idea that an enterprise architect could become so focused on “one architecture to rule them all” is as preposterous as “one vendor to rule them all”.

@atmanes’ session was In Memory of SOA, a sequel to her famous SOA is Dead; Long Live Services blogpost of 1/5/2009. Her current presentation carried the following abstract:

In most organizations, SOA has become a bad word. Except in rare situations, SOA has failed to deliver its promised benefits. IT Groups have invested hundreds of thousands, if not millions of dollars into SOA with little return to show for it. The people holding the purse strings are fed up. Funding for these SOA initiatives has dried up.

It’s time to face reality: the term “SOA” now carries too much baggage. It’s time to declare SOA dead and move on.

So what went wrong? Was SOA really just a great failed experiment? Or did we just lose our way? Should we abandon our architectural efforts? Can we salvage any value from our past efforts?

• Research and Markets, which claims to be “The World’s Largest Market Research Resource,” offers to share their Worldwide Cloud Computing Market Shares, Strategies, and Forecasts, 2009-2015 report with you for US$3,400 (US$6,800 for a site license.)

This 2009 study has 712 pages, 211 Tables and Figures. Worldwide markets are poised to achieve significant growth as search engines use efficient automated process to drive new advertising and communications capabilities. Applications can be built without programming. …

SOA reaches into every industry and every segment of the economy via cloud computing. SOA drives innovation for the very large enterprises. Mid range size companies and very small organizations are adopting technologies similar to what the enterprise use, creating automated process to replace manual process. Cloud computing markets at $36 billion in 2008 are expected to reach $160.2 billion by 2015. …

The question is what will be the market for cloud-computing research reports in 2015?

David Linthicum reduces his blood pressure by writing Cloud Computing & SOA: Getting the Links Straight Between Them, “How SOA benefits cloud computing”:

Want to know what gets my blood pressure up? It's when there's both a huge shift in thinking around how we should do computing, namely cloud computing, and at the same time, there's a bunch of information out there that causes confusion. As cloud computing hype spikes to a frenzy, so does the number of less-than-intelligent things that I hear about it and its relationship to SOA.

We've got a herd mentality in IT. We're always chasing the next paradigm shift, which seems to come along every five years, claiming that whatever the last paradigm shift was had "failed" and that's why we're looking at something new. However, these hype-driven trends are often complementary, and so the real power is in figuring out how known approaches fit with what's new, and not look to replace, but how to build on the foundation. The best case for that scenario has been how SOA benefits cloud computing, but few understand how and why. …

Lori MacVittie explains Why the cloud operating system is a myth in this 8/6/2009 article for ZDNet UK:

Google's foray into the operating-system business was barely public before it was being hailed as the latest cloud operating system, with some industry watchers saying this product could be pivotal in the cloud revolution.

To be fair, Google's Chrome OS is not the only operating system to which the cloud handle has been attached. It is merely the latest in a long line of attempts to capitalise on the growing interest and hype surrounding cloud computing.

Novell, Dell, Microsoft — in fact, anyone who is anyone with a stake in operating systems has been mentioned at least once in conjunction with a cloud operating system.

There is no such thing. It is a myth existing entirely in the minds of those who cannot seem to get enough cloud in their daily technology diets. And the problem in perpetuating that myth is that it continues to confuse an already confused market.

John Foley reports that the State of Washington Chooses Data Center Over The Cloud in this post of 8/6/2009 to InformationWeek’s Plug in to the Cloud blog:

The state of Washington is investing $180 million to build a new data center, and not everyone is thrilled about it. Opponents wonder if cloud computing wouldn't be a cheaper alternative. Ironically, Washington is home to two of the biggest cloud service providers, Amazon.com and Microsoft.

As reported by The Olympian, a bond sale and groundbreaking for the new facility, which will also serve as the headquarters for the state's Information Services division, is imminent. Construction equipment is due to arrive on the site in Olympia within a few days.

Two state representatives, Reuven Carlyle and Hans Dunshee, tried to put a halt to the project. In a letter to Gov. Chris Gregoire, they pointed to data centers operated by Google, Microsoft, and others -- a.k.a. cloud computing centers -- as potentially cheaper alternatives. For a state that spends upwards of $1 billion annually on IT (according to Carlyle), lawmakers and tax payers can't be blamed for balking.

The State of Washington probably doesn’t pay sales tax to itself. For more detail on this issue, see my Mystery Move of Azure Services Out of USA – Northwest (Quincy, WA) Data Center post updated 8/5/2009.

Mike Manos adds background to Microsoft’s move of the Windows Azure platform from its Quincy, Washington, data center in his The Cloud Politic – How Regulation, Taxes, and National Borders are shaping the infrastructure of the cloud post of 8/6/2009. My preceding post has a update that includes an except from Mikes essay.

Mike currently is responsible for the global data center design, construction, ongoing operations and professional services for Digital Realty Trust, his past roles include similar responsibilities at Microsoft Corporation, and leadership roles at Walt Disney, Rhythms NetConnections, and Nuclio Corporation (now part of Sun Microsystems).

It would be nice to hear from a Microsoft executive on this topic.

Herb Torrens reports on an Evans Data Survey: Cloud Dev Efforts on the Rise in this 8/5/2009 article for Redmond Developer News:

The move to the Internet cloud will pick up steam in the next year for developers, according to a new survey from Santa Cruz, Calif.-based Evans Data Corp.

Nearly half (48 percent plus) of the 500-plus developers surveyed expects to deploy private cloud applications in the coming year. Development for the cloud is also happening now. More than 29 percent said they are currently building applications for a private cloud.

Evans Data announced some of the results on Tuesday, but the company's "Cloud Development Survey 2009" publication is expected to be released sometime next week. The survey also examines public cloud trends among developers. …

Randy Bias’s Bifurcating Clouds post of 8/6/2009 claims:

There will soon be two major paths for cloud computing providers: commodity and premium.  If you read my series, Cloud Futures, you’ll know that I broke down cloud service providers into three major categories: service clouds, consumer clouds (previously ‘commodity’)[1], and focused clouds. In retrospect I realize now that there are possibly four, not three major categories. The missing category is premium enterprise clouds. Previously I had lumped these under focused clouds, but I now realize that, in fact, there are likely to be so many of these that they deserve their own category. I’ll go even further and suggest that in terms of markets targeted, there will really only be two ends of a spectrum: enterprise and non-enterprise. …

Krishnan Subramanian asks Obstacles To Enterprise Cloud Adoption: Who Is The Culprit? on 8/5/2007:

Slowly, but steadily, enterprises are warming up to Cloud technologies. No, they are not queuing outside the Amazon headquarters waiting to order public cloud infrastructure, like the Amazon's EC2 offerings, yet. But, the idea of private clouds and the advantages of tapping the public clouds for non mission critical operations like testing are slowly making the enterprise community comfortable with Cloud Computing. In fact, a recent Gartner survey predicts that by 2012, 80 percent of Fortune 1000 enterprises will be paying for some cloud computing services and 30 percent will be paying for cloud computing infrastructure services. …

BasicGov Software issued a Customer Case Study Using BasicGov Web-Based, SaaS, Cloud Computing Software for Permits and Inspections press release about the town of Waxhaw, North Carlolina, which is “Using BasicGov web-based software (SaaS and cloud computing) for Permits and Inspections to Improve Planning and Community Development Department:”

In January 2008, Waxhaw started a new Building Inspections Department. This function was moved from the county level in order to be more responsive to Waxhaw citizens while ensuring quality building construction for new developments and historic restorations.

Greg Mahar, the Director of Planning and Community Development for Waxhaw, sought software that would better enable his team to manage planning and community development in a more effective manner. After extensive research, Greg chose BasicGov web-based software because of its affordability and reliability. …

R. McNeill and B. Guptill wrote their Cloud Computing: A Silver Lining for Outsourcing Providers? Research Alert for Saugatuck Research (site registration required):

IT services providers regularly contact Saugatuck, seeking to understand the potential opportunities and limitations of introducing Cloud Computing and SaaS to their customer bases. What we see is the emergence of web-based Cloud Computing outsourcing alternatives (including SaaS) that are substantially reshaping the way technology-enabled services are purchased and used. This in turn is fundamentally shifting the IT outsourcing landscape, creating new opportunities that grow from established, traditional categories of IT outsourcing. These emergent shifts - and opportunities - include the following:

• From Infrastructure Outsourcing (IO) to Infrastructure-as-a-service (IaaS) and Platform-as-a-Service (PaaS);
• From Application Management Outsourcing (AMO) to PaaS and SaaS; and
• From Business Process Outsourcing to Cloud Enabled Business Services and IT as a Service.

Future Saugatuck Strategic Perspectives will examine these areas of change opportunity in more detail, from both the user and provider points of view. …

Dale Vile asks Will cloud put traditional hosters out of business? in this essay of 8/4/2009 for The Register:

It sometimes seems as if the whole world has gone cloud crazy - well at least most of the vendors, pundits and many in the media. If we listen to the evangelists, the days of the enterprise data centre are numbered and players like Google, Amazon and Microsoft will inherit the earth. Even David Cameron, the illustrious leader of the opposition to the UK government, has been talking about handing over the country's health records for storage and management to one of these big American multinationals.

In the midst of all this noise and hype, many have lost sight of the fact that getting a third party to run some of your infrastructure for you has been around for at least three decades. Indeed, those who have been taking advantage of hosted services - or on the other side of the fence, delivering them - must be wondering what all the fuss is about. Just what, exactly, is this cloud thing bringing to the party that is supposed to change the way everything works? …

<Return to section navigation list> 

Cloud Security and Governance

• Peter Choi explains How to Develop an Effective Security Strategy to Play in the Public Cloud and “Develop an effective security strategy with the right blend of technology and processes” in this lengthy essay of 8/7/2009:

Look all around and you can easily see that there is no shortage of press regarding the promises of cloud computing. Cloud evangelists have touted cloud computing as the next big thing, a game changer - a disruptive technology that will spark innovation and revolutionize the way businesses acquire and deliver IT services. The staggering volume of these sales pitches is to be expected, considering that cloud computing is at or near the peak of its hype cycle, but as with any new technology or model, reality will eventually set in and the public relations blitz will fade. As people continue to define cloud computing and debate its pros and cons, one thing is certain - one of the biggest obstacles to widespread cloud computing adoption will be security.

Peter Choi is the cloud computing security lead for Apptis, Inc.

• Steve Lesem posits Cloud Storage and Security [Is] Not a New Concept and asks “Everybody Talks About It, But Is It Really All That Different?” in this 8/7/2009 post:

Articles and blog posts associated with security and cloud computing are a daily occurrence, unless some well-publicized breach occurs in the cloud.  At that point the number of commentaries and discussions will increase exponentially, and then, over the following week, return to normal frequency.

I decided to focus on security as it relates to cloud storage, to see if something really new and different is occurring, and if overall changes need to be contemplated, as it comes to classic data security activities.  When I focused in this way, I quickly discovered that not much has changed, and security of data in the cloud is highly dependent on the same precautions and understandings as security of your data in a private data center.

In this recent article, it was suggested that files of one owner residing on a physical device with the files of others could somehow result in unauthorized access. It could, and the answer to this and a myriad of concerns fits within traditional approaches and understandings of security. 

• Eric Chabrow asks is Janet Napolitano: The Cyber Czar? in this 8/5/2009 post:

Homeland Security Secretary Janet Napolitano isn't the federal cybersecurity czar, and has no desire to become the president's top IT security adviser. But if one of the responsibilities of the White House cybersecurity coordinator is to be the cheerleader for federal government cybersecurity initiatives, then Napolitano is filling that bill.

I’d say that Janet is angling to fill the power vacuum created by Melissa Hathaway’s resignation in advance of her anticipated appointment to the job. Melissa was the White House’s acting senior director for cyberspace.

Eric’s Cyber Czar Waiting Game post of 8/4/2009, reported in Windows Azure and Cloud Computing Posts for 8/3/2009+, suggests a more significant stumbling block to filling the job:

[H]aving two bosses, each with strong personalities and their own power centers in the White House. Who would want two bosses like that?

I wouldn’t.

Krishnan Subramanian questions Will Government Alter The Cloud SLA Game? in this 8/6/2009 post to the CloudAve blog:

One of the key parameters in the push to accelerate enterprise cloud adoption is the SLA (Service Level Agreements). It is an important requirement before enterprises can even think of jumping into the cloud. After a slow start, companies are coming out with SLAs for their services but it is still a messy affair with different companies offering varying terms with ambiguity. Recently, US General Services Administration, part of federal government, came up with a RFQ (Request For Quotations) that demands a 99.95% uptime per month. Let us try to understand the SLA dynamics in this post and see how government's requirement will affect the SLA game.

Microsoft requires two compute instances for a 99.95% uptime guarantee and only offers 99.9% uptime for data accessibility when Windows Azure RTMs.

John Oltsik proposes A Prudent Approach for Storage Encryption and Key Management:

In this white paper, Jon Oltsik, Principal Analyst at ESG, cuts through the hype and provides recommendations to protect your organization's data, with today's budget. Oltsik shows you where to start, how to focus on the real threats to data, and what actions you can take today to make a meaningful contribution to stopping data breaches.

As part of the paper's storage encryption to-do list, Oltsik details three realistic steps to provide the necessary protection for stored data based on risk.

The white paper covers:

• What are the real threats to data today
• Where do you really need to encrypt data first
• How does key management fit into your encryption plans
• What shifts in the industry and vendor developments will mean to your storage environment and strategy

Downloading requires registration.

Robert Lemos offers 5 Lessons from Dark Side of Cloud Computing in this 8/6/2009 article for ComputerWorld’s Security section:

While many companies are considering moving applications to the cloud, the security of the third-party services still leaves much to be desired, security experts warned attendees at last week's Black Hat Security Conference. …

"Guys at the low end are using (cloud infrastructure) to save money, but the danger is that the guys at the top end start to use it without any auditing," says Haroon Meer, technical director at security firm SensePost, who discussed his team's research into some aspects of Amazon's Elastic Compute Cloud (EC2) at the Black Hat security conference. …

Reuven Cohen’s The Battle for Cloud Application Neutrality post of 8/5/2009 claims “The concept of Cloud Application Neutrality extends upon the core tenets of the existing network neutrality debate.” Ruv says:

It's hard to believe that it's been a year since we first created the Cloud Computing Interoperability Forum (CCIF) with the goal of defining and enabling interoperable enterprise-class cloud computing platforms through application integration and stakeholder cooperation. Over the last 12 months a lot has happened. For me the most notable change has been how the conversation has shifted from "why use the cloud" & "what is cloud computing" to how to implement it. The need for interoperability among vendors has also become a central point of discussion with the concept being included in recent US federal government cloud requirements. But like it or not the battle for an open cloud ecosystem is far from over.

Brian Krebs warns Researchers: XML Security Flaws are Pervasive in this 8/5/2009 Washington Post article:

Security researchers today unveiled details about a little-known but ubiquitous class of vulnerabilities that may reside in a range of Internet components, from Web applications to mobile and cloud computing platforms to documents, images and instant messaging products. [Emphasis added.]

At issue are problems with the way many hardware and software makers handle data from an open standard called XML. Short for "eXtensible Markup Language," XML has been used for many years as a fast and efficient way to transport, store and structure information across a wide range of often disparate applications.

Researchers at Codenomicon Ltd., a security testing company out of Oulu, Finland, say they found multiple critical flaws in XML "libraries," chunks of code that are typically used and re-used in software applications to process XML data. …

<Return to section navigation list>

Cloud Computing Events

• Bob Gourley’s Announcing the Federal Technology Events Calender post of 8/8/2009 describes his

[P]ublic calendar titled the Federal Technology Events Calendar. This calendar uses Google Calendar technologies so it is fast and easy to maintain, which means it should be easy to keep it up to date.

Calendar data also is available for download in XML, ICAL and HTML formats.

• The B.NET (Bangalore.net) User Group announces a series of sessions focused on Windows Azure starting on 8/8/2009:

B.NET brings you a series of sessions on the Microsoft Cloud Computing platform - Windows Azure. Spread across 6 sessions of 90 minutes each, this series takes you through the nuts and bolts of Windows Azure. Some of the key concepts of Windows Azure like the Fabric, Web Role, Worker Role, Tables, Blobs, Queues and configuration will be covered in-depth in the sessions. By end of the series, you would be able to architect cloud services for Azure or migrate your existing applications to the Azure platform.

What's more? Those members who attend all the 6 sessions and successfully complete a quiz by the end of the series stand to win cool prizes from our sponsors!

When: 8/8/2009 11:00 AM to 1:00 PM 
Where: PANANI Room, Microsoft Signature Building, EGL, Koramangala Ring road, Bangalore

[The five remaining session don’t have dates assigned.] 

• Indiana University issued a Call for Student Participation: Cloud Computing and Collaborative Technologies in the Geosciences on 8/7/2009:

Students from all IU campuses and other university students from across the US have an opportunity to consider the implications of cloud computing on the geosciences while networking with some of the leading thought leaders in the field. The Indiana University Pervasive Technology Institute Data to Insight Center (D2I) is soliciting student abstracts for an upcoming workshop titled "Cloud Computing and Collaborative Technologies in the Geosciences."

Sponsored by the National Science Foundation, the workshop will be hosted by the Pervasive Technology Institute and the Linked Environment for Atmospheric Discovery (LEAD) Project and will take place September 17-18, 2009, at the University Place Conference Center on the campus of Indiana University-Purdue University Indianapolis.

Abstracts for poster sessions will be accepted through August 20, 2009. Funding awards for travel and accommodations will be recommended to those posters targeted to: geosciences, including atmospheric, earth sciences, hydrology, environmental sciences, and climatology; collaborative technologies; and cloud computing. …

When: 9/17 to 9/18/2009   
Where: University Place Conference Center, Indiana University-Purdue University, Indianapolis, IN, USA 

InformationWeek’s Vivek Kundra, United States Federal CIO, Announced as Keynote Speaker for 2009 InformationWeek 500 Conference press release of 8/5/2008 says:

Vivek Kundra, Federal CIO, will deliver the opening keynote address on Monday, September 14, at 8:15 a.m. PT at the 2009 InformationWeek 500 Conference and Gala Awards, to be held at the St. Regis Monarch Beach Resort in Dana Point, Calif. Kundra will share his unique perspectives on getting things done within the massive federal bureaucracy, ensuring that his $75 billion annual IT budget delivers maximum value and impact. …

Bring your surfboard.

When: 9/14/2009 8:15 AM   
Where: St. Regis Monarch Beach Resort, Dana Point, CA, USA

Adam Grocholski announces the Twin Cities Cloud Computing User Group’s August Meeting to take place August 26, 2009 from 8:30 am to 10:30am at the
Microsoft Office - Bloomington, MN.

Featured Speaker:
David Chappell, Chappell & Associates
An Overview of the Windows Azure Platform
In this session David Chappell will discuss the Windows Azure Platform which includes Windows Azure, SQL Azure and .NET Services. He will also compare Windows Azure with Amazon Web Services (AWS), Google App Engine and SalesForce.com.

When: 8/26/2009, 8:30 to 10:30 AM   
Where: 8300 Norman Center Drive, Suite 950, Bloomington, MN 55437

<Return to section navigation list> 

Other Cloud Computing Platforms and Services

• Martin Eley says SalesForce.com time to rethink the price tag? for its application platform on 8/5/2009:

SalesForce have recently been heavily promoting their application development platform.  The platform offers all of the benefits of cloud computing (scaleable, lower costs, etc) with the added bonus of best in breed CRM and sales support.

As more and more organizations are looking towards cloud computing to reduce their ICT spend cloud computing is very attractive.  Add in all of the ready to use functionality SalesForce offers and it would appear to be the best solution but there are some hidden costs to consider.  For example if an organization wanted to authenticate users to their Visual Force site they would need to purchase a license for each user or pay per sign on.

An organisation wanting to host large volumes of data would have to pay extra once they have exceeded their data allowance (typically 1GB for an enterprise license).

For SalesForce to compete with rivals such as Amazon Web Services they will need to consider changing their price structure.  In the past their current price structure worked well for CRM and sales software as a service (SaaS) but they are now in the application development market and those high prices cannot compete with competitors who are offering cloud storage for $0.25 per GB/Month.

This is another case of miscategorizing the competition. Like Azure, the Sales Force app platform is a PaaS, not an IaaS like Amazon Web services. Fortunately, Martin compares SalesForce’s pricing with AWS and Google App Engine in these Google Sheets. It’s unfortunate that he didn’t include Azure in the comparison.

Peritor Consulting uncovers a relationship between instance size on Amazon EC2 bandwidth and reports their results in an Elastic Load Balancer and EC2 instance bandwidth post of 8/6/2009:

So we are working on a caching related project on EC2. In this scenario high performance is very important.

We are setting up a Varnish cluster on EC2 and evaluate if can replace an existing caching infrastructure in terms of costs and requests per second. Our benchmarks yielded some interesting results. It seemed that for our caching scenario the limiting factor is bandwidth. Varnish is very humble with CPU/RAM consumption. We could easily deliver 500 to 600 requests per second with a small instance and have the box idle around 95% (uncompressed content).

It turns out we are limited by bandwidth and not by CPU.

In our benchmarks we were only able to push 35 MB/s on small instances. So the actual requests per seconds were dependent on the object size we were pushing. The limit were always ~35 MB/s. Our typical HTML pages were around 50 to 70 KB, so we couldn’t reach the desired requests per second as our instance was at it’s bandwidth limit. …

Bernard Golden addresses the bandwidth issue in his The Skinny Straw: Cloud Computing's Bottleneck and How to Address It post of 8/6/2009 to CIO.com:

Virtualization implementers found that the key bottleneck to virtual machine density is memory capacity; now there's a whole new slew of servers coming out with much larger memory footprints, removing memory as a system bottleneck. Cloud computing negates that bottleneck by removing the issue of machine density from the equation—sorting that out becomes the responsibility of the cloud provider, freeing the cloud user from worrying about it.

For cloud computing, bandwidth to and from the cloud provider is a bottleneck. We recently performed a TCO analysis for a client, evaluating whether it would make sense to migrate its application to a cloud provider. Interestingly, our analysis showed that most of the variability in the total cost was caused by assumptions about the amount of network traffic the application would use. This illustrates a key truth about computing: there's always a bottleneck, and solving one shifts the system bottleneck to another location.

Virtualization implementers found that the key bottleneck to virtual machine density is memory capacity; now there's a whole new slew of servers coming out with much larger memory footprints, removing memory as a system bottleneck. Cloud computing negates that bottleneck by removing the issue of machine density from the equation—sorting that out becomes the responsibility of the cloud provider, freeing the cloud user from worrying about it. …

Zack’s Investment Research‘s Analyst Blog reports CRM Focuses on Healthcare on 8/6/2009:

Healthcare provides a good business opportunity to information technology companies, a fact reinforced by Salesforce.com (CRM - Analyst Report). The company is investing in Practice Fusion, which is involved in the business of electronic health records, health policy, health information technology and consumer medical data topics. Salesforce.com will invest around $10.0 million for a marginal stake in the company, which will generate around $1.0 million of revenue a year for the company. …

<Return to section navigation list> 

Technorati Tags: Windows Azure,Azure Services Platform,Azure Storage Services,Azure Table Services,Azure Blob Services,Azure Queue Services,SQL Azure Database,SADB,SDS,.NET Services,Cloud Computing,Hadoop,Hive,Amazon EC2,Health Information Technology,HIT,Electronic Health Records,EHR,Personal Health Records,PHR,HIPAA,HealthVault,Google Health,VistA,Practice Fusion