Enterprise Cloud Storage « Zetta Scalabytes Blog

April 29, 2010

What data would you put in the cloud?

Jeff runs corporate marketing for Zetta. Prior to Zetta, Jeff was VP of Marketing at Pivot3 and VP of Marketing at Pillar Data Systems.

In the fall of 2009, a survey of more than 400 IT professionals probed their status and plans for cloud storage as a means of handling unstructured data. A broad spectrum of industries was included in the survey with software and technology, government, education and financial services being the most prevalent.

As part of the survey, Respondents were asked to select which applications they either already were or would consider moving to the cloud. Multiple selections could be made.

The two most often-selected applications were backup, selected by 38 percent of the respondents, and online archive at 37 percent. There is no surprise there, as those are very early use cases that can fit into first-generation cloud storage offerings.

Cloud Storage Application Graph

Data warehousing (28 percent), primary file storage (25 percent) and business continuance (18 percent) were the next most chosen applications. It’s interesting that primary file storage scored as high as it did. Many early cloud offerings do not make that an easy transition as new APIs and storage techniques are required. This indicates though a need and willingness on the part of the users to explore this option.

Twenty-six percent of the respondents selected “none,” indicating that they would not consider using cloud storage for anything. I suppose the reverse logic would say that 74% would consider cloud storage?

At Zetta, approximately a third of our clients are doing primary storage, usually workgroup collaboration, a third are doing active archiving and a third are doing some form of off-site data protection for backup or DR.

You can download the full survey report here.

Tweet This

Tags: Archive, Backup, Clooud Applications, cloud applications, Enterprise Cloud Storage, Primary storage, Use Cases, Workgroup
Posted in Cloud Storage | No Comments »

March 31, 2010

Hosting Primary, Unstructured Enterprise Data in the Cloud – Part 8: Administrative Transparency and Control

Chris Schin, VP Products, is responsible for coordinating all Zetta product-related initiatives including product strategy, direction, and marketing, as well as business model and go-to-market process definition. Prior to joining Zetta, Chris was acting GM and Senior Director for Symantec Protection Network, Symantec's Software as a Service platform.

Hi — this blog series contains concepts that we used to design the Zetta storage solution, based on feedback from enterprise IT professionals and their needs.

Here is an outline of this series and hyperlinks to previous posts:

This post discusses how a service provider can engender trust from customers through transparent access to administration tools and system information.

A good software user interface enables easy & quick access: to information about the functioning of the system (monitor), and to the features available to the user (manage). Placed in the context of an IT storage professional, such a UI should provide:

An intuitive interface; one that behaves like existing filer controls and enables rapid navigation to trending information and features
A robust control framework — designed for IT professionals — one that enables access management, access logging, and controls for things like snapshots and replication
Transparent visibility into storage solution behavior — both good and bad events should be surfaced in order to provide the user confidence that he has access to all available events that are relevant to his data set
Instant access to support and knowledge, in the form of online ticketing and a maintained knowledgebase

Zetta Events Screen Shot

Both actionable alerts to respond to, and automated self-healing capabilities; what this amounts to is a notification framework with some auto-corrective actions
The ability to delegated administration based on granular roles and permissions, leveraging existing LDAP permissions
Access from anywhere (i.e. Web-based)

This may not seem like a long or onerous list, but if you have any experience with the UIs of either enterprise NAS filers or cloud storage providers, you’ll have noticed that many of these seemingly simple requirements were not fulfilled.

Tweet This

Tags: Cloud Requirements, Enterprise Cloud Storage, Enterprise Features, management, transparency
Posted in Cloud Storage, Storage Management | 7 Comments »

March 03, 2010

Hosting Primary, Unstructured Enterprise Data in the Cloud – Part 7: Non-blocking Performance

Chris Schin, VP Products, is responsible for coordinating all Zetta product-related initiatives including product strategy, direction, and marketing, as well as business model and go-to-market process definition. Prior to joining Zetta, Chris was acting GM and Senior Director for Symantec Protection Network, Symantec's Software as a Service platform.

Hello again and welcome back to my blog series outlining what our customers told us they wanted to see in a cloud storage solution before they would put primary copies of their enterprise data in the cloud. Again, it is important to note that these requirements drove the design and development of the solution we have in market today.

This is the outline of the series and hyperlinks to previous posts:

This post discusses how a service provider must create a storage solution architecture that can ensure “non-blocking” performance, enabling it to adapt to multiple customer access patterns simultaneously.

There is no question that innovations have allowed today’s traditional arrays to scale to huge capacity — hundreds of terabytes per array. But the core array architecture has changed little across time, and this architecture can limit the amount of additional capacity that can be added, and can even prevent existing capacity from being utilized adequately. A massive scale, multi-tenant architecture requires a fundamentally different design — one that borrows heavily from distributed systems design principles.

There are effectively three components to any storage solution: the network, the controller, and disk. In a traditional array, purchase-time decisions are made that determine the ratios of each of these to the others, and those decisions are very difficult to alter once the array has been deployed. Unfortunately, circumstances change, and one of these three components almost always becomes the bottleneck, preventing full utilization of the other components. For example, if the workload winds up being more controller-intensive than expected, the disks won’t ever be filled.

A service provider who tries to construct a storage service using a series of high-priced, traditional arrays will fall prey to this dynamic in a very acute way — installing multiple arrays doesn’t obviate this issue, it expands it. This is augmented by the fact that there is literally no way to plan in advance for customer behavior when the customer isn’t even identified prior to array purchase, as is the case for a cloud storage service provider.

A cloud service provider shouldn’t attempt to use traditional vendor-produced arrays to create a storage service — the costs don’t add up, any single customer’s access pattern could negatively impact others, and the fundamental array architecture is in conflict with the notion of a storage service.

Instead, a storage service must be architected using Internet-centric distributed computing principles. Each of the tiers of the architecture — throughput, IOPs, and density — should be able to scale independently of any other tier, allowing the service provider to adapt to customer behavior — singly and in aggregate — as necessary to ensure adequate performance to all and adequate system resource utilization in the aggregate.

One additional best practice to mention: unlike computer processors, disks are mechanical devices — they spin at a certain maximum rate. As a result, if enough IOPs hit a disk at the same time, the disk can become snarled and disk throughput can fall off a cliff. Since both IOPs and density are determined by the disk, a storage service should provide a QOS engine — similar to a computer’s scheduler — to ensure that disks never reach a point-of-no-return under load, where IOPs begin to slow exponentially.

Tweet This

Tags: Cloud Requirements, Enterprise Cloud Storage, performance, QOS
Posted in Cloud Storage | 8 Comments »

January 19, 2010

Hosting Primary, Unstructured Enterprise Data in the Cloud – Part 6: Continuous Availability

Chris Schin, VP Products, is responsible for coordinating all Zetta product-related initiatives including product strategy, direction, and marketing, as well as business model and go-to-market process definition. Prior to joining Zetta, Chris was acting GM and Senior Director for Symantec Protection Network, Symantec's Software as a Service platform.

For those of you just joining here, I’m using this blog series to document what enterprise IT professionals have told us about the baseline requirements that would need to be met by a cloud storage service before they would consider storing their enterprise primary data in the cloud. This list outlines the high-level requirements and hyperlinks to previous posts:

This post lists a few questions you should ask your cloud storage vendor about their architecture for delivering availability before considering placing a primary copy of your data in their cloud:

“Does your solution have redundant network links from different top-tier networking providers?” It must; networks go down every day, no matter how expensive they are or what brand is behind them. Redundancy in networks is a baseline requirement for placing primary data in the cloud.
“Does your solution reside in a data center that has redundant power and cooling?” It must; if the environs of the systems holding your data are not adequately protected, failure of the solutions is inevitable, resulting in availability outages.
“Does your solution offer triple-layer redundancy at the storage controller tier at no additional cost?” It must; the controller tier holds the brains of the storage solution, and cannot afford downtime or corruption — this is not only key to system availability, but extends to data integrity as well.
“Does your solution leverage an advanced RAID algorithm to ensure that the data is available?” It must; holding single copies of data in multiple locations is not nearly as available and protected as holding RAID-6-protected copies of data in multiple locations.

Before you even consider putting a primary copy of your data into a cloud storage provider’s infrastructure, you should certainly ask these questions and receive detailed, satisfactory answers. If you are using a cloud solution today and don’t know the answers to these questions (or even whom to ask these questions), then you should be concerned about the availability and protection of your data.

Zetta’s CTO, Jeff Whitehead, is fond of using a nuclear submarine analogy when discussing system availability, as in “imagine you are on a nuclear submarine right now — would you be satisfied knowing that submarine was highly available, or would you demand that it be continuously available?” An enterprise solution must be built to the stringent demands of an enterprise IT professional, and when it comes to data, an enterprise IT professional demands continuous availability.

Tweet This

Tags: availability, Cloud Requirements, Enterprise Cloud Storage, network, RAID-6, RAIN-6, redundancy
Posted in Cloud Storage | 7 Comments »

January 12, 2010

Hosting Primary, Unstructured Enterprise Data in the Cloud – Part 5: Data Security/Privacy

Chris Schin, VP Products, is responsible for coordinating all Zetta product-related initiatives including product strategy, direction, and marketing, as well as business model and go-to-market process definition. Prior to joining Zetta, Chris was acting GM and Senior Director for Symantec Protection Network, Symantec's Software as a Service platform.

Happy New Year! I’m back with part 5 of a nine-part blog series that describes the requirements for hosting primary unstructured enterprise data in the cloud.

This entire blog series includes an introduction and the following set of requirements:

When talking to enterprise IT professionals (our customers), the second-most frequently-referenced concern/consideration (second only to “don’t lose or corrupt my data,” which was covered in my last post) is “don’t let anyone else see or steal my data.”

As this first post of the year comes right after Network World has named Zetta as one of the ‘10 Storage Startups to Watch,’ I would like to say that it is certainly rewarding to see editors such as Jon Brodkin recognize that while “many companies are concerned about the safety of trusting their information to a third party, to help ease those concerns, Zetta has built a system that encrypts data at rest, and can withstand multiple hardware and network failures without losing data.” There are certain baseline security/privacy criteria that must be met prior to trusting a cloud storage solution with primary copies of enterprise data.

Wireline encryption: Using a storage service (as opposed to an inside-the-firewall solution) clearly implies a need to secure the data in transit from the enterprise to the service. Fortunately, this is increasingly facilitated by the protocols themselves. Most file transfer protocols and Web-optimized storage protocols have encrypted versions readily available today, including sFTP, FTPS, and Secure WebDAV, run over HTTPS. Even traditional storage access protocols are building in wireline encryption in recognition of our increasingly Internet-driven existence, such as NFSv4.

While we encourage customers to use these encrypted protocols, there are clearly use cases that require the use of unencrypted protocols. The solutions here are also tried and true — either encrypt prior to sending the data, contract for a dedicated network link, or work with the service provider to put in place a secure tunnel, such as a VPN.
Logical partitioning within multi-tenancy: By some definitions (certainly mine), a service must be multi-tenant before it can be considered a “cloud” service[i]. In order for enterprise IT professionals to have confidence using a cloud storage service for enterprise data, they must know that their data cannot be accessed while resident in service infrastructure. The first step to this is to ensure logical separation between customers at the “front door” of the service infrastructure — the initial customer access point to the service. Virtualization makes this easy — simply house every customer’s mountpoint as a unique URI within a distinct virtual machine instance. This way, you know that your access point is completely unique to you, and is not a shared resource comingled with other users.
At-Rest Encryption: By far the most significant feature to ensuring data security is default encryption at rest, supplied by your service provider at no additional cost. Ideally this should be facilitated by a full Public Key Infrastructure (PKI) backed by FIPS 140-2 compliant key repositories, with advanced bit encryption, a robust key rotation scheme, and ideally per-customer or per-volume keys. Strong encryption at rest is really table stakes for any enterprise-class data storage service.

To reiterate a common theme across these posts — it is important to remember that these are the baseline requirements that your cloud storage provider should take in consideration from the development phase. These types of customer requirements drove the design of the Zetta storage solution, which was built specifically to house enterprise primary data in the cloud.

I’ll be back in a few days to touch on the next requirement, continuous availability architecture.

[i] Note that this is not a statement unique to storage services, but to any kind of service.

Tweet This

Tags: Cloud Requirements, encryption, Enterprise Cloud Storage, Enterprise Features, FIPS, FTPS, PKI, security, sFTP
Posted in Cloud Storage, Zetta Product | 8 Comments »

Zetta Scalabytes Blog

Posts Tagged ‘Enterprise Cloud Storage’

Archives

Categories