Tag: "Data Deduplication"

Flood Affects Storage Industry


There was a great post a couple of weeks ago, with Tom Coughlin as a contributing editor, on Forbes’ news site about the floods that hit Thailand and how it will affect the disk drive market.  The great thing about the article is it truly highlights that necessity is the mother of invention.  What do I mean by that?  Over the past few “storage efficiency” has been a big topic with vendors.  Helping customers “do more with less”, especially in these stringent economic times, is key to the vitality of a number of businesses.  Technologies such as storage virtualization and thin provisioning have helped customers to slow their storage spend and get better utilization out of their existing storage.  Once customers have moved their utilization rates from 35% to 65% or 70%, time comes when new storage needs to be acquired to keep up with the growth of data.  The issue comes when there are no more disk drives to be acquired.  Due to the floods in Thailand, analysts predict that the storage industry could be 50 to 60 million units shy of the demand this quarter.  This does two things:

1)      Drives the price of disk higher, at a time when the expectation is to spend less for disk

2)      Has IT getting more creative on how they use and deploy their storage

It is the later that I want to focus on as paying more for disk is not necessarily the best option.  It is important to note that data grows for one reason, business does not stop, it needs to keep going and it is what is driving the demand on the data.

In the Forbes piece Tom talks about “a surge in new technologies because of this disk shortage” but he doesn’t cover some of the most innovative technologies that are available to help customers.  I would agree with Tom that we “could” see a surge in SSD but that would be short lived do to both supply and cost as well as a surge in tape, but these aren’t really “new technologies”.

This is a preview of Flood Affects Storage Industry. Read the full post
PDF Download    Send article as PDF   
Dec 01, 2011 | 0 comments View Post

Top 10 Reasons to Use IBM for VM Deployments


 

IBM @ VMworld 2011

After a full first day at VMworld, I started to think more about IBM and their technology solutions that help customers in a VMware environment.  Here is a top ten list of things to consider when looking at a VMware implementation and how IBM can help.

#1 Integration

VMware is playing Switzerland and ensuring all vendors are on a level playing field, so when other vendors state that they have “better” or “closer” technology integration than other vendors its probably not true.  Some vendors may not choose to integrate with certain things, but rest assured, all of   VMware’s APIs are open to all vendors.  Take a look and see how IBM is providing plug-ins for vSphere, SRM, and VAAI in XIV as well as other storage platforms.

#2 Ease of Use

IBM has seen, firsthand, a number of our customers switch from different competitive platforms to XIV because of the simplicity of the XIV solution.  A large manufacturer is one example of a customer who is provisioning new VMware instances in less than five minutes with XIV. 

Another XIV customer, who is a very experienced storage administrator, saw the XIV GUI and quoted "I don't get it (XIV GUI).  It can't be that easy.  Either I'm missing something or they are not showing me everything."  Well, the reality is, it is that easy and that interface is prolific throughout the IBM storage portfolio including the Storwize V7000 and SVC.

#3 Storage Efficiency

Probably one of the most important topics this year is Storage Efficiency and IBM is a leader in this department.  The N-Series with the Real-time Compression appliance can reduce the VMware storage footprint up to 75%.  Users tell us that by implementing VMware, their storage footprint has grown by as much as 4x.  Therefore their overall IT budgets didn’t get better, the dollars just shifted from servers to storage.  IBM’s Real-time Compression users can save up to 75% without any performance impact.  Additionally, Real-time Compression is the only compression technology that works in conjunction with deduplication, compressing the data before it is dedplicated, giving an added benefit to the technology.

This is a preview of Top 10 Reasons to Use IBM for VM Deployments. Read the full post
PDF    Send article as PDF   
Aug 30, 2011 | 0 comments View Post

Efficiency vs. Optimization


“Storage Efficiency” has become a big topic over the past 12 months.  There are a number of new technologies that have come out in the last few years that are helping to deal with storage growth.  We all know that data is the root of the decisions that drive business today.  The more data you have, hopefully, the better decisions you can make to drive your business to success.  The question is, “what is the value (and hence the cost) of the infrastructure to create that success?”  What we do know is that the ability to put more data in a highly efficient footprint can give your company a competitive edge.  There are five technologies that can help an IT organization create an efficient storage infrastructure.  These are:

 

1)      Tiering

2)      Virtualization

3)      Thin Provisioning

4)      Compression

5)      Deduplication

It is also important to point out that there are some semantics when talking about storage efficiency, specifically between efficiency and optimization technologies.  I think it is useful to attempt to define these as they lead us to picking the right solutions for what we are trying to accomplish.  For the purpose of this post, efficiency will relate to making existing capacity more useful and optimization will mean making more capacity out of existing capacity.

Using these definitions, technologies such as Tiering, Virtualization and Thin Provisioning are efficiency technologies.  These technologies help to utilize the existing capacity that you have.

Tiering is technology that is used on about 10% of your data or less.  It is used to move data that requires higher performance to flash storage.  Good tiering technology analyzes data access patterns and moves the most active data to the highest performing disk.  It doesn’t really change the amount of physical capacity that is required; it just changes what type of capacity is required and allows IT to make sure data is operating as fast and efficiently as possible.

This is a preview of Efficiency vs. Optimization. Read the full post
PDF Creator    Send article as PDF   
Jun 30, 2011 | 1 comment View Post

Data Protection, Retention and Archive Starts with Data Value


It feels good to open up the blogging again to new topics, especially ones I am intimately familiar with.  (But have no fear, there will be references to primary storage optimization / compression.)

This weekend I had an interesting conversation with my Dad.  We were discussing backup.  My dad basically runs IT for the State of Maine.  The State of Maine uses CommVault backup software.  So I posed the question to him, “What would it take for you to rip out CommVault and replace it with another solution.  He thought about it for a moment and replied “I wouldn’t”.  His answer came down to a couple of reasons.

First was the expense.  It’s not just about buying the new software, it would be training people to run the new software and it would be about throwing away the massive investment they have in their existing product as well as converting all the years of backup takes created with one software to the new software.  This is one of the biggest things vendors forget when trying to sell a customer on their backup software.

Second was the fact that, feature for feature, the top 5 traditional backup software products are not really that different from one another.  Sure, I do agree that some products have features that others don’t, and others products have features that work better than others, but in reality, the delta is so small and the workarounds are so simple it doesn’t really matter.  Unless your replacing traditional backup software with an evolutionary source based data deduplication software (which is only applicable for some environments) there is no advantage to switching software.

The challenge is if Data Protection is still one of the biggest and most expensive pain points within IT, how do the problems get resolved if replacing the software controlling it all is too costly to change?

This is a preview of Data Protection, Retention and Archive Starts with Data Value. Read the full post
PDF Printer    Send article as PDF   
May 09, 2011 | 1 comment View Post

Language Weaver – RtC – Total Transparency


See how Language Weaver has utilized IBM Real-time Compression and are getting 3 to 1 compression and the solution was totally transparent to their infrastructure.

Permanent link to this post (27 words, estimated 6 secs reading time)
Free PDF    Send article as PDF   
Feb 18, 2011 | 2 comments View Post

Shopzilla – IBM Real-time Compression is Transparent


Shopzilla has been a customer of the IBM Real-time Compression technology for over 2 years.  Here they describe the benefits of the technology.

Permanent link to this post (25 words, 1 image, estimated 6 secs reading time)
Create PDF    Send article as PDF   
Feb 15, 2011 | 0 comments View Post

Real-time Compression “Meets Minimum”


IBM's Ed Walsh, Director of Storage Efficiency sits down with Steve Duplessie, Founder of ESG to talk about how IBM Real-time Compression sets the bar for doing storage optimization in NAS. At the end of the day, if you can do compression in real time, without sacrificing performance and the transparency of the implementation, then why wouldn't you - given the savings you can get over traditional compression.

We all know compression is not new and it is coming as a standard feature in a number of storage systems. The issue is, each of these technologies has a significant impact on performance - both primary storage performance as well as the performance on all of the back end operations such as backups, replication etc...

IBM's Real-time Compression doesn't have any of these limitations - listen to Ed to hear more.

Permanent link to this post (142 words, estimated 34 secs reading time)
PDF Download    Send article as PDF   
Jan 19, 2011 | 0 comments View Post

Key Competitive Advantages to IBM Real-time Compression


It still baffles me when there is so much information available for people to learn about any topic and it is not used.  Many times people just tend to rely on the information provided by their employer (which in many cases is just competitive FUD).  This video was the result of reading an email between IBM and one of their key partners on the competitive knowledge of each others products.

Permanent link to this post (72 words, estimated 17 secs reading time)
PDF Printer    Send article as PDF   
Jan 10, 2011 | 0 comments View Post

Storage Alchemist Video Update #2


See how data deduplication and IBM Real-time Compression work hand in hand.

Permanent link to this post (14 words, 1 image, estimated 3 secs reading time)
PDF Printer    Send article as PDF   
Jan 06, 2011 | 0 comments View Post

Linked In Storage Discussion on Storage Efficiency


Great conversation on Linked In about deduplication and compression for storage efficiency in the Data Storage Professionals Group.  Help the storage community answer this question:

Does anyone has any experience in NAS de-duplication at filesystem level, like NetApps. Does it really work? I concerns/limitations?

Permanent link to this post (46 words, 1 image, estimated 11 secs reading time)
PDF Creator    Send article as PDF   
Jan 04, 2011 | 2 comments View Post
Next Page »