Tag: "Capacity Optimization"

Fixed Input vs. Variable Input Compression


As a number of you know, I have been blogging about the merits of Real-time Compression.  It may be of some interest to know that when Ed Walsh, CEO of Storwize, asked me to join and told me the company focused on "compression", I first thought he was joking.  I mean the industry has had compression available for years.  The reality is, there is no other technology like Real-time Compression available from any vendor, and it is today, even more clear, why IBM chose to own this technology.  In the next few blog pieces I plan to talk about a few of the concepts of the IP that make this technology so far advanced than any / all of its competition. Today’s piece is about fixed input versus variable input compression.  This is a very simple concept to understand really.  Traditional compression uses a process called 'fixed input' / 'variable output'.  If we refer to the diagrams below, we start off with the original file on the left and the compressed file on the right.  The way traditional compression works (and you can actually watch this on your home computer if you winzip a file) is the following: The compression algorithm will 'chunk up' the original file into 'manageable' sizes before it compresses the file.  The tradeoff here, and why this process happens, is like with anything in computer science, performance for optimization.  The first diagram shows the large file being 'chunked up', compressed and stuffed into the smaller file.

 

  

Figure 1

There are two significant issues with this. The first issue is that the compression dictionary is not shared across multiple ‘chunks’ when compression is taking place.  The example in Figure 2 shows that the letter “F” in ‘chunk’ 1 does not get compressed with the letter “F” in ‘chunk’ 4.  This means that the compression ratio is simply not optimized across the file.

This is a preview of Fixed Input vs. Variable Input Compression. Read the full post
PDF    Send article as PDF   
Nov 03, 2011 | 0 comments View Post

Dell/Ocarina – Too Little, Too Late


On October 11, 2011, at Dell World, Dell announced a component to their DX6000G object based storage called an “SCN” or Storage Compression Node.  It is interesting that Dell would mention in their blog post that this is “Dell’s first Ocarina based solution…” What makes this interesting is the value proposition behind Ocarina was its ‘content aware’ deduplication, not necessarily compression.  That said, this blog post seems to be the ONLY information on Dell’s web site about the product and there is very little in the press about this product and the technology.

While it is nice to see that Dell, who has committed to their own storage technology, understanding that storage optimization is important, the reality is they are a little to late to the game.  I say this because the announcement that came from Dell around their 6000 is really bizarre.  First, the solution is an object based solution.  Didn't they learn anything from EMC?  The Centera is not gaining a lot of momentum these days, even if they had a lot of ISV partners.  In fact, it is loosing ground.  Object based storage was good before the whole 'Big Data' thing was the 'next big thing' but today, people need a big clustered file system, that is optimized, that can server not only unstructured based data, but also some structured data that allows you to find stuff quickly.  Also, the DX may be a good solution for data types that are of the media / entertainment only segment, but when it comes to running a business, it takes more than just this object based file structure to be successful.

To me, this solution is too little, too late.  Dell, in order to be a true competitor in the space that is highly scale-able, clustered file systems that are optimized, they need to advance their thinking.   This will be difficult for Dell.  First of all they are not known for technology advancement or integration.  Until they announced thier departure from EMC they didn't really have a major focus on storage and now with their acquisitions, the question is, what is their value prop.  Couple that with the fact that IBM has 1000's of patents in storage and Dell doesn't where does that leave the direction of Dell storage?

This is a preview of Dell/Ocarina – Too Little, Too Late. Read the full post
PDF Printer    Send article as PDF   
Oct 27, 2011 | 0 comments View Post

Storage Efficiency Panel – SNW 2011 Fall


Yesterday I was on a panel at SNW in Orlando Florida.  The panel was hosted by Dave Vellente, Founder of Wikibon and always a great host for these kinds of things.  On the panel was Larry Freeman of NetApp, Craig Nunes of HP (formally 3Par), Jarred Floyed CTO / Founder at Permabit and myself, IBM (formally Storwize).

Some interesting data came out of this panel.  There were probably over 150 people in the audience.  It was a well-attended session.  Also, Dave is VERY good about asking the audience questions.  Let me start by making sure we all know where everyone sits at the “storage efficiency table” that was on the panel.

  • Larry Freeman is from NetApp – they claim, and I believe them, that they have 10 storage efficiency technologies that are embedded into WAFL
  • Craig Nunes main focus on the panel was ‘zero reclamation’ to optimize storage
  • I have a Real-time Compression drum I am beating
  • Jarred Floyed focuses on data deduplication

Here are some questions and answers Dave got when speaking to the audience:

Dave’s Question

Audience Response (in close estimated %)
How many people use deduplication / compression in their storage? 60% responded they did use one or both of these technologies in their environment
How do users use these technologies - embedded or appliance? 100% of the 60% said "embedded"
Who is your storage vendor was that provided these technologies? 100% of the 60% said NTAP
What is the number 1 issue was with the embedded solution and making it not more widely adopted? Performance was the answer.  They all believed that for 70% of their applications, the embedded solution was “good enough” but for 30% where performance is critical – it couldn’t do the job.
Why are not more appliances deployed to solve the performance issues? The response was that customers didn’t want to have to manage multiple solutions in their environment doing the same thing.
This is a preview of Storage Efficiency Panel – SNW 2011 Fall. Read the full post
Create PDF    Send article as PDF   
Oct 11, 2011 | 0 comments View Post

The Storage Alchemist in Prague


Alright, landed safe in Prague and was picked up by one of my colleagues and whisked away to the IBM office.  There we did an interview with Czech writer Martin Noska from Computerworld for IDG in Czech Republic.  The first Noska informed me was that IBM is the number one in storage sales in Czech Republic (just like Poland!).  He also had some very good questions and he with “What are IBM’s biggest challenges in the storage business”?  I had thought about this for a while and I would have to say it is really about marketing our storage “solutions” to the customer base.  IBM is a double edge sword.  IBM is so big and has so many products it becomes difficult to market or message all of our products without inundating all of our customers and confusing them.  If you think about it, IBM has hundreds of thousands of customers and business partners, if not more.  This is one of our strengths.  When customers have needs or requirements we have very good input into our product portfolio, perhaps the best in the business.  Combine this with the fact that IBM has not only storage solutions but technology across the entire stack from servers to networking.  So when it comes to developing the right technology, that solves real customer problems, I would argue that IBM’s portfolio is the best in the business.  IBM takes an extreme amount of care when developing a solution to ensure that it matches the customer requirements based on the changing needs of IT.  Having an integrated portfolio that works well with our ISV partners, VMware for example, allows us to help customers speed their time to ROI and be very competitive in the market place.  The challenge is, how do we properly message our new solutions to our customers, in a timely manner so that they are well aware of new products without giving them too much information such that it just becomes noise?  It is difficult to say the least.

This is a preview of The Storage Alchemist in Prague. Read the full post
PDF    Send article as PDF   
Sep 12, 2011 | 0 comments View Post

Top 10 Reasons to Use IBM for VM Deployments


 

IBM @ VMworld 2011

After a full first day at VMworld, I started to think more about IBM and their technology solutions that help customers in a VMware environment.  Here is a top ten list of things to consider when looking at a VMware implementation and how IBM can help.

#1 Integration

VMware is playing Switzerland and ensuring all vendors are on a level playing field, so when other vendors state that they have “better” or “closer” technology integration than other vendors its probably not true.  Some vendors may not choose to integrate with certain things, but rest assured, all of   VMware’s APIs are open to all vendors.  Take a look and see how IBM is providing plug-ins for vSphere, SRM, and VAAI in XIV as well as other storage platforms.

#2 Ease of Use

IBM has seen, firsthand, a number of our customers switch from different competitive platforms to XIV because of the simplicity of the XIV solution.  A large manufacturer is one example of a customer who is provisioning new VMware instances in less than five minutes with XIV. 

Another XIV customer, who is a very experienced storage administrator, saw the XIV GUI and quoted "I don't get it (XIV GUI).  It can't be that easy.  Either I'm missing something or they are not showing me everything."  Well, the reality is, it is that easy and that interface is prolific throughout the IBM storage portfolio including the Storwize V7000 and SVC.

#3 Storage Efficiency

Probably one of the most important topics this year is Storage Efficiency and IBM is a leader in this department.  The N-Series with the Real-time Compression appliance can reduce the VMware storage footprint up to 75%.  Users tell us that by implementing VMware, their storage footprint has grown by as much as 4x.  Therefore their overall IT budgets didn’t get better, the dollars just shifted from servers to storage.  IBM’s Real-time Compression users can save up to 75% without any performance impact.  Additionally, Real-time Compression is the only compression technology that works in conjunction with deduplication, compressing the data before it is dedplicated, giving an added benefit to the technology.

This is a preview of Top 10 Reasons to Use IBM for VM Deployments. Read the full post
Create PDF    Send article as PDF   
Aug 30, 2011 | 0 comments View Post

Efficiency vs. Optimization


“Storage Efficiency” has become a big topic over the past 12 months.  There are a number of new technologies that have come out in the last few years that are helping to deal with storage growth.  We all know that data is the root of the decisions that drive business today.  The more data you have, hopefully, the better decisions you can make to drive your business to success.  The question is, “what is the value (and hence the cost) of the infrastructure to create that success?”  What we do know is that the ability to put more data in a highly efficient footprint can give your company a competitive edge.  There are five technologies that can help an IT organization create an efficient storage infrastructure.  These are:

 

1)      Tiering

2)      Virtualization

3)      Thin Provisioning

4)      Compression

5)      Deduplication

It is also important to point out that there are some semantics when talking about storage efficiency, specifically between efficiency and optimization technologies.  I think it is useful to attempt to define these as they lead us to picking the right solutions for what we are trying to accomplish.  For the purpose of this post, efficiency will relate to making existing capacity more useful and optimization will mean making more capacity out of existing capacity.

Using these definitions, technologies such as Tiering, Virtualization and Thin Provisioning are efficiency technologies.  These technologies help to utilize the existing capacity that you have.

Tiering is technology that is used on about 10% of your data or less.  It is used to move data that requires higher performance to flash storage.  Good tiering technology analyzes data access patterns and moves the most active data to the highest performing disk.  It doesn’t really change the amount of physical capacity that is required; it just changes what type of capacity is required and allows IT to make sure data is operating as fast and efficiently as possible.

This is a preview of Efficiency vs. Optimization. Read the full post
PDF    Send article as PDF   
Jun 30, 2011 | 1 comment View Post

Shopzilla – IBM Real-time Compression is Transparent


Shopzilla has been a customer of the IBM Real-time Compression technology for over 2 years.  Here they describe the benefits of the technology.

Permanent link to this post (25 words, 1 image, estimated 6 secs reading time)
PDF    Send article as PDF   
Feb 15, 2011 | 0 comments View Post

Real-time Compression “Meets Minimum”


IBM's Ed Walsh, Director of Storage Efficiency sits down with Steve Duplessie, Founder of ESG to talk about how IBM Real-time Compression sets the bar for doing storage optimization in NAS. At the end of the day, if you can do compression in real time, without sacrificing performance and the transparency of the implementation, then why wouldn't you - given the savings you can get over traditional compression.

We all know compression is not new and it is coming as a standard feature in a number of storage systems. The issue is, each of these technologies has a significant impact on performance - both primary storage performance as well as the performance on all of the back end operations such as backups, replication etc...

IBM's Real-time Compression doesn't have any of these limitations - listen to Ed to hear more.

Permanent link to this post (142 words, estimated 34 secs reading time)
Free PDF    Send article as PDF   
Jan 19, 2011 | 0 comments View Post

Trident Micro Has Success with IBM Real-time Compression


As with any new technology there is a hurdle to get over before putting it into production, but once in, it can add a TON of value.

Trident Micro mentioned on runningDATA with Steve and Dave


Watch live video from skenniston on Justin.tv
Permanent link to this post (45 words, estimated 11 secs reading time)
Create PDF    Send article as PDF   
Jan 14, 2011 | 0 comments View Post

Linked In Storage Discussion on Storage Efficiency


Great conversation on Linked In about deduplication and compression for storage efficiency in the Data Storage Professionals Group.  Help the storage community answer this question:

Does anyone has any experience in NAS de-duplication at filesystem level, like NetApps. Does it really work? I concerns/limitations?

Permanent link to this post (46 words, 1 image, estimated 11 secs reading time)
Free PDF    Send article as PDF   
Jan 04, 2011 | 2 comments View Post
Next Page »
cars promotion car rental companies in england low duties . HLI-C771SL extended battery . schoenen online