Tag: "storage optimization"

Fixed Input vs. Variable Input Compression


As a number of you know, I have been blogging about the merits of Real-time Compression.  It may be of some interest to know that when Ed Walsh, CEO of Storwize, asked me to join and told me the company focused on "compression", I first thought he was joking.  I mean the industry has had compression available for years.  The reality is, there is no other technology like Real-time Compression available from any vendor, and it is today, even more clear, why IBM chose to own this technology.  In the next few blog pieces I plan to talk about a few of the concepts of the IP that make this technology so far advanced than any / all of its competition. Today’s piece is about fixed input versus variable input compression.  This is a very simple concept to understand really.  Traditional compression uses a process called 'fixed input' / 'variable output'.  If we refer to the diagrams below, we start off with the original file on the left and the compressed file on the right.  The way traditional compression works (and you can actually watch this on your home computer if you winzip a file) is the following: The compression algorithm will 'chunk up' the original file into 'manageable' sizes before it compresses the file.  The tradeoff here, and why this process happens, is like with anything in computer science, performance for optimization.  The first diagram shows the large file being 'chunked up', compressed and stuffed into the smaller file.

 

  

Figure 1

There are two significant issues with this. The first issue is that the compression dictionary is not shared across multiple ‘chunks’ when compression is taking place.  The example in Figure 2 shows that the letter “F” in ‘chunk’ 1 does not get compressed with the letter “F” in ‘chunk’ 4.  This means that the compression ratio is simply not optimized across the file.

This is a preview of Fixed Input vs. Variable Input Compression. Read the full post
PDF    Send article as PDF   
Nov 03, 2011 | 1 comment View Post

Marketing Gone Awry


Okay, so not many times will you see a blog post from me admitting that, perhaps the marketing and messaging aspect of what I set out to do, probably could have been better thought out.

What am I saying?  Well, after the Storwize acquisition into IBM, and IBM so graciously took the “Storwize” name and put it on another product,  we needed to come up with a name for our technology and hence the name “Real-time Compression” was born.

Here is the problem.  The name really doesn’t do the technology justice, in a nutshell, it is a bad name.  Not because “Real-time Compression” isn’t important for all of the reasons we have talked about in the past, but because compression is not really a part of the overall IP of the platform.  As I have blogged about before, Real-time Compression use industry standard LZ compression to compress the data.  There is nothing really innovative behind that.  The value in Real-time Compression is really to allow the compression to happen in “real-time”, and that is the true innovation.  Thirty-five patents go into making the half a century old zip technology, actually useful in an enterprise environment.  The ability to perform the 5 essential storage efficiency technologies in real-time is now table stakes for storage optimization.

The issue is, by calling the technology “Real-time Compression” is it leaves the too much to the interpretation of the user and with the name “compression” users tend to ignore the “real-time” part, the valuable part, and only talk about the act of “compression”.  The reason why this is unfortunate is because the market has already set a perceived value for the technology called “compression” at free.  EMC and NetApp talk about having “compression for free”.  Well, as my grandfather used to tell me, Steve, “You always get what you pay for.”  The reality is you can’t do compression in real time with either of their technologies, they cause a huge impact to storage performance, they do not seamlessly integrate with backup and cause more of a headache for backup then they are worth, thereby you don’t get the level of storage efficiency out of their “free compression” technology.

This is a preview of Marketing Gone Awry. Read the full post
Fax Online    Send article as PDF   
Oct 06, 2011 | 0 comments View Post

The Storage Alchemist in Lubianijana, Slovenia and Umag, Croatia


Okay, so I rounded out my trip after leaving Prague to Slovenia and Croatia.  In both locations there was an IBM Storage Forum conference.  In Slovenia, IBM has just moved into a new building this year called Crystal Palace.  It was very beautiful.  The highlights of the Form were Cloud, Big Data and Real-time Compression.  At the IBM Slovenia Form I discussed Real-time Compression.  There were approximately 80 customers and partners at the conference.  They were very enthusiastic about learning about Real-time Compression.  They had all heard about the technology but they wanted to know more.  We talked about how the Real-time Compression technologies core functionality comes from it real-time platform.  The real-time platform is how compression is done in real-time vs. the competition that cannot perform compression in real-time.  The customers and partners saw this as a distinct competitive advantage.One of the most interesting events that I was able to witness this week was kind of reality show for a job.  IBM Slovenia, Ministry of Labour, family and social affairs and Slovenian employment institute got together to host a contest. The contest was to take 15 Slovenian unemployed workers, and give them a challenge.  IBM has just moved into the new premises - Crystal Palace and in June they opened IBM Innovation Center Ljubljana. Candidates competed for are open position of Assistant (to marketing) in IBM Innovation Center (IIC) Ljubljana.The contest was to identify ways to promote and market IIC Ljubljana in the region of southeast Europe.  The contestants came to the IBM office and heard about IBM’s values and to tour the new facility as well as meet some of the employees. The contestants were then given 48 hours to come up with a power point presentation that shows off IBM’s values, the Innovation center inside the new complex and IBM’s commitment to growth in the region.  It was a great contest and they got a number of great presentations.  The winner was Mateja Gorše. I thought this was a great concept and we welcome the new employee to IBM with open arms.

This is a preview of The Storage Alchemist in Lubianijana, Slovenia and Umag, Croatia. Read the full post
Sep 21, 2011 | 0 comments View Post

The Storage Alchemist in Sterdyn (Poland)


After landing in Warsaw, I got into a car with the local sales leader for Poland and we drove to the event location.  It was a 2 hour drive.  First, the roads and the land in Poland reminded me very much of my home time in Maine.  Very scenic and rural but beautiful and peaceful.  We talked storage for 2 hours and I am always festinated at the thirst for knowledge there is when I travel.  It was a great ride followed up by a customer reception and some local Polish brew.

Thursday I spent the day in Sterdyn, Poland for IBM Storage University.  There were 30 customers at the event and it went very very well.  The event was at Palac Ossolinski, today used as an event center but has a very rich history, in fact at one point it was used as a medical facility in WWII.  The photo is of the building where we had the event.  The topics we covered were:

  • Storage Efficiency
  • EasyTier
  • ProtecTIER
  • XIV
  • Real-time Compression
  • V7000

The customers were very interactive and provided a lot of insight to their environments.  Interestingly enough I learned during our customer reception that IBM storage is #1 in Poland with HP second and EMC third.  This is a true testament to the IBM sellers and the customers who use the IBM products every day to drive their business.  I also learned that the data break down in Poland is 90% block, 10% file which I found interesting and would be interested to check back 12 months from today to see how it will be different.

I did learn something very interesting in Poland.  The question was asked “Why XIV”?  What is so special about XIV.  The answer was awesome.  The answer started with 2 questions:

1)      How old is RAID?

2)      How old is your iPhone?

This is a preview of The Storage Alchemist in Sterdyn (Poland). Read the full post
PDF Creator    Send article as PDF   
Sep 09, 2011 | 0 comments View Post

The Storage Alchemist in Moscow


 

The first city on my Eastern European trip was Moscow.  I think the traffic here is worse than the 101 in Silicon Valley during the dot com era.  That said, it was a great visit.  I spoke at the Information Infrastructure Conference at the Swissotel convention center in Moscow.  It was the first time I spoke to a group of people with an interpreter.  It was like being at the UN.  The two main topics were Storage Efficiency and Real-time Compression.

I spoke with a few customers and the press and in dealing with the data growth challenges they wanted to know, “When it comes to big data, what is next, is it ‘huge data’”?  Data growth clearly a concern.  Interesting enough though most of the questions, came around my title of “Evangelist”.  One report told me, “if an Evangelist is ‘preaching the word of storage’ then why not just call yourself an Apostle”?  How do you think that would look on an IBM business card: Global Storage Efficiency Apostle?

The next day I did a day of “sales enablement” in the Moscow office.  We discussed mostly how to sell and position Real-time Compression and what is next for the technology.  I was very impressed with the team.  They were very technical and knew quite a bit about Real-time Compression and really wanted to know in more detail how the technology was invented.  This means they are really talking about the technology and the customers are drilling down into the next level of detail.  There are a lot of good opportunities for the technology in Moscow and I look forward to hearing more about the success of Real-time Compression there.

I didn’t have a lot of time to sight see but I did make it to Red Square.  You can actually buy a beer outside in Red Square and walk around.  So I did.  I took a few photos and then as the US was getting going, I had some work calls to attend to.  That evening I spent on the 34th floor of my hotel having dinner.  It was a great view of Moscow.  I hope to come back.

This is a preview of The Storage Alchemist in Moscow. Read the full post
Free PDF    Send article as PDF   
Sep 08, 2011 | 0 comments View Post

5 Most Interesting Things at VMworld 2011


Two solid days at VMworld 2011 and I got to do and see a lot.  Here is a breakdown of the top 5 things I saw at VMworld.

#1 The SiliconAngle / Wikibon Cube

You couldn’t miss it.  You walk into the show floor and there they were, larger than life.  The SiliconAngle / Wikibon Cube broadcasting live from VMworld2011.  Guests that were on the cube included, Tom Georgens (NTAP), Pat Gelsinger (EMC), David Scott (HP), Rick Jackson (VMware) as well as many more.  The Cube also had 12 Industry Spotlights.  The most interesting spotlight had to do with Storage Optimization, especially for VMware.

Oh the times they are a changing.  Now that you can deliver HD TV live over the internet, the Cube has broadcast from a number industry shows and user conferences.  The great part about this, it is like the ability to watch a sporting event being covered by ESPN but for tech.  The Cube brings all of the highlights of these events right into your computer screen.  Now if you can’t make an event, no problem, you can catch all the most important messages from the Cube.  The Cube is now the new mechanism for delivering content to users in the way they want to receive the content, TV.  For more, check out www.siliconangle.tv

#2 Storage Optimization – Industry Spotlight

In the Storage Optimization industry spotlight, the first 15 minutes Dave Vellante and his co-host John Furrier tee up the concept.  They discussed storage optimization, where it has come and were it is going, especially in VMware environments.  We are hearing more and more about storage efficiency technologies.  During the next 15 minutes Dave and I discussed the 5 essential storage efficiency technologies including:

  • Tiering
  • Thin Provisioning
  • Virtualization
  • Compression
  • Deduplication

We also discussed the fact that the IBM Real-time Compression technology is not only the most efficient and effective compression technology in the industry; we also learned that IBM really acquired not just a real-time “compression” technology but a platform that can do a number of things in real time.  In fact, the 5 IBM storage efficiency technologies all operate in real time which is the most effective for customers.

This is a preview of 5 Most Interesting Things at VMworld 2011. Read the full post
PDF Printer    Send article as PDF   
Sep 06, 2011 | 0 comments View Post

Storage Efficiency Spotlight at VMworld


VMworld Live 2011
Via: Wikibon

Permanent link to this post (4 words, 1 image, estimated 1 secs reading time)
Create PDF    Send article as PDF   
Aug 29, 2011 | 0 comments View Post

Virtual Disk Storage


History truly does repeat itself.  We are talking about the history of data storage.  Every once and a while a new technology comes along that requires a new way to think about infrastructure.  Notice I said “infrastructure”.  I’d like to paint two analogies:

Analogy 1: RAID – Prior to RAID users stored their data on disk and if they could afford it, they backed that data up to have a protected copy of their data.  When RAID came out, users were able to store their data on multiple disks appearing as one device.  The benefits to this were, increased data reliability, better performance.  This new technology however, fundamentally changed how disk was sold, but the questions were the same:

  1. How much capacity do you need?
  2. What type of performance does your application require?

The sales reps point of view changed.  There were a number of new considerations that needed to be taken into account.  First, the age old question, “Will I sell less storage “stuff?”  Remember the person, at the time, selling the disk was probably also selling the backup tape and software to protect that information.  If the disks are more reliable, maybe the customer won’t need as much tape?  Second, when the capacity question came up, the seller also needed to know what type of RAID the customer wanted to ensure they sold them enough drives.  It was no longer as simple as asking the capacity requirements and dividing it by the drive capacity at the time.  Now depending upon RAID levels there was a new set of math that needed to be done.  Third was the notion of performance and more spindles meant more performance so now that the capacity equation was solved for, you also needed to know the I/O requirements in order to make sure the right number of drives were sold to solve for the capacity as well as the performance.

This is a preview of Virtual Disk Storage. Read the full post
PDF Download    Send article as PDF   
Jul 06, 2011 | 3 comments View Post