IBM rig doesn’t look like much, scans 10 billion files in 43 minutes

Someone ought to gift these IBM researchers a better camera, because their latest General Parallel File System is a back-slapping 37 times faster than their last effort back in 2007. The rig combines ten IBM System xSeries servers with Violin Memory SSDs that hold 6.5 terabytes of metadata relating to 10 billion separate files. Every single one of those files can be analyzed and managed using policy-guided rules in under three quarters of an hour. That kind of performance might seem like overkill, but it’s only just barely in step with what IBM’s Doug Balog describes as a “rapidly growing, multi-zettabyte world.” No prizes for guessing who their top customer is likely to be. Full details in the PR after the break. Continue reading IBM rig doesn’t look like much, scans 10 billion files in 43 minutes IBM rig doesn’t look like much, scans 10 billion files in 43 minutes originally appeared on Engadget on Fri, 22 Jul 2011 03:35:00 EDT. Please see our terms for use of feeds . Permalink

Posted by on July 22, 2011. Filed under News, Tech. You can follow any responses to this entry through the RSS 2.0. You can skip to the end and leave a response. Pinging is currently not allowed.