Source

riak / www / scale.html

<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
	<meta name="author" content="Basho Technologies" />
	<meta name="description" content="riak - a decentralized key value store - basho technologies" />
	<meta name="keywords" content="riak nosql decentralized distributed key value store" />
    <meta http-equiv="content-type" content="text/html;charset=utf-8" />
	<link rel="stylesheet" href="css/style.css" type="text/css" />
	<title>Riak - A database at Web scale</title>
</head>
<body>
	<div id="content">
		<h1><span class="hr"></span><a href="/">riak</a></h1>
		<ul id="top">
			<li><a href="/">Home</a></li>
			<li><a href="http://bitbucket.org/justin/riak/">Source Code</a></li>
                        <li><a href="edoc/index.html">API Docs</a></li>
			<li><a href="faq.html">FAQ</a></li>
			<li><a href="contact.html">Contact</a></li>
		</ul>
		
		<div id="intro">
			<p>Developed with solid distributed systems fundamentals from the start, Riak scales out to meet your needs.  It also scales down easily, making development and prototyping easy.</p>

		</div>
		<div id="left">
			
			<h3>Whatever size you need it to be</h3>

			<p>"Scalability" is an often-misused word on the Web.  Scaling is not the same as being fast, and it is not the same as being large.  To say meaningfully that something scales, you must do so in terms of some numerically measurable feature (throughput, latency, volume, anything you can describe with a single number) and some other numerically measurable resource that presumably costs you money (such as the number of computers being used).  To say that something scales is to say that there is a relationship between that resource and that feature which remains constant regardless of how much you increase the numbers.  This is practically useful because it gives you predictable cost ceilings when your needs grow.  If there is no such useful resource/benefit relation, your system does not scale.  (If turning the dial way up on your scaling factor causes some other aspect of your system to perform much worse, your system's scalability is questionable at best.)</p>

			<p>One important way in which Riak scales is in the relationship between total storage capacity and the number of disk-containing servers in the cluster.  If your cluster has a given total capacity of some number "C", and is comprised of "N" servers (which roughly equivalent amounts of disk in each) then you can double your capacity by doubling your number of servers -- no matter what the original values of C and N.</p>

			<p>This is a huge deal, as it means that you don't have to keep packing more and more resources into a single master database, incurring greater and greater marginal expense the farther you go.  Instead, when you need more capacity you just plug in another ordinary server and walk away.</p>

			<p>Most storage systems (including both traditional RDBMS and some more recent document databases) do not scale in any meaningful way.  While you can often add replicas to such systems for redundancy or load-balancing, such systems still require all of the data to fit on a single master.  As soon as you run out of room to add disks to that master, you establish a maximum practical capacity.</p>

			<p>Some systems achieve scaling through <a href="http://en.wikipedia.org/wiki/Shard_%28database_architecture%29">sharding</a>, or dividing the data up into segments, each of which is owned by a separate master.  This achieves some scaling, but typically at the cost of multiplying the points of failure that can bring everything crashing down.  Between namenodes responsible for knowing which shard is which and the fact that each of these shards must now be treated with all of the care of the previous master, operational concerns can climb rapidly as such systems grow.  The <a href="ops.html">operational design</a> of Riak does not have any of these drawbacks.  Riak's scaling is done not by making more "master" locations, but by having no master at all.</p>

			<p>Another essential and often ignored aspect of scaling is "scaling down".  Systems that are designed to work in the large are often very inconvenient to set up, manage, and use in a very small environment such as a developer's laptop.  If a system cannot run in a scaled-down and simple setup, it will be much harder for <a href="dev.html">developers</a> to explore the system and work with it to its fullest potential.  Riak works well even when running on just a single node; developers can easily work against a local instance and have the same code work when deployed on a large cluster elsewhere.</p>


			
		</div>
		<div id="right">
<img src="images/more.gif" alt="partitioning the ring" />
		

			
		</div>
		<div id="footer">

		</div>
	</div>
<script type="text/javascript">
var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www.");
document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E"));
</script>
<script type="text/javascript">
try {
var pageTracker = _gat._getTracker("UA-10051263-1");
pageTracker._trackPageview();
} catch(err) {}</script>
</body>
</html>
Tip: Filter by directory path e.g. /media app.js to search for public/media/app.js.
Tip: Use camelCasing e.g. ProjME to search for ProjectModifiedEvent.java.
Tip: Filter by extension type e.g. /repo .js to search for all .js files in the /repo directory.
Tip: Separate your search with spaces e.g. /ssh pom.xml to search for src/ssh/pom.xml.
Tip: Use ↑ and ↓ arrow keys to navigate and return to view the file.
Tip: You can also navigate files with Ctrl+j (next) and Ctrl+k (previous) and view the file with Ctrl+o.
Tip: You can also navigate files with Alt+j (next) and Alt+k (previous) and view the file with Alt+o.