<?xml version="1.0" encoding="UTF-8" standalone="no"?> <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd"> <html xmlns="http://www.w3.org/1999/xhtml"> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> <title>Chapter 1. Introduction</title> <link rel="stylesheet" href="gettingStarted.css" type="text/css" /> <meta name="generator" content="DocBook XSL Stylesheets V1.62.4" /> <link rel="home" href="index.html" title="Getting Started with Replicated Berkeley DB Applications" /> <link rel="up" href="index.html" title="Getting Started with Replicated Berkeley DB Applications" /> <link rel="previous" href="preface.html" title="Preface" /> <link rel="next" href="repadvantage.html" title="Replication Benefits" /> </head> <body> <div class="navheader"> <table width="100%" summary="Navigation header"> <tr> <th colspan="3" align="center">Chapter 1. Introduction</th> </tr> <tr> <td width="20%" align="left"><a accesskey="p" href="preface.html">Prev</a> </td> <th width="60%" align="center"> </th> <td width="20%" align="right"> <a accesskey="n" href="repadvantage.html">Next</a></td> </tr> </table> <hr /> </div> <div class="chapter" lang="en" xml:lang="en"> <div class="titlepage"> <div> <div> <h2 class="title"><a id="introduction"></a>Chapter 1. Introduction</h2> </div> </div> <div></div> </div> <div class="toc"> <p> <b>Table of Contents</b> </p> <dl> <dt> <span class="sect1"> <a href="introduction.html#overview">Overview</a> </span> </dt> <dd> <dl> <dt> <span class="sect2"> <a href="introduction.html#repenvirons">Replication Environments</a> </span> </dt> <dt> <span class="sect2"> <a href="introduction.html#repdbs">Replication Databases</a> </span> </dt> <dt> <span class="sect2"> <a href="introduction.html#commlayer">Communications Layer</a> </span> </dt> <dt> <span class="sect2"> <a href="introduction.html#masterselect">Selecting a Master</a> </span> </dt> </dl> </dd> <dt> <span class="sect1"> <a href="repadvantage.html">Replication Benefits</a> </span> </dt> <dt> <span class="sect1"> <a href="apioverview.html">The Replication APIs</a> </span> </dt> <dd> <dl> <dt> <span class="sect2"> <a href="apioverview.html#repframeworkoverview">Replication Framework Overview</a> </span> </dt> <dt> <span class="sect2"> <a href="apioverview.html#repapioverview">Replication API Overview</a> </span> </dt> </dl> </dd> <dt> <span class="sect1"> <a href="elections.html">Holding Elections</a> </span> </dt> <dd> <dl> <dt> <span class="sect2"> <a href="elections.html#influencingelections">Influencing Elections</a> </span> </dt> <dt> <span class="sect2"> <a href="elections.html#winningelections">Winning Elections</a> </span> </dt> <dt> <span class="sect2"> <a href="elections.html#switchingmasters">Switching Masters</a> </span> </dt> </dl> </dd> <dt> <span class="sect1"> <a href="permmessages.html">Permanent Message Handling</a> </span> </dt> <dd> <dl> <dt> <span class="sect2"> <a href="permmessages.html#permmessagenot">When Not to Manage Permanent Messages</a> </span> </dt> <dt> <span class="sect2"> <a href="permmessages.html#permmanage">Managing Permanent Messages</a> </span> </dt> <dt> <span class="sect2"> <a href="permmessages.html#permimplement">Implementing Permanent Message Handling</a> </span> </dt> </dl> </dd> </dl> </div> <p> This book provides a thorough introduction and discussion on replication as used with Berkeley DB (DB). It begins by offering a general overview to replication and the benefits it provides. It also describes the APIs that you use to implement replication, and it describes architecturally the things that you need to do to your application code in order to use the replication APIs. Finally, it discusses the differences in backup and restore strategies that you might pursue when using replication, especially where it comes to log file removal. </p> <p> You should understand the concepts from the <span> <i class="citetitle">Berkeley DB Getting Started with Transaction Processing</i> </span> guide before reading this book. </p> <div class="sect1" lang="en" xml:lang="en"> <div class="titlepage"> <div> <div> <h2 class="title" style="clear: both"><a id="overview"></a>Overview</h2> </div> </div> <div></div> </div> <p> The DB replication APIs allow you to distribute your database write operations (performed on a read-write master) to one or more read-only <span class="emphasis"><em>replicas</em></span>. For this reason, DB's replication implementation is said to be a <span class="emphasis"><em>single master, multiple replica</em></span> replication strategy. </p> <p> Note that your database write operations can occur only on the master; any attempt to write to a replica results in an error being <span>raised by</span> the DB API used to perform the write. </p> <p> A single replication master and all of its replicas are referred to as a <span class="emphasis"><em>replication group</em></span>. While all members of the replication group can reside on the same machine, usually each replication participant is placed on a separate physical machine somewhere on the network. </p> <p> Note that all replication applications must first be transactional applications. The data that the master transmits its replicas are log records that are generated as records are updated. Upon transactional commit, the master transmits a transaction record which tells the replicas to commit the records they previously received from the master. In order for all of this to work, your replicated application must also be a transactional application. For this reason, it is recommended that you write and debug your DB application as a stand-alone transactional application before introducing the replication layer to your code. </p> <p> Finally, be aware that all machines participating in the replication group must share identical <span class="emphasis"><em>endianess</em></span>. Endianess is the byte-order strategy used by the computing platform to store multibyte numbers. Berkeley DB is sensitive to byte order and so your replication infrastructure must be consistent in this area. We expect to remove this requirement in some future release of the product. </p> <div class="sect2" lang="en" xml:lang="en"> <div class="titlepage"> <div> <div> <h3 class="title"><a id="repenvirons"></a>Replication Environments</h3> </div> </div> <div></div> </div> <p> The most important requirement for a replication participant is that it must use a unique Berkeley DB database environment independent of all other replication participants. So while multiple replication participants can reside on the same physical machine, no two such participants can share the same environment home directory. </p> <p> For this reason, technically replication occurs between unique <span class="emphasis"><em>database environments</em></span>. So in the strictest sense, a replication group consists of a <span class="emphasis"><em>master environment</em></span> and one or more <span class="emphasis"><em>replica environments</em></span>. However, the reality is that for production code, each such environment will usually be located on its own unique machine. Consequently, this manual sometimes talks about <span class="emphasis"><em>replication sites</em></span>, meaning the unique combination of environment home directory, host and port that a specific replication application is using. </p> <p> There is no DB-specified limit to the number of environments which can participate in a replication group. The only limitation here is one of resources — network bandwidth, for example. </p> <p> (Note, however, that the replication framework does place a limit on the number of environments you can use. See <a href="apioverview.html#repframeworkoverview">Replication Framework Overview</a> for details.) </p> <p> Also, DB's replication implementation requires all participating environments to be assigned IDs that are locally unique to the given environment. Depending on the replication APIs that you choose to use, you may or may not need to manage this particular detail. </p> <p> For detailed information on database environments, see the <i class="citetitle">Berkeley DB Getting Started with Transaction Processing</i> guide. For more information on environment IDs, see the <i class="citetitle">Berkeley DB Programmer's Reference Guide</i>. </p> </div> <div class="sect2" lang="en" xml:lang="en"> <div class="titlepage"> <div> <div> <h3 class="title"><a id="repdbs"></a>Replication Databases</h3> </div> </div> <div></div> </div> <p> DB's databases are managed and used in exactly the same way as if you were writing a non-replicated application, with a couple of caveats. First, the databases maintained in a replicated environment must reside either in the <tt class="literal">ENV_HOME</tt> directory, or in the directory identified by the <tt class="methodname">EnvironmentConfig.addDataDir()</tt> method. Unlike non-replication applications, you cannot place your databases in a subdirectory below these locations. You should also not use full path names for your databases or environments as these are likely to break as to replicated to other machines. </p> </div> <div class="sect2" lang="en" xml:lang="en"> <div class="titlepage"> <div> <div> <h3 class="title"><a id="commlayer"></a>Communications Layer</h3> </div> </div> <div></div> </div> <p> In order to transmit database writes to the replication replicas, DB requires a communications layer. DB is agnostic as to what this layer should look like. The only requirement is that it be capable of passing two opaque data objects and an environment ID from the master to its replicas without corruption. </p> <p> Because replicas are usually placed on different machines on the network, the communications layer is usually some kind of a network-aware implementation. Beyond that, its implementation details are largely up to you. It could use TCP/IP sockets, for example, or it could use raw sockets if they perform better for your particular application. </p> <p> Note that you may not have to write your own communications layer. DB provides a replication framework that includes a fully-functional TCP/IP-based communications layer. See <a href="apioverview.html">The Replication APIs</a> for more information. </p> <p> See the <i class="citetitle">Berkeley DB Programmer's Reference Guide</i> for a description of how to write your own custom replication communications layer. </p> </div> <div class="sect2" lang="en" xml:lang="en"> <div class="titlepage"> <div> <div> <h3 class="title"><a id="masterselect"></a>Selecting a Master</h3> </div> </div> <div></div> </div> <p> Every replication group is allowed one and only one master environment. Almost always, masters are selected by holding an <span class="emphasis"><em>election</em></span>. All such elections are performed by the underlying Berkeley DB replication code so you have to do very little to implement them. </p> <p> When holding an election, replicas "vote" on who should be the master. Among replicas participating in the election, the one with the most up-to-date set of log records will win the election. Note that it's possible for there to be a tie. When this occurs, priorities are used to select the master. See <a href="elections.html">Holding Elections</a> for details. </p> <p> For more information on holding and managing elections, see <a href="elections.html">Holding Elections</a>. </p> </div> </div> </div> <div class="navfooter"> <hr /> <table width="100%" summary="Navigation footer"> <tr> <td width="40%" align="left"><a accesskey="p" href="preface.html">Prev</a> </td> <td width="20%" align="center"> <a accesskey="u" href="index.html">Up</a> </td> <td width="40%" align="right"> <a accesskey="n" href="repadvantage.html">Next</a></td> </tr> <tr> <td width="40%" align="left" valign="top">Preface </td> <td width="20%" align="center"> <a accesskey="h" href="index.html">Home</a> </td> <td width="40%" align="right" valign="top"> Replication Benefits</td> </tr> </table> </div> </body> </html>