Segment tree
The segment tree is a highly versatile data structure, based upon the divide-and-conquer paradigm, which can be thought of as a tree of intervals of an underlying array, constructed so that queries on ranges of the array as well as modifications to the array's elements may be efficiently performed.
Contents
Motivation
One of the most common applications of the segment tree is the solution to the range minimum query problem. In this problem, we are given some array and repeatedly asked to find the minimum value within some specified range of indices. For example, if we are given the array , we might be asked for the minimum element between the third and the sixth, inclusive, which would be . Then, another query might ask for the minimum element between the first and third, inclusive, and we would answer 2, and so on. Various solutions to this problem are discussed in the range minimum query article, but the segment tree is often the most appropriate choice, especially when modification instructions are interspersed with the queries. For the sake of brevity, we shall focus for several following sections on the type of segment tree designed to answer the range minimum query without explicitly re-stating each time that we are doing so. Bear in mind, however, that other types of segment tree exist, which are discussed later in the article.
The divide-and-conquer solution
The divide-and-conquer solution would be as follows:
- If the range contains one element, that element itself is trivially the minimum within that range.
- Otherwise, divide the range into two smaller ranges, each approximately half the size of the original, and find their respective minima. The minimum for the original range is then the smaller of the two minima of the sub-ranges.
Hence, if denotes the th element in the array, finding the minimum could be encoded as the following recursive function:
assuming that .
Hence, for example, the first query from the previous section would be and it would be recursively evaluated as .
Structure
Suppose that we use the function defined above to evaluate , where is the number of elements in the array. When is large, this recursive call has two "children", one of which is the recursive call , and the other one of which is . Each of these children will then have two children of its own, and so on, down until the base case is reached. If we represent these recursive calls with a tree structure, the call would be the root, it would have two children, each child would have two more children, and so on; the base cases would be the leaves of the tree. We are now ready to specify the structure of the segment tree:
- it is a binary tree which represents some underlying array;
- each node is associated with some interval of the array and contains the value(s) of one or more functions of the elements in that interval;
- the root node is associated with the entire array (i.e. the interval );
- each leaf is associated with an individual element;
- each non-leaf node has two children whose associated intervals are disjoint, and the union of the intervals associated with the two children is the interval associated with the parent;
- each child's interval has approximately half the size of the parent's interval;
- the data stored in each non-leaf node is not only a function of the elements in its associated interval but also a function of the data stored in its children.
That is, the structure of the segment tree is exactly that of the recursive call tree of the function defined above (up to some minor details, such as whether the middle element of an interval of odd size belongs to the left child interval or the right).
Hence, for example, the root node of the array would contain the number 0: the minimum of the entire array. Its left child would contain the minimum of , that is, 2, and the right would contain the minimum of , that is, 0. Evidently, the datum stored in the root node, 0, is the minimum of the data stored at its immediate children, 0 and 2. Similarly, the datum 2 stored in the left child is the minimum of the data stored at its immediate children, 2 and 3 (which are the minima in and , respectively). Each individual element in the array has a leaf node, which merely contains that element itself. (The minimum of a range containing a single element is, of course, the element itself.)
Operations
There are three fundamental operations on a segment tree.
Construction
To construct a segment tree is to initialize it so that it represents some array; we can query and modify this array later but first we need to construct a valid segment tree. We can construct a segment tree either top-down or bottom-up. Top-down construction is recursive; we attempt to fill in the root node, which leads to a recursive call on each of the two children, and so on; the base cases are the leaf nodes, which may be immediately filled in with the corresponding values from the array. After the two recursive calls made on behalf of a non-leaf node return, that node's value is set to the minimum of the values stored at the children. Bottom-up construction is left as an exercise for the reader; the difference in speed is likely to be negligible.
Update
To update a segment tree is to modify the value of one element in the underlying array. To do so, we first modify the corresponding leaf node. The other leaf nodes are not affected, since each leaf node is associated only with an individual element. The modified node's parent is affected, since its associated interval contains the modified element, and so is the grandparent, and so on up to the root, but no other nodes are affected. To execute a top-down update, we begin by requesting an update of the root; this leads to a recursive call of one of the two children --- the one whose associated interval contains the modified element. (The other child and its subtree are unaffected.) The same is done recursively for the child; the base case is the leaf node associated with the element to update. After a recursive call has completed, the value in a non-leaf node is re-evaluated as the minimum of the values at its two children. Updating a segment tree bottom-up is possible too and is again left as an exercise for the reader.
Query
To query a segment tree is to use it to determine a function of a range in the underlying array (in this case, the minimum element of that range). The execution of a query is more complex than the execution of an update and will be illustrated by example. Suppose we wish to know the minimum element between the first and sixth, inclusive. We shall represent this query as . Each node in the segment tree contains the minimum in some interval: for example, the root node contains , its left child , its right , and so on, with each leaf containing for some . There is no node that contains , but we notice that , and that there are nodes in the segment tree containing those two values (shown in yellow). (This expression for is not the one given by the definition of , but it is fairly clear that where , regardless of the actual value of .)
When querying a segment tree, therefore, we select a subset of the nodes with the property that the union of their sets of descendants is exactly the interval whose minimum we seek. To do so, we start at the root and recurse over nodes whose corresponding intervals have at least one element in common with the query interval. Hence, in our example of , we notice that both the left and right subtrees contain descendants that contain elements in the query interval; hence, we recurse on both. The left child of the root serves as a base case, since its interval is contained entirely within the query interval; hence it is chosen (marked in yellow). At the right child of the root, we notice that its left child has descendants in the query interval, but its right does not; hence we recurse on the former and not the latter. The former is now another base case, and it too is chosen and marked in yellow. The recursion has now terminated, and the desired minimum is the minimum of the nodes that have been chosen.
Analysis
Some important performance bounds for segment trees are as follows:
Space
A node whose depth is is associated with an interval of size no greater than . This is easily proven by induction on . We therefore see that all nodes at depth are responsible for no more than one element: they are leaves. Hence, a segment tree is a fully balanced binary tree; it has the minimum possible height for the number of nodes it contains. Because of this, we may store the tree as a breadth-first traversal of its nodes, where the left child is (by convention) explored before the right. The segment tree above for , then, would be stored as . Suppose the root is stored at index 1. Then, if a non-leaf node has index , its left child will be stored at and its right at . Note that there will be some wasted space on the lowest level of the tree; this however is generally acceptable. A binary tree with a depth of may have up to elements, so some mathematical analysis shows that a segment tree on an array of elements requires an array of no more than elements for its own storage in this manner. Asymptotically, a segment tree uses space.
Time
Construction
Construction requires a constant number of operations on each node of the segment tree; as there are nodes, the construction takes linear time. You will notice that this is faster than doing separate update operations.
Update
A constant number of operations is performed for each node on the path from the root to the leaf associated with the modified element. The number of nodes on this path is bounded by the height of the tree; hence, per the conclusions in the Space section above, the time required for an update is .
Query
Consider the set of selected nodes (marked in yellow in the illustration). It is possible, in the case of a query , that there are logarithmically many. Can there be more? The answer is no. The simplest way of proving this, perhaps, is by exhibiting an algorithm for selecting the nodes that terminates within steps; this is the non-recursive algorithm alluded to earlier. So a query takes time. The proof that the recursive version also takes time is left as an exercise for the reader.
Implementation
object rmq_segtree private function build_rec(node,begin,end,a[]) if begin = end A[node] = a[begin]; else let mid = floor((begin+end)/2) build_rec(2*node,begin,mid,a[]) build_rec(2*node+1,mid+1,end,a[]) A[node] = min(A[2*node],A[2*node+1]) private function update_rec(node,begin,end,pos,val) if begin = end A[node] = val else let mid=floor((begin+end)/2) if pos<=mid update_rec(2*node,begin,mid,pos,val) else update_rec(2*node+1,mid+1,end,pos,val) A[node] = min(A[2*node],A[2*node+1]) private function query_rec(node,t_begin,t_end,a_begin,a_end) if t_begin>=a_begin AND t_end<=a_end return A[node] else let mid = floor((t_begin+t_end)/2) let res = ∞ if mid>=a_begin AND t_begin<=a_end res = min(res,query_rec(2*node,t_begin,mid,a_begin,a_end)) if t_end>=a_begin AND mid+1<=a_end res = min(res,query_rec(2*node+1,mid+1,t_end,a_begin,a_end)) return res function construct(size,a[1..size]) let N = size let A be an array that can hold at least 4N elements build_rec(1,1,N,a) function update(pos,val) update_rec(1,1,N,pos,val) function query(begin,end) return query_rec(1,1,N,begin,end)