组合数学 (Fall 2011)/Counting and existence
Contents
Cayley's Formula
We now present a theorem of the number of labeled trees on a fixed number of vertices. It is due to Cayley in 1889. The theorem is often referred by the name Cayley's formula.
Cayley's formula for trees - There are different trees on distinct vertices.
The theorem has several proofs. Classical methods include the bijection which encodes a tree by a Prüfer code, through the Kirchhoff's matrix tree theorem, and by double counting.
Prüfer code
The Prüfer code encodes a labeled tree to a sequence of labels. This gives a bijections between trees and tuples.
In a tree, the vertices of degree 1 are called leaves. It is easy to see that:
- each tree has at least two leaves; and
- after removing a leaf (along with the edge adjacent to it) from a tree, the resulting graph is still a tree.
The following algorithm transforms a tree of vertices , to a tuple .
Prüfer code (encoder) - Input: A tree of distinct vertices, labeled by .
- let ;
- for to , do
- let be the leaf in with the smallest label, and be its neighbor;
- let be the new tree obtained from deleting the leaf from ;
- end
- return ;
It is trivial to observe the following lemma:
Lemma 1 - For each , is a tree of vertices. In particular, the vertices of are , and the edges of are precisely , .
And there is a reason that we do not need to store in the Prüfer code.
Lemma 2 - It always holds that .
Proof. Every tree (of at least two vertices) has at least two leaves. The , , are the leaf of the smallest label in , which can never be , thus is never deleted.
Lemma 1 and 2 together imply that given a Prüfer code , the only remaining task to reconstruct the tree is to figure out those , . The following lemma state how to obtain , , from a Prüfer code .
Lemma 3 - For , is the smallest element of not in .
Proof. Note that is a sequence of distinct vertices, because are deleted one by one from the tree, and is never deleted. Thus, each vertex appears among exactly once. And each vertex appears for times among the edges , , where denotes the degree of vertex in the original tree . Therefore, each vertex appears among for times.
Similarly, each vertex of appears among for times, where is the degree of vertex in the tree . In particular, the leaves of are not among . Recall that the vertices of are . Then the leaves of are the elements of not in . By definition of Prüfer code, is the leaf in of smallest label, hence the smallest element of not in .
Applying Lemma 3, we have the following decoder for the Prüfer code:
Prüfer code (decoder) - Input: A tuple .
- let be empty graph, and ;
- for to , do
- let be the smallest label not in ;
- add an edge to ;
- end
- return ;
In other words, the encoding of trees to tuples by the Prüfer code is reversible, thus the mapping is injective (1-1). To see it is also surjective, we need to show that for every possible , the above decoder recovers a tree from it.
It is easy to see that the decoder always returns a graph of edges on the vertices. The only thing remaining to verify is that the returned graph has no cycle in it, which can be easily proved by a timeline argument (left as an exercise).
Therefore, the Prüfer code establishes a bijection between the set of trees on distinct vertices and the tuples from . This proves Cayley's formula.
Double counting
We now present a proof of the Cayley's formula by double counting, which is considered by the Proofs from THE BOOK "the most beautiful of them all".
Proof of Cayley's formula by double counting (Due to Pitman 1999)
Let be the number of different trees defined on distinct vertices.
A rooted tree is a tree with a special vertex. That is, one of the vertices is marked as the "root" of the tree. A rooted tree defines a natural direction of all edges, such that an edge of the tree is directed from to if is before along the unique path from the root.
We count the number of different sequences of directed edges that can be added to an empty graph on vertices to form from it a rooted tree. We note that such a sequence can be formed in two ways:
- Starting with an unrooted tree, choose one of its vertices as root, and fix an total order of edges to specify the order in which the edges are added.
- Starting from an empty graph, add the edges one by one in steps.
In the first method, we pick one of the unrooted trees, choose one of the vertices as the root, and pick one of the total orders of the edges. This gives us ways.
In the second method, we consider the number of choices in one step, and multiply the numbers of choices in all steps. This is done as follows.
Given a sequence of adding edges to an empty graph to form a rooted tree, we reverse this sequence and get a sequence of removing edges one by one from the final rooted tree until no edge left. We observe that:
- At first, we remove an edge from the rooted tree. Suppose that the root of the tree is , and the removed directed edge is . After removing , the original rooted tree is disconnected into two rooted trees, one rooted at and the other rooted at .
- After removing edges, there are rooted trees. In the th step, a directed edge in the current forest is removed and the tree containing is disconnected into two trees, one rooted at the old root of that tree, and the other rooted at .
We now again reverse the above procedure, and consider the sequence of adding directed edges to an empty graph to form a rooted tree.
- At first, we have rooted trees, each of 0 edge ( isolated vertices).
- After adding edges, there are rooted trees. Denoting the directed edge added next as . As observed above, can be any one of the vertices; but must be the root of one of the trees, except the tree which contains . There are choices of such .
Multiplying the numbers of choices in all steps, the number of sequences of adding directed edges to an empty graph to form a rooted tree is given by
- .
By the principle of double counting, counting the same thing by different methods yield the same result.
- ,
which gives that .
Existence by Counting
Shannon's circuit lower bound
This is a fundamental problem in in Computer Science.
A boolean function is a function in the form .
Boolean circuit is a mathematical model of computation. Formally, a boolean circuit is a directed acyclic graph. Nodes with indegree zero are input nodes, labeled . A circuit has a unique node with outdegree zero, called the output node. Every other node is a gate. There are three types of gates: AND, OR (both with indegree two), and NOT (with indegree one).
Computations in Turing machines can be simulated by circuits, and any boolean function in P can be computed by a circuit with polynomially many gates. Thus, if we can find a function in NP that cannot be computed by any circuit with polynomially many gates, then NPP.
The following theorem due to Shannon says that functions with exponentially large circuit complexity do exist.
Theorem (Shannon 1949) - There is a boolean function with circuit complexity greater than .
Proof. We first count the number of boolean functions . There are boolean functions .
Then we count the number of boolean circuit with fixed number of gates. Fix an integer , we count the number of circuits with gates. By the De Morgan's laws, we can assume that all NOTs are pushed back to the inputs. Each gate has one of the two types (AND or OR), and has two inputs. Each of the inputs to a gate is either a constant 0 or 1, an input variable , an inverted input variable , or the output of another gate; thus, there are at most possible gate inputs. It follows that the number of circuits with gates is at most .
If , then
- thus,
Each boolean circuit computes one boolean function. Therefore, there must exist a boolean function which cannot be computed by any circuits with gates.
Note that by Shannon's theorem, not only there exists a boolean function with exponentially large circuit complexity, but almost all boolean functions have exponentially large circuit complexity.
Double counting
The double counting principle states the following obvious fact: if the elements of a set are counted in two different ways, the answers are the same.
Handshaking lemma
The following lemma is a standard demonstration of double counting.
Handshaking Lemma - At a party, the number of guests who shake hands an odd number of times is even.
We model this scenario as an undirected graph with standing for the guests. There is an edge if and shake hands. Let be the degree of vertex , which represents the number of times that shakes hand. The handshaking lemma states that in any undirected graph, the number of vertices whose degrees are odd is even. It is sufficient to show that the sum of odd degrees is even.
The handshaking lemma is a direct consequence of the following lemma, which is proved by Euler in his 1736 paper on Seven Bridges of Königsberg that began the study of graph theory.
Lemma (Euler 1736)
Proof. We count the number of directed edges. A directed edge is an ordered pair such that . There are two ways to count the directed edges.
First, we can enumerate by edges. Pick every edge and apply two directions and to the edge. This gives us directed edges.
On the other hand, we can enumerate by vertices. Pick every vertex and for each of its neighbors, say , generate a directed edge . This gives us directed edges.
It is obvious that the two terms are equal, since we just count the same thing twice with different methods. The lemma follows.
The handshaking lemma is implied directly by the above lemma, since the sum of even degrees is even.
Sperner's lemma
The Pigeonhole Principle
The pigeonhole principle states the following "obvious" fact:
- pigeons cannot sit in holes so that every pigeon is alone in its hole.
This is one of the oldest non-constructive principles: it states only the existence of a pigeonhole with more than one pigeons and says nothing about how to find such a pigeonhole.
The general form of pigeonhole principle, also known as the averaging principle, is stated as follows.
Generalized pigeonhole principle - If a set consisting of more than objects is partitioned into classes, then some class receives more than objects.
Inevitable divisors
The following is one of Erdős' favorite initiation questions to mathematics. The proof uses the Pigeonhole Principle.
Theorem - For any subset of size , there are two numbers such that .
Proof. For every odd number , let
- .
It is easy to see that for any from the same , it holds that .
Every number can be uniquely represented as for some odd number , thus belongs to exactly one of , for odd . There are odd numbers in , thus different , but , thus there must exist distinct , supposed that , belonging to the same , which implies that .
Monotonic subsequences
Let be a sequence of distinct real numbers. A subsequence is a sequence of distinct terms of appearing in the same order in which they appear in . Formally, a subsequence of is an , with .
A sequence is increasing if , and decreasing if .
We are interested in the longest increasing and decreasing subsequences of an . It is intuitive that the length of both the longest increasing subsequence and the longest decreasing subsequence cannot be small simultaneously. A famous result of Erdős and Szekeres formally justifies this intuition. This is one of the first results in extremal combinatorics, published in the influential 1935 paper of Erdős and Szekeres.
Theorem (Erdős-Szekeres 1935) - A sequence of more than different real numbers must contain either an increasing subsequence of length , or a decreasing subsequence of length .
Proof. (due to Seidenberg 1959) Let be the original sequence of distinct real numbers. Associate each a pair , defined as:
- : the length of the longest increasing subsequence ending at ;
- : the length of the longest decreasing subsequence starting at .
A key observation is that whenever . This is proved as follows:
- Case 1: If , then the longest increasing subsequence ending at can be extended by adding on , so .
- Case 2: If , then the longest decreasing subsequence starting at can be preceded by , so .
Now we put "pigeons" into "pigeonholes" , such that is put into hole , with at most one pigeon per each hole (since different has different ).
The number of pigeons is . Due to pigeonhole principle, there must be a pigeon which is outside the region , which implies that there exists an with either or . Due to our definition of , there must be either an increasing subsequence of length , or a decreasing subsequence of length .
Dirichlet's approximation
Let be an irrational number. We now want to approximate be a rational number (a fraction).
Since every real interval with contains infinitely many rational numbers, there must exist rational numbers arbitrarily close to . The trick is to let the denominator of the fraction sufficiently large.
Suppose however we restrict the rationals we may select to have denominators bounded by . How closely we can approximate now?
The following important theorem is due to Dirichlet and his Schubfachprinzip ("drawer principle"). The theorem is fundamental in numer theory and real analysis, but the proof is combinatorial.
Theorem (Dirichlet 1879) - Let be an irrational number. For any natural number , there is a rational number such that and
- .
- Let be an irrational number. For any natural number , there is a rational number such that and
Proof. Let denote the fractional part of the real number . It is obvious that for any real number .
Consider the numbers , . These numbers (pigeons) belong to the following intervals (pigeonholes):
- .
Since is irrational, cannot coincide with any endpoint of the above intervals.
By the pigeonhole principle, there exist , such that are in the same interval, thus
- .
Therefore,
- .
Let and . We have and . Dividing both sides by , the theorem is proved.
References
- (声明: 资料受版权保护, 仅用于教学.)
- (Disclaimer: The following copyrighted materials are meant for educational uses only.)
- Aigner and Ziegler. Proofs from THE BOOK, 4th Edition. Springer-Verlag. Chapter 25 and Chapter 30.