In many parts of analysis, the word "bounded" is too coarse to capture compactness. A subset of $\mathbb{R}$ with finite diameter can still have infinitely many separated points, while a bounded interval can be approximated at any fixed resolution by finitely many sample points. Totally boundedness isolates this second, stronger finitary feature: at every scale $\varepsilon > 0$, the whole space can be seen from finitely many centers.
The concept belongs naturally to [metric spaces](/page/Metric%20Space), because it uses distances rather than only [open sets](/page/Open%20Set). It is one of the main bridges between boundedness and compactness: in a complete metric space, compactness is exactly completeness plus [total boundedness](/page/Total%20Boundedness). In functional analysis it is also the language behind precompact sets, compact embeddings, and compact operators.
## Definition
The motivating question is not merely whether all points fit inside one large ball, but whether the space admits a finite description at every prescribed accuracy. If a numerical or geometric problem only sees distances smaller than $\varepsilon$ as negligible, a totally bounded space can be represented by finitely many prototypes at that accuracy. Throughout this page, for $y \in M$ and $\varepsilon > 0$, the notation $B(y,\varepsilon)$ means the open metric ball
\begin{align*}
B(y,\varepsilon)=\{x \in M : d(x,y)<\varepsilon\}.
\end{align*}
[definition: Totally Bounded Metric Space]
A metric space $(M,d)$ is totally bounded if for every $\varepsilon > 0$ there exists a finite set $F \subset M$ such that
\begin{align*}
M = \bigcup_{y \in F} B(y,\varepsilon).
\end{align*}
[/definition]
The finite set in the definition is the data that makes the condition operational. Naming it separately is useful because many arguments construct these finite approximating sets before invoking total boundedness itself.
[definition: Finite Epsilon Net]
Let $(M,d)$ be a metric space, let $A \subset M$, and let $\varepsilon > 0$. A finite subset $F \subset M$ is a finite $\varepsilon$-net for $A$ in $M$ if
\begin{align*}
A \subset \bigcup_{y \in F} B(y,\varepsilon).
\end{align*}
If $F \subset A$, then $F$ is called an internal finite $\varepsilon$-net for $A$.
[/definition]
Many compactness questions concern one family of points or functions inside a larger ambient space. The obstruction is that the set may not carry a useful metric on its own, or its approximating centers may naturally live in the ambient space rather than inside the set. The subset version records finite approximability at every scale relative to that surrounding metric.
[definition: Totally Bounded Subset]
Let $(M,d)$ be a metric space. A subset $A \subset M$ is totally bounded in $M$ if for every $\varepsilon > 0$ there exists a finite set $F \subset M$ such that
\begin{align*}
A \subset \bigcup_{y \in F} B(y,\varepsilon).
\end{align*}
[/definition]
Qualitative total boundedness says whether finite approximation is possible at each scale, but it does not say how expensive the approximation is. In estimates one often needs to compare two sets that are both totally bounded but require very different numbers of balls at the same resolution. The covering number records this finite cost at scale $\varepsilon$.
[definition: Covering Number]
Let $(M,d)$ be a metric space and let $A \subset M$. For $\varepsilon > 0$, the covering number $N(A,d,\varepsilon)$ is the least cardinality of a finite set $F \subset M$ such that
\begin{align*}
A \subset \bigcup_{y \in F} B(y,\varepsilon),
\end{align*}
when such finite sets exist.
[/definition]
With this language, a subset $A$ is totally bounded exactly when $N(A,d,\varepsilon)$ is finite for every $\varepsilon > 0$. Covering numbers are central in entropy estimates, compactness arguments, and [approximation theory](/page/Approximation%20Theory).
## Equivalent Characterisations
A covering definition is often the most efficient way to prove total boundedness, but sequences give the most memorable test. If a metric space cannot be covered by finitely many small balls, then it contains an infinite sequence whose terms stay separated at that scale. Total boundedness rules out that kind of persistent separation.
[quotetheorem:1087]
The sequential test is useful because it turns a covering property into a compactness-style obstruction: failure of total boundedness produces a sequence with no Cauchy subsequence, while total boundedness forces every sequence to have Cauchy subsequences after repeatedly passing to finer finite covers. This does not by itself give convergence, since the ambient space may be incomplete; it only gives the finite-approximation part of compactness.
Partition and grid arguments often produce finitely many pieces of small diameter before they produce centers of balls. The obstruction is that a cover by arbitrary small pieces does not initially provide a chosen center for each piece, so it is not visibly the same as a cover by metric balls. The following definition isolates this center-free covering condition so those arguments can be compared with total boundedness without extra bookkeeping.
[definition: Finite Small-Diameter Cover]
Let $(M,d)$ be a metric space, let $A \subset M$, and let $\varepsilon > 0$. A finite family of subsets $U_1,\ldots,U_N \subset M$ is a finite cover of $A$ by sets of diameter less than $\varepsilon$ if
\begin{align*}
A \subset \bigcup_{i=1}^{N} U_i
\end{align*}
and
\begin{align*}
\operatorname{diam}(U_i) < \varepsilon
\end{align*}
for every $i \in \{1,\ldots,N\}$.
[/definition]
A definition using small-diameter pieces should agree with the ball definition, or else total boundedness would depend on an arbitrary choice of language. The issue is the mismatch between a ball, which has a chosen center and radius, and a set of small diameter, which may have no distinguished center.
This creates the next test: can every finite small-diameter cover be converted into a finite ball cover, and conversely, without losing the essential all-scales condition? The equivalence shows that the mismatch only changes the scale, not the underlying finite-resolution property.
[quotetheorem:8879]
The direction from balls to small-diameter sets usually costs a factor of $2$ in the radius, while the direction from small-diameter sets to balls chooses one representative point from each nonempty set. This harmless change of scale is typical in total boundedness arguments.
A third formulation uses completion. Since total boundedness supplies Cauchy subsequences and completeness supplies their limits, the completion is the natural place to ask whether a set becomes compact after adding its missing limit points.
[definition: Precompact Subset]
Let $(M,d)$ be a metric space, and let $\widehat{M}$ be the completion of $(M,d)$ with canonical isometric embedding $\iota:M \to \widehat{M}$. A subset $A \subset M$ is precompact in $M$ if the closure of $\iota(A)$ in $\widehat{M}$ is compact.
[/definition]
This definition is especially common in functional analysis, where a bounded sequence may fail to converge in the original space but may have convergent subsequences after passing to a compact closure. The word "precompact" emphasizes that compactness is obtained after taking closure in the appropriate complete ambient space.
[quotetheorem:8517]
This result is the reason the terms "totally bounded" and "precompact" often appear near each other. Total boundedness is the metric covering condition; precompactness is the corresponding compactness condition after the missing limit points have been added.
## Examples
The basic Euclidean example shows that total boundedness captures finite-resolution approximation rather than closedness. The interval $(0,1)$ has missing endpoints, so it is not compact in $\mathbb{R}$, but no positive scale can distinguish infinitely many independent regions inside it.
[example: Open Interval Is Totally Bounded but Not Compact]
Consider $(0,1)$ with the [Euclidean metric](/page/Euclidean%20Metric) $d(x,y)=|x-y|$. Fix $\varepsilon>0$, and choose an integer $N \ge 2$ such that $1/N<\varepsilon$. Define
\begin{align*}
F=\left\{\frac{k}{N}:1\le k\le N-1\right\}.
\end{align*}
This set is finite and lies in $(0,1)$.
Let $x\in(0,1)$. If $0<x<1/N$, choose $k=1$. Then
\begin{align*}
\left|x-\frac{1}{N}\right|=\frac{1}{N}-x<\frac{1}{N}<\varepsilon.
\end{align*}
If $1/N\le x<1$, choose $k=\lfloor Nx\rfloor$. Since $1\le Nx<N$, we have $1\le k\le N-1$, so $k/N\in F$. Also $k\le Nx<k+1$, hence
\begin{align*}
\frac{k}{N}\le x<\frac{k+1}{N}.
\end{align*}
Therefore
\begin{align*}
0\le x-\frac{k}{N}<\frac{1}{N},
\end{align*}
so
\begin{align*}
\left|x-\frac{k}{N}\right|<\frac{1}{N}<\varepsilon.
\end{align*}
Thus every $x\in(0,1)$ lies in some ball $B(k/N,\varepsilon)$ with $k/N\in F$, and
\begin{align*}
(0,1)\subset \bigcup_{y\in F}B(y,\varepsilon).
\end{align*}
Since this works for every $\varepsilon>0$, the interval $(0,1)$ is totally bounded.
It is not compact as a subspace of $\mathbb{R}$. The family
\begin{align*}
\left\{(1/n,1)\cap(0,1):n\in\mathbb{N},\ n\ge 2\right\}
\end{align*}
is an [open cover](/page/Open%20Cover) of $(0,1)$: for any $x\in(0,1)$, choose $n>1/x$, so $1/n<x$ and therefore $x\in(1/n,1)\cap(0,1)$. If finitely many of these sets are chosen, let $n_0$ be the largest index among them. Then their union is contained in $(1/n_0,1)$, but the point $1/(n_0+1)$ belongs to $(0,1)$ and satisfies
\begin{align*}
\frac{1}{n_0+1}<\frac{1}{n_0}.
\end{align*}
So $1/(n_0+1)$ is not covered by that finite subfamily. Hence the open cover has no [finite subcover](/page/Finite%20Subcover), and $(0,1)$ is not compact. Total boundedness detects finite approximation at each positive scale, but it does not force the missing endpoints to belong to the space.
[/example]
This example separates total boundedness from compactness. The finite nets exist, but completeness fails because some Cauchy sequences approach boundary points outside the space.
The next example shows why ordinary boundedness is not enough outside finite-dimensional Euclidean spaces. Infinite-dimensional normed spaces can contain infinitely many mutually separated points inside a bounded set.
[example: Unit Ball of an Infinite-Dimensional Hilbert Space]
Let $H=\ell^2$ be the Hilbert space of square-summable scalar sequences, with norm
\begin{align*}
\|x\|_{\ell^2} = \left(\sum_{j=1}^{\infty} |x_j|^2\right)^{1/2}.
\end{align*}
For each $n \in \mathbb{N}$, let $e_n \in \ell^2$ be the sequence whose $n$-th coordinate is $1$ and whose other coordinates are $0$. Then
\begin{align*}
\|e_n\|_{\ell^2}=\left(|1|^2+\sum_{j\ne n}0^2\right)^{1/2}=1,
\end{align*}
so each $e_n$ belongs to the closed unit ball
\begin{align*}
\overline{B}(0,1)=\{x \in \ell^2 : \|x\|_{\ell^2} \le 1\}.
\end{align*}
If $m \ne n$, then $e_m-e_n$ has coordinate $1$ in position $m$, coordinate $-1$ in position $n$, and coordinate $0$ everywhere else. Hence
\begin{align*}
\|e_m-e_n\|_{\ell^2}=\left(|1|^2+|-1|^2+\sum_{j\ne m,n}0^2\right)^{1/2}=\sqrt{2}.
\end{align*}
Suppose, toward a contradiction, that $\overline{B}(0,1)$ were totally bounded. Then there would be finitely many points $y_1,\ldots,y_N \in \ell^2$ such that
\begin{align*}
\overline{B}(0,1)\subset \bigcup_{i=1}^{N}B(y_i,1/3).
\end{align*}
Since every $e_n$ lies in $\overline{B}(0,1)$, each $e_n$ lies in at least one of these $N$ balls. Infinitely many vectors $e_n$ are being assigned to finitely many balls, so two distinct vectors $e_m$ and $e_n$ lie in the same ball, say $B(y_i,1/3)$. Then
\begin{align*}
\|e_m-y_i\|_{\ell^2}<1/3
\end{align*}
and
\begin{align*}
\|e_n-y_i\|_{\ell^2}<1/3.
\end{align*}
By the triangle inequality for the norm metric,
\begin{align*}
\|e_m-e_n\|_{\ell^2}\le \|e_m-y_i\|_{\ell^2}+\|y_i-e_n\|_{\ell^2}<1/3+1/3=2/3.
\end{align*}
But the explicit computation above gives $\|e_m-e_n\|_{\ell^2}=\sqrt{2}$, and $\sqrt{2}>2/3$ because $2>4/9$. This contradiction shows that the closed unit ball of $\ell^2$ is not totally bounded. It is nevertheless bounded, since every element $x$ in it satisfies $\|x\|_{\ell^2}\le 1$.
[/example]
The example is a template for many compactness failures in [Banach spaces](/page/Banach%20Space) and [Hilbert spaces](/page/Hilbert%20Space). A bounded set may still have infinitely many independent directions, and total boundedness is exactly what rules out that behavior.
Discrete metrics give another boundary case. They show that total boundedness can collapse to finiteness when the metric has a smallest positive separation between distinct points.
[example: Infinite Discrete Metric Space]
Let $M$ be an infinite set with the [discrete metric](/page/Discrete%20Metric) $d$, so $d(x,x)=0$ and $d(x,y)=1$ whenever $x \ne y$. We show that $M$ is not totally bounded by using the fixed scale $\varepsilon=1$.
For any $y \in M$, the open ball of radius $1$ about $y$ is
\begin{align*}
B(y,1)=\{x \in M : d(x,y)<1\}.
\end{align*}
If $x=y$, then $d(x,y)=d(y,y)=0<1$, so $y \in B(y,1)$. If $x\ne y$, then $d(x,y)=1$, and $1<1$ is false, so $x\notin B(y,1)$. Hence
\begin{align*}
B(y,1)=\{y\}.
\end{align*}
Now let $F\subset M$ be any finite set. Then
\begin{align*}
\bigcup_{y\in F}B(y,1)=\bigcup_{y\in F}\{y\}=F.
\end{align*}
Because $F$ is finite and $M$ is infinite, $F\ne M$, so
\begin{align*}
M\not\subset \bigcup_{y\in F}B(y,1).
\end{align*}
Thus no finite $1$-net covers $M$, and therefore $M$ is not totally bounded. The obstruction is that every point remains isolated at radius $1$, so finite-radius-one data can only see finitely many points.
[/example]
This failure is not about large diameter: the whole space has diameter $1$. The obstruction is that infinitely many points remain separated at the fixed scale $\varepsilon=1/2$.
The examples above raise the central structural question: which familiar hypotheses guarantee finite nets at every scale? Compactness is the strongest and most flexible answer, because it turns the open cover by all $\varepsilon$-balls into a finite subcover.
[quotetheorem:316]
This theorem is often the fastest way to produce finite nets. For instance, every closed bounded interval $[a,b] \subset \mathbb{R}$ is compact, so it is totally bounded.
A Euclidean bounded set need not be closed, but it is still totally bounded. This is a special finite-dimensional phenomenon and should not be confused with the behavior of bounded sets in infinite-dimensional spaces.
[quotetheorem:8880]
The theorem depends on finite dimension. The $\ell^2$ unit-ball example shows that replacing $\mathbb{R}^n$ by an infinite-dimensional normed space makes the statement false.
## Properties
Total boundedness is stronger than boundedness in every metric space. The finite-net condition gives much more than one large containing ball, but it should at least imply that the space cannot spread out to arbitrarily large distances.
[quotetheorem:8723]
The converse fails in many metric spaces. Infinite discrete metric spaces and infinite-dimensional unit balls are bounded examples that are not totally bounded, for different structural reasons.
The next property explains why total boundedness is paired so often with completeness. Total boundedness gives Cauchy subsequences at small scales; completeness is the condition that these Cauchy subsequences actually converge inside the space.
[quotetheorem:8881]
This criterion separates the two ways compactness can fail in metric spaces. Total boundedness prevents infinitely many points from remaining a fixed positive distance apart, while completeness prevents Cauchy sequences from escaping to missing limit points. Both hypotheses are necessary: the open interval $(0,1)$ is totally bounded but not complete, and an infinite-dimensional closed unit ball can be complete and bounded without being totally bounded. The result is most useful as a diagnostic tool: to prove compactness, build finite nets at every scale and then check that the limiting process stays inside the space.
After this compactness test, it is natural to ask which parts of the finite-net condition survive under basic set operations. The first such operation is passing to a smaller family of points. The possible obstruction is that a net for the larger space might use centers outside the subset, so it is not automatic from an internal-net viewpoint that the smaller set remains controlled. With ambient centers allowed, the same finite approximations still cover every subset.
[quotetheorem:8882]
This property is one of the conveniences of total boundedness: unlike compactness, it is inherited by arbitrary subsets rather than only by closed subsets. The loss is that arbitrary subsets of compact spaces may fail to be compact because they may omit their limit points.
Approximation arguments often start with a [dense subset](/page/Dense%20Subset) and then pass to its closure. The next property says that adding all limit points does not change whether finite nets exist at every scale.
[quotetheorem:8517]
This theorem explains why dense subsets of compact metric spaces are totally bounded. For example, $\mathbb{Q} \cap [0,1]$ is totally bounded in $\mathbb{R}$ even though it is not complete.
Product constructions ask whether coordinatewise finite approximation can be assembled into finite approximation of the whole space. In countable products, the obstruction is the infinitely many coordinates: one cannot simply multiply nets in every coordinate. Product metrics handle this by making far-out coordinates contribute only a controlled tail, so a finite number of coordinate nets can control the product at a chosen scale.
[quotetheorem:1092]
The countable product result is therefore not a naive infinite multiplication of finite covers. It depends on the specific [product metric](/page/Product%20Metric): first control the finitely many coordinates that matter at the chosen scale, then use the metric's tail estimate to make the remaining coordinates harmless.
Many compactness arguments pass through a function, for instance by evaluating a family of functions or applying a continuous transformation. The obstruction is that nearby points in the domain must remain uniformly nearby after applying the map; otherwise one finite net in the domain might not control the whole image at a chosen scale. [Uniform continuity](/page/Uniform%20Continuity) supplies exactly the scale conversion needed to transport finite nets.
[quotetheorem:8883]
Continuity alone is not enough on noncompact domains, because ordinary continuity may not control all parts of the domain with a single scale. Uniform continuity is the correct hypothesis because total boundedness itself is a uniform covering condition.
A different question is what total boundedness says about the size of the space as a topological object. Finite approximation at every scale should also give countable approximation across all scales, but the finite lists occur at separate resolutions and must be organized into one dense set. Collecting finite nets for the radii $1,1/2,1/3,\ldots$ turns uniform finite approximation into separability.
[quotetheorem:8884]
This result is weaker than compactness but useful: finite approximation at every scale yields countable approximation across all scales. The converse fails, since an infinite separable Hilbert space is separable but its closed unit ball is not totally bounded.
## Relationship to Other Concepts
Total boundedness refines [boundedness](/page/Bounded%20Set). Boundedness asks for one ball of finite radius; total boundedness asks for finitely many balls at every positive radius. The second condition implies the first, but it remembers the small-scale distribution of points.
Its closest partner is [completeness](/page/Complete%20Metric%20Space). Total boundedness produces Cauchy subsequences; completeness turns those subsequences into convergent subsequences. Together they give compactness in metric spaces, which is why the concept appears in proofs of the [Heine-Borel theorem](/theorems/309), Arzela-Ascoli theorem, and compactness criteria for function spaces.
In finite-dimensional Euclidean space, total boundedness coincides with ordinary boundedness for subsets. This coincidence is special: the geometry of $\mathbb{R}^n$ allows bounded sets to be covered by finitely many grid cubes at any scale. Infinite-dimensional spaces lack such finite coordinate control.
In functional analysis, total boundedness is often phrased as relative compactness or precompactness. A linear operator between normed spaces is compact precisely when it sends bounded sets to relatively compact sets, and total boundedness supplies the metric form of that condition. Compact embeddings such as $X \hookrightarrow\hookrightarrow Y$ are also governed by the total boundedness of bounded subsets of $X$ when measured in the $Y$-metric.
The concept also has a quantitative side. Covering numbers $N(A,d,\varepsilon)$ measure how many data points are needed to approximate $A$ to accuracy $\varepsilon$. Their growth as $\varepsilon \to 0$ leads to metric entropy, fractal dimension, empirical process theory, and approximation rates.
## References
Androma, [Metric Space](/page/Metric%20Space).
Androma, [Compact Space](/page/Compact%20Space).
Androma, [Complete Metric Space](/page/Complete%20Metric%20Space).
Walter Rudin, *Principles of Mathematical Analysis* (1976).
John B. Conway, *A Course in Functional Analysis* (1990).
Gerald B. Folland, *Real Analysis* (1999).
Totally Bounded
Also known as: Total Boundedness, Totally bounded set, Totally bounded metric space, Finite epsilon-net property, Precompact metric space