2. Random Variables and Stochastic Processes

Jay H. Lee, Niket S. Kaisare, Carlos E. García · Society for Industrial and Applied Mathematics eBooks · 2008

Assuming an underlying probability space, as defined in Chapter 1, a real number, called a random variable, is defined. Since estimation and stochastic control algorithms all process real numbers, the concept of the random variable is central to all the concepts that follow. For example, based on a probability space on which the random variable is defined, probability distributions and probability density functions are defined. By indexing the random variable with a parameter, the notions of a stochastic sequence and stochastic process are introduced. We focus first on the properties of stochastic sequences in this chapter as well as their role in discrete-time estimation theory in Chapters 3 and 4. In Chapters 5 and 6 the emphasis is on the characterization and properties of stochastic processes and their role in continuous-time estimation theory. Finally, by using probability distributions and probability density functions, the notion of averaging or expectation is defined. 2.1 Random Variables The concept of an experiment served us well in introducing probability theory. However, the problems that you will run into will not be phrased in terms of events or sets. To tie probability theory to our everyday experience, we will introduce the concept of a random variable. Definition 2.1. Given a probability space, a random variable X(·) : Ω → Rn is a real- (vector-) valued point function which carries a sample point, ω ε Ω, into a point y εRn in such a way that every set, A ⊂ Ω, of the form A= {ω : X (ω) ≤x,x ∈ Rn } 2.1 is an element of the σ-algebra Remark 2.2. The vector form of the random variable is sometimes referred to as a random vector.

Cited by 94 works. doi:10.1002/9781394333325.app02

Authors