Maximum pseudo likelihood estimation in network tomography
Gang Liang, Bin Yu · IEEE Transactions on Signal Processing · 2003
Network monitoring and diagnosis are key to improving network performance. The difficulties of performance monitoring lie in today's fast growing Internet, accompanied by increasingly heterogeneous and unregulated structures. Moreover, these tasks become even harder since one cannot rely on the collaboration of individual routers and servers to measure network traffic directly. Even though the aggregative nature of possible network measurements gives rise to inverse problems, existing methods for solving inverse problems are usually computationally intractable or statistically inefficient. A pseudo likelihood approach is proposed to solve a group of network tomography problems. The basic idea of pseudo likelihood is to form simple subproblems and ignore the dependences among the subproblems to form a product likelihood of the subproblems. As a result, this approach keeps a good balance between the computational complexity and the statistical efficiency of the parameter estimation. Some statistical properties of the pseudo likelihood estimator, such as consistency and asymptotic normality, are established. A pseudo expectation-maximization (EM) algorithm is developed to maximize the pseudo log-likelihood function. Two examples, with simulated or real data, are used to illustrate the pseudo likelihood proposal: 1) inference of the internal link delay distributions through multicast end-to-end measurements; 2) origin-destination matrix estimation through link traffic counts.
Cited by 165 works. doi:10.1109/tsp.2003.814464
Authors
References
- Maximum Likelihood from Incomplete Data Via the EM Algorithm
- Theory of Point Estimation
- R: A Language for Data Analysis and Graphics
- Spatial Interaction and the Statistical Analysis of Lattice Systems
- The EM Algorithm and Extensions
- Multivariate Density Estimation
- Wiley Series in Probability and Statistics
- Partial Likelihood
- Multivariate Density Estimation, Theory, Practice, and Visualbation
- Statistical Analysis of Non-Lattice Data