Loading web-font TeX/Math/Italic
On the Success Probability of Three Detectors for the Box-Constrained Integer Linear Model | IEEE Journals & Magazine | IEEE Xplore

On the Success Probability of Three Detectors for the Box-Constrained Integer Linear Model

Publisher: IEEE

Abstract:

This paper is concerned with detecting an integer parameter vector inside a box from a linear model that is corrupted with a noise vector following the Gaussian distribut...View more

Abstract:

This paper is concerned with detecting an integer parameter vector inside a box from a linear model that is corrupted with a noise vector following the Gaussian distribution. One of the commonly used detectors is the maximum likelihood detector, which is obtained by solving a box-constrained integer least squares problem, that is NP-hard. Two other popular detectors are the box-constrained rounding and Babai detectors due to their high efficiency of implementation. In this paper, we first present formulas for the success probabilities (the probabilities of correct detection) of these three detectors for two different situations: the integer parameter vector is deterministic and is uniformly distributed over the constraint box. Then, we give two simple examples to respectively show that the success probability of the box-constrained rounding detector can be larger than that of the box-constrained Babai detector and the latter can be larger than the success probability of the maximum likelihood detector when the parameter vector is deterministic, and prove that the success probability of the box-constrained rounding detector is always not larger than that of the box-constrained Babai detector when the parameter vector is uniformly distributed over the constraint box. Some relations between the results for the box constrained and ordinary cases are presented, and two bounds on the success probability of the maximum likelihood detector, which can easily be computed, are developed. Finally, simulation results are provided to illustrate our main theoretical findings.
Published in: IEEE Transactions on Communications ( Volume: 69, Issue: 11, November 2021)
Page(s): 7180 - 7191
Date of Publication: 26 July 2021

ISSN Information:

Publisher: IEEE

Funding Agency:


I. Introduction

Suppose that we have the following box-constrained linear model: \begin{align*} {\boldsymbol {y}}=&\boldsymbol {A} {\hat { {\boldsymbol {x}}}} + \boldsymbol {v}, \quad \boldsymbol {v} \sim \mathcal {N}(\boldsymbol {0},\sigma ^{2} \boldsymbol {I}), \tag{1}\\ {\hat { {\boldsymbol {x}}}}\in \mathcal {B}\equiv&\{ {\boldsymbol {x}}\in \mathbb {Z}^{n}: \boldsymbol {\ell }\leq {\boldsymbol {x}}\leq \boldsymbol {u},\; \boldsymbol {\ell }, \boldsymbol {u}\in \mathbb {Z}^{n}, \boldsymbol {\ell }< \boldsymbol {u}\}, \tag{2}\end{align*}

where is an observation vector, with is a deterministic full column rank model matrix, is an integer parameter vector and is a noise vector following the Gaussian distribution with given .

References

References is not available for this document.