I. Introduction
In recent communication area, downlink (DL) multi-user multiple-input multiple-output (MU-MIMO) system has received many attentions. The DL MU-MIMO system is the data communication from base station (BS) toward multiple users. BS and each user has more than one transmit and receive antennas respectively. Under the limited feedback systems, because the information of channel state is limited, precoding does not perform perfectly [1]. As a result, performance degradation and error floor are caused. For this problem, in previous work, we already proposed an extended version of sphere decoding (ESD) which detects the interference signal additionally [2], [3]. Although it can achieve near optimal performance, it has high complexity. Therefore, in this paper, we propose more strict enumeration based on the minimum mean-square error (MMSE) to reduce high complexity of ESD.