Loading [MathJax]/extensions/MathZoom.js
Sergios Theodoridis - IEEE Xplore Author Profile

Showing 1-25 of 188 results

Results

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyperparameter optimization. This article presents a novel GP linear multiple kernel (LMK) and a generic sparsity-aware distributed learning framework to optimize the hyperparameters. The newly proposed grid spectral mixture product (GSMP) kernel is tailo...Show More
A fundamental challenge in cognitive radio is the detection of primary users in a licensed spectrum. Cooperative sensing, which utilizes multiple receivers distributed across different locations, offers the advantage of utilizing multiple antennas and achieving spatial diversity gain. However, successful implementation of cooperative sensing relies on the ideal exchange of information among cooper...Show More
A fundamental problem in cognitive radio is spectrum sensing, which detects the presence of the primary users in a licensed spectrum. To boost the detection performance and robustness, the multiantenna detector has been investigated and various related methods have been developed, e.g., the energy detector, the eigenvalue arithmetic-to-geometric mean detector, and the generalized likelihood ratio ...Show More
The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension, leading to escalating computational complexity and parameter proliferation, thus posing challenges for modeling dynamical systems with high-dimensional latent states....Show More
Extracting information from fMRI data constitutes a broad active area of research. Current techniques still present several limitations; some ignore relevant aspects regarding the brain functioning or lack of interpretability. In an effort to overcome such limitations, we introduce an extension of the sparse matrix factorization approach to a multilinear decomposition. The proposed model is built ...Show More
Variational autoencoders (VAE) are one of the most prominent deep generative models for learning the underlying statistical distribution of high-dimensional data. However, training VAEs suffers from a severe issue called posterior collapse; that is, the learned posterior distribution collapses to the assumed/pre-selected prior distribution. This issue limits the capacity of the learned posterior d...Show More
Sparse modeling for signal processing and machine learning, in general, has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning (SAL) consists of two major paths paved by 1) discriminative methods that establish direct input–output mapping based on a regularized cost function optimization and 2) generative methods that learn the underlyin...Show More
Neural networks based on reconfigurable photonic integrated chips (RPICs) can offer zero-latency processing, marginal power consumption and operational flexibility. On the other hand, they are subject to, performance affecting, operational/fabrication deviations in their building blocks. Here, we present a Bayesian learning framework that when combined with device characterization, can dramaticall...Show More
Artificial neural networks are efficient computing platforms inspired by the brain. Such platforms can tackle a vast area of real-life tasks ranging from image processing to language translation. Silicon photonic integrated chips (PICs), by employing coherent interactions in Mach-Zehnder interferometers, are promising accelerators offering record low power consumption and ultra-fast matrix multipl...Show More
Transfer entropy can to a certain degree assess the direction in addition to the strength of the couplings within dynamic time series. The greater the transfer entropy, the greater the strength of the dependency between time series. In this work, we are interested in quantifying the effect that a given time series (e.g., an external stimuli) has upon the coupling strength between other time series...Show More
Tensor rank learning for canonical polyadic decomposition (CPD) has long been deemed as an essential yet challenging problem. In particular, since thetensor rank controls the complexity of the CPD model, its inaccurate learning would cause overfitting to noise or underfitting to the signal sources, and even destroy the interpretability of model parameters. However, the optimal determination of a t...Show More
In this overview paper, data-driven learning model-based cooperative localization and location data processing are considered, in line with the emerging machine learning and big data methods. We first review (1) state-of-the-art algorithms in the context of federated learning, (2) two widely used learning models, namely the deep neural network model and the Gaussian process model, and (3) various ...Show More
Gaussian processes (GPs) for machine learning have been studied systematically over the past two decades. However, kernel design for GPs and the associated hyper-parameters optimization are still difficult, and to a large extent open problems. We consider GP regression for time series modeling and analysis. The underlying stationary kernel is approximated closely by a new grid spectral mixture (GS...Show More
In this paper, the task-related fMRI problem is treated in its matrix factorization form, focusing on the Dictionary Learning (DL) approach. The proposed method allows the incorporation of a priori knowledge that is associated with both the experimental design and available brain atlases. Moreover, it can cope efficiently with uncertainties in the modeling of the hemodynamic response function. In ...Show More
The next generation of telecommunication networks will integrate the latest developments and emerging advancements in telecommunications connectivity infrastructures. In this article, we discuss the transformation and convergence of the fifth-generation (5G) mobile network and the internet of things technologies, toward the emergence of the smart sixth-generation (6G) networks which will employ AI...Show More
The advantages of tensor- over matrix-based methods have been recently demonstrated in the context of functional magnetic resonance imaging (fMRI) blind source unmixing. However, these methods rely on the assumption of a Gaussian distribution for the noise, which suggests a least squares criterion for the tensor decomposition. One can instead argue that a Rician model for the fMRI noise is much mo...Show More
Data fusion refers to the joint analysis of multiple datasets which provide complementary views of the same task. In this paper, the problem of jointly analyzing electroencephalography (EEG) and functional Magnetic Resonance Imaging (fMRI) data is considered. Analyzing both EEG and fMRI measurements is highly beneficial for studying brain function because these modalities have complementary spatio...Show More
We propose a modified spectral mixture (SM) kernel that serves as a universal stationary kernel for temporal Gaussian process regression (GPR). The kernel is named grid spectral mixture (GSM) kernel as we fix the frequency and variance parameters in the original SM kernel to a set of pre-selected grid points. The hyper-parameters are the non-negative weights of all sub-kernel functions and the res...Show More
Distributed estimation of a parameter vector in a network of sensor nodes with ambiguous measurements is considered. These ambiguities may be due to interference, poor calibration, high noise levels or any other cause. Cooperation among the nodes is required to resolve them. In such a setting, non-convex constraint sets may be required at the nodes, in order to accurately model the local ambiguiti...Show More
We present a novel diffusion scheme for online kernel-based learning over networks. So far, a major drawback of any online learning algorithm, operating in a reproducing kernel Hilbert space (RKHS), is the need for updating a growing number of parameters as time iterations evolve. Besides complexity, this leads to an increased need of communication resources in a distributed setting. In contrast, ...Show More
Tensor-based analysis of brain imaging data, in particular functional Magnetic Resonance Imaging (fMRI), has proved to be quite effective in exploiting their inherently multidimensional nature. It commonly relies on a trilinear model generating the analyzed data. This assumption, however, may prove to be quite strict in practice; for example, due to the natural intra-subject and inter-subject vari...Show More
Extracting information from functional magnetic resonance images (fMRI) has been a major area of research for more than two decades. The goal of this work is to present a new method for the analysis of fMRI data sets, that is capable to incorporate a priori available information, via an efficient optimization framework. Tests on synthetic data sets demonstrate significant performance gains over ex...Show More
We consider the task of robust nonlinear regression in the presence of both inlier noise and outliers. Assuming that the unknown nonlinear function belongs to a reproducing kernel Hilbert space, our goal is to estimate the set of the associated unknown parameters. Due to the presence of outliers, common techniques such as the kernel ridge regression (KRR) or the support vector regression turn out ...Show More
Unlike traditional homogeneous single-task wireless sensor networks (WSNs), heterogeneous and multitask WSNs allow the cooperation among multiple heterogeneous devices dedicated to solving different signal processing tasks. Despite their heterogeneous nature and the fact that each device may solve a different task, the devices could still benefit from a collaboration between them to achieve a supe...Show More
Diffusion-based distributed dictionary learning methods are studied in this work. We consider the classical mixed l2-l1 cost function, that employs an l2 representation error term and an l1 sparsity promoting regularizer. First, we observe that this cost function suffers from an inherent permutation ambiguity. This ambiguity may deteriorate significantly the performance of diffusion-based schemes,...Show More