Author details
Author's Published Works
Scheduled Maintenance on Monday 1/13/2025
Single article sales and account management will be unavailable from 5:00 AM - 7:00 PM ET (09:00 - 23:00 UTC). We apologize for the inconvenience.
Author details
Showing 1-11 of 11 results
- Sort
Filter Results
Show
Sort By
Results
Towards Generating Ultra-High Resolution Talking-Face Videos with Lip synchronization
Anchit Gupta;Rudrabha Mukhopadhyay;Sindhu Balachandra;Faizan Farooq Khan;Vinay P. Namboodiri;C. V. Jawahar
2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Year: 2023 | Conference Paper |
Cited by: Papers (7)
Talking-face video generation works have achieved state-of-the-art results in synthesizing videos with lip synchronization. However, most of the previous works deal with low-resolution talking-face videos (up to 256×256 pixels), thus, generating extremely high-resolution videos still remains a challenge. We take a giant leap in this work and propose a novel method to synthesize talking-face videos...Show More
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Aditya Agarwal;Bipasha Sen;Rudrabha Mukhopadhyay;Vinay Namboodiri;C V Jawahar
2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Year: 2023 | Conference Paper |
Cited by: Papers (1)
Many people with some form of hearing loss consider lipreading as their primary mode of day-to-day communication. However, finding resources to learn or improve one’s lipreading skills can be challenging. This is further exacerbated in the COVID19 pandemic due to restrictions on direct interactions with peers and speech therapists. Today, online MOOCs platforms like Coursera and Udemy have become ...Show More
FaceOff: A Video-to-Video Face Swapping System
Aditya Agarwal;Bipasha Sen;Rudrabha Mukhopadhyay;Vinay Namboodiri;C V Jawahar
2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Year: 2023 | Conference Paper |
Cited by: Papers (2)
Doubles play an indispensable role in the movie industry. They take the place of the actors in dangerous stunt scenes or scenes where the same actor plays multiple characters. The double's face is later replaced with the actor's face and expressions manually using expensive CGI technology, costing millions of dollars and taking months to complete. An automated, inexpensive, and fast way can be to ...Show More
Audio-Visual Face Reenactment
Madhav Agarwal;Rudrabha Mukhopadhyay;Vinay Namboodiri;C V Jawahar
2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)
Year: 2023 | Conference Paper |
Cited by: Papers (15)
This work proposes a novel method to generate realistic talking head videos using audio and visual streams. We animate a source image by transferring head motion from a driving video using a dense motion field generated using learnable keypoints. We improve the quality of lip sync using audio as an additional input, helping the network to attend to the mouth region. We use additional priors using ...Show More
Visual Speech Enhancement Without A Real Visual Stream
Sindhu B Hegde;K R Prajwal;Rudrabha Mukhopadhyay;Vinay Namboodiri;C.V. Jawahar
2021 IEEE Winter Conference on Applications of Computer Vision (WACV)
Year: 2021 | Conference Paper |
Cited by: Papers (8)
In this work, we re-think the task of speech enhancement in unconstrained real-world environments. Current state- of-the-art methods use only the audio stream and are limited in their performance in a wide range of real-world noises. Recent works using lip movements as additional cues improve the quality of generated speech over "audio-only " methods. But, these methods cannot be used for several ...Show More
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
K R Prajwal;Rudrabha Mukhopadhyay;Vinay P. Namboodiri;C.V. Jawahar
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Year: 2020 | Conference Paper |
Cited by: Papers (56)
Humans involuntarily tend to infer parts of the conversation from lip movements when the speech is absent or corrupted by external noise. In this work, we explore the task of lip to speech synthesis, i.e., learning to generate natural speech given only the lip movements of a speaker. Acknowledging the importance of contextual and speaker-specific cues for accurate lip-reading, we take a different ...Show More
NTIRE 2019 Challenge on Video Super-Resolution: Methods and Results
Seungjun Nah;Radu Timofte;Shuhang Gu;Sungyong Baik;Seokil Hong;Gyeongsik Moon;Sanghyun Son;Kyoung Mu Lee;Xintao Wang;Kelvin C.K. Chan;Ke Yu;Chao Dong;Chen Change Loy;Yuchen Fan;Jiahui Yu;Ding Liu;Thomas S. Huang;Xiao Liu;Chao Li;Dongliang He;Yukang Ding;Shilei Wen;Fatih Porikli;Ratheesh Kalarot;Muhammad Haris;Greg Shakhnarovich;Norimichi Ukita;Peng Yi;Zhongyuan Wang;Kui Jiang;Junjun Jiang;Jiayi Ma;Hang Dong;Xinyi Zhang;Zhe Hu;Kwanyoung Kim;Dong Un Kang;Se Young Chun;Kuldeep Purohit;A.N. Rajagopalan;Yapeng Tian;Yulun Zhang;Yun Fu;Chenliang Xu;A. Murat Tekalp;M. Akin Yilmaz;Cansu Korkmaz;Manoj Sharma;Megh Makwana;Anuj Badhwar;Ajay Pratap Singh;Avinash Upadhyay;Rudrabha Mukhopadhyay;Ankit Shukla;Dheeraj Khanna;A. S. Mandal;Santanu Chaudhury;Si Miao;Yongxin Zhu;Xiao Huo
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2019 | Conference Paper |
Cited by: Papers (22)
This paper reviews the first NTIRE challenge on video super-resolution (restoration of rich details in low-resolution video frames) with focus on proposed solutions and results. A new REalistic and Diverse Scenes dataset (REDS) was employed. The challenge was divided into 2 tracks. Track 1 employed standard bicubic downscaling setup while Track 2 had realistic dynamic motion blurs. Each competitio...Show More
NTIRE 2019 Challenge on Video Super-Resolution: Methods and Results
Seungjun Nah;Radu Timofte;Shuhang Gu;Sungyong Baik;Seokil Hong;Gyeongsik Moon;Sanghyun Son;Kyoung Mu Lee;Xintao Wang;Kelvin C.K. Chan;Ke Yu;Chao Dong;Chen Change Loy;Yuchen Fan;Jiahui Yu;Ding Liu;Thomas S. Huang;Xiao Liu;Chao Li;Dongliang He;Yukang Ding;Shilei Wen;Fatih Porikli;Ratheesh Kalarot;Muhammad Haris;Greg Shakhnarovich;Norimichi Ukita;Peng Yi;Zhongyuan Wang;Kui Jiang;Junjun Jiang;Jiayi Ma;Hang Dong;Xinyi Zhang;Zhe Hu;Kwanyoung Kim;Dong Un Kang;Se Young Chun;Kuldeep Purohit;A.N. Rajagopalan;Yapeng Tian;Yulun Zhang;Yun Fu;Chenliang Xu;A. Murat Tekalp;M. Akin Yilmaz;Cansu Korkmaz;Manoj Sharma;Megh Makwana;Anuj Badhwar;Ajay Pratap Singh;Avinash Upadhyay;Rudrabha Mukhopadhyay;Ankit Shukla;Dheeraj Khanna;A. S. Mandal;Santanu Chaudhury;Si Miao;Yongxin Zhu;Xiao Huo
Year: 2019 | Conference Paper |
NTIRE 2018 Challenge on Spectral Reconstruction from RGB Images
Boaz Arad;Ohad Ben-Shahar;Radu Timofte;Luc Van Gool;Lei Zhang;Ming-Hsuan Yang;Zhiwei Xiong;Chang Chen;Zhan Shi;Dong Liu;Feng Wu;Charis Lanaras;Silvano Galliani;Konrad Schindler;Tarek Stiebel;Simon Koppers;Philipp Seltsam;Ruofan Zhou;Majed El Helou;Fayez Lahoud;Marjan Shahpaski;Ke Zheng;Lianru Gao;Bing Zhang;Ximin Cui;Haoyang Yu;Yigit Baran Can;Aitor Alvarez-Gila;Joost van de Weijer;Estibaliz Garrote;Adrian Galdran;Manoj Sharma;Sriharsha Koundinya;Avinash Upadhyay;Raunak Manekar;Rudrabha Mukhopadhyay;Himanshu Sharma;Santanu Chaudhury;Koushik Nagasubramanian;Sambuddha Ghosal;Asheesh K. Singh;Arti Singh;Baskar Ganapathysubramanian;Soumik Sarkar
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2018 | Conference Paper |
Cited by: Papers (73)
This paper reviews the first challenge on spectral image reconstruction from RGB images, i.e., the recovery of whole-scene hyperspectral (HS) information from a 3-channel RGB image. The challenge was divided into 2 tracks: the "Clean" track sought HS recovery from noiseless RGB images obtained from a known response function (representing spectrally-calibrated camera) while the "Real World" track c...Show More
NTIRE 2018 Challenge on Spectral Reconstruction from RGB Images
Boaz Arad;Ohad Ben-Shahar;Radu Timofte;Luc Van Gool;Lei Zhang;Ming-Hsuan Yang;Zhiwei Xiong;Chang Chen;Zhan Shi;Dong Liu;Feng Wu;Charis Lanaras;Silvano Galliani;Konrad Schindler;Tarek Stiebel;Simon Koppers;Philipp Seltsam;Ruofan Zhou;Majed El Helou;Fayez Lahoud;Marjan Shahpaski;Ke Zheng;Lianru Gao;Bing Zhang;Ximin Cui;Haoyang Yu;Yigit Baran Can;Aitor Alvarez-Gila;Joost van de Weijer;Estibaliz Garrote;Adrian Galdran;Manoj Sharma;Sriharsha Koundinya;Avinash Upadhyay;Raunak Manekar;Rudrabha Mukhopadhyay;Himanshu Sharma;Santanu Chaudhury;Koushik Nagasubramanian;Sambuddha Ghosal;Asheesh K. Singh;Arti Singh;Baskar Ganapathysubramanian;Soumik Sarkar
Year: 2018 | Conference Paper |
NTIRE 2018 Challenge on Single Image Super-Resolution: Methods and Results
Radu Timofte;Shuhang Gu;Jiqing Wu;Luc Van Gool;Lei Zhang;Ming-Hsuan Yang;Muhammad Haris;Greg Shakhnarovich;Norimichi Ukita;Shijia Hu;Yijie Bei;Zheng Hui;Xiao Jiang;Yanan Gu;Jie Liu;Yifan Wang;Federico Perazzi;Brian McWilliams;Alexander Sorkine-Hornung;Olga Sorkine-Hornung;Christopher Schroers;Jiahui Yu;Yuchen Fan;Jianchao Yang;Ning Xu;Zhaowen Wang;Xinchao Wang;Thomas S. Huang;Xintao Wang;Ke Yu;Tak-Wai Hui;Chao Dong;Liang Lin;Chen Change Loy;Dongwon Park;Kwanyoung Kim;Se Young Chun;Kai Zhang;Pengjv Liu;Wangmeng Zuo;Shi Guo;Jiye Liu;Jinchang Xu;Yijiao Liu;Fengye Xiong;Yuan Dong;Hongliang Bai;Alexandru Damian;Nikhil Ravi;Sachit Menon;Cynthia Rudin;Junghoon Seo;Taegyun Jeon;Jamyoung Koo;Seunghyun Jeon;Soo Ye Kim;Jae-Seok Choi;Sehwan Ki;Soomin Seo;Hyeonjun Sim;Saehun Kim;Munchurl Kim;Rong Chen;Kun Zeng;Jinkang Guo;Yanyun Qu;Cuihua Li;Namhyuk Ahn;Byungkon Kang;Kyung-Ah Sohn;Yuan Yuan;Jiawei Zhang;Jiahao Pang;Xiangyu Xu;Yan Zhao;Wei Deng;Sibt Ul Hussain;Muneeb Aadil;Rafia Rahim;Xiaowang Cai;Fang Huang;Yueshu Xu;Pablo Navarrete Michelini;Dan Zhu;Hanwen Liu;Jun-Hyuk Kim;Jong-Seok Lee;Yiwen Huang;Ming Qiu;Liting Jing;Jiehang Zeng;Ying Wang;Manoj Sharma;Rudrabha Mukhopadhyay;Avinash Upadhyay;Sriharsha Koundinya;Ankit Shukla;Santanu Chaudhury;Zhe Zhang;Yu Hen Hu;Lingzhi Fu
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2018 | Conference Paper |
Cited by: Papers (184)
This paper reviews the 2nd NTIRE challenge on single image super-resolution (restoration of rich details in a low resolution image) with focus on proposed solutions and results. The challenge had 4 tracks. Track 1 employed the standard bicubic downscaling setup, while Tracks 2, 3 and 4 had realistic unknown downgrading operators simulating camera image acquisition pipeline. The operators were lear...Show More
NTIRE 2018 Challenge on Single Image Super-Resolution: Methods and Results
Radu Timofte;Shuhang Gu;Jiqing Wu;Luc Van Gool;Lei Zhang;Ming-Hsuan Yang;Muhammad Haris;Greg Shakhnarovich;Norimichi Ukita;Shijia Hu;Yijie Bei;Zheng Hui;Xiao Jiang;Yanan Gu;Jie Liu;Yifan Wang;Federico Perazzi;Brian McWilliams;Alexander Sorkine-Hornung;Olga Sorkine-Hornung;Christopher Schroers;Jiahui Yu;Yuchen Fan;Jianchao Yang;Ning Xu;Zhaowen Wang;Xinchao Wang;Thomas S. Huang;Xintao Wang;Ke Yu;Tak-Wai Hui;Chao Dong;Liang Lin;Chen Change Loy;Dongwon Park;Kwanyoung Kim;Se Young Chun;Kai Zhang;Pengjv Liu;Wangmeng Zuo;Shi Guo;Jiye Liu;Jinchang Xu;Yijiao Liu;Fengye Xiong;Yuan Dong;Hongliang Bai;Alexandru Damian;Nikhil Ravi;Sachit Menon;Cynthia Rudin;Junghoon Seo;Taegyun Jeon;Jamyoung Koo;Seunghyun Jeon;Soo Ye Kim;Jae-Seok Choi;Sehwan Ki;Soomin Seo;Hyeonjun Sim;Saehun Kim;Munchurl Kim;Rong Chen;Kun Zeng;Jinkang Guo;Yanyun Qu;Cuihua Li;Namhyuk Ahn;Byungkon Kang;Kyung-Ah Sohn;Yuan Yuan;Jiawei Zhang;Jiahao Pang;Xiangyu Xu;Yan Zhao;Wei Deng;Sibt Ul Hussain;Muneeb Aadil;Rafia Rahim;Xiaowang Cai;Fang Huang;Yueshu Xu;Pablo Navarrete Michelini;Dan Zhu;Hanwen Liu;Jun-Hyuk Kim;Jong-Seok Lee;Yiwen Huang;Ming Qiu;Liting Jing;Jiehang Zeng;Ying Wang;Manoj Sharma;Rudrabha Mukhopadhyay;Avinash Upadhyay;Sriharsha Koundinya;Ankit Shukla;Santanu Chaudhury;Zhe Zhang;Yu Hen Hu;Lingzhi Fu
Year: 2018 | Conference Paper |
2D-3D CNN Based Architectures for Spectral Reconstruction from RGB Images
Sriharsha Koundinya;Himanshu Sharma;Manoj Sharma;Avinash Upadhyay;Raunak Manekar;Rudrabha Mukhopadhyay;Abhijit Karmakar;Santanu Chaudhury
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2018 | Conference Paper |
Cited by: Papers (45)
Hyperspectral cameras are used to preserve fine spectral details of scenes that are not captured by traditional RGB cameras that comprehensively quantizes radiance in RGB images. Spectral details provide additional information that improves the performance of numerous image based analytic applications, but due to high hyperspectral hardware cost and associated physical constraints, hyperspectral i...Show More
IRGUN : Improved Residue Based Gradual Up-Scaling Network for Single Image Super Resolution
Manoj Sharma;Rudrabha Mukhopadhyay;Avinash Upadhyay;Sriharsha Koundinya;Ankit Shukla;Santanu Chaudhury
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2018 | Conference Paper |
Cited by: Papers (6)
Convolutional neural network based architectures have achieved decent perceptual quality super resolution on natural images for small scaling factors (2X and 4X). However, image super-resolution for large magnication factors (8X) is an extremely challenging problem for the computer vision community. In this paper, we propose a novel Improved Residual based Gradual Up-Scaling Network (IRGUN) to imp...Show More
IEEE Account
Purchase Details
Profile Information
Need Help?
- US & Canada: +1 800 678 4333
- Worldwide: +1 732 981 0060
- Contact & Support
- About IEEE Xplore
- Contact Us
- Help
- Accessibility
- Terms of Use
- Nondiscrimination Policy
- Sitemap
- Privacy & Opting Out of Cookies
A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity.
© Copyright 2025 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.