Author details
Author's Published Works
Scheduled Maintenance on Monday 1/13/2025
Single article sales and account management will be unavailable from 5:00 AM - 7:00 PM ET (09:00 - 23:00 UTC). We apologize for the inconvenience.
Author details
Showing 1-25 of 56 results
- Sort
Filter Results
Show
Sort By
Results
SegGuard: Defending Scene Segmentation Against Adversarial Patch Attack
2024 IEEE International Conference on Image Processing (ICIP)
Year: 2024 | Conference Paper |
Adversarial Patch Attacks (APAs) induce prediction errors by inserting carefully crafted regions into images. This paper presents the first defence against APAs for deep networks that perform semantic segmentation of scenes. We show that a conditional generator can be trained to produce patches on demand targeting specific classes and achieving superior performance versus conventional pixel-optimi...Show More
PARASOL: Parametric Style Control for Diffusion Image Synthesis
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2024 | Conference Paper |
We propose PARASOL, a multi-modal synthesis model that enables disentangled, parametric control of the visual style of the image by jointly conditioning synthesis on both content and a fine-grained visual style embedding. We train a latent diffusion model (LDM) using specific losses for each modality and adapt the classifer-free guidance for encouraging disentangled control over independent conten...Show More
ProMark: Proactive Diffusion Watermarking for Causal Attribution
Vishal Asnani;John Collomosse;Tu Bui;Xiaoming Liu;Shruti Agarwal
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Year: 2024 | Conference Paper |
Cited by: Papers (1)
Generative AI (GenAI) is transforming creative work-flows through the capability to synthesize and manipulate images via high-level prompts. Yet creatives are not well supported to receive recognition or reward for the use of their content in GenAI training. To this end, we propose ProMark, a causal attribution technique to attribute a synthetically generated image to its training data concepts li...Show More
To Authenticity, and Beyond! Building Safe and Fair Generative AI Upon the Three Pillars of Provenance
Provenance facts, such as who made an image and how, can provide valuable context for users to make trust decisions about visual content. Against a backdrop of inexorable progress in generative AI for computer graphics, over two billion people will vote in public elections this year. Emerging standards and provenance enhancing tools promise to play an important role in fighting fake news and the s...Show More
VADER: Video Alignment Differencing and Retrieval
Alexander Black;Simon Jenni;Tu Bui;Md. Mehrab Tanjim;Stefano Petrangeli;Ritwik Sinha;Viswanathan Swaminathan;John Collomosse
2023 IEEE/CVF International Conference on Computer Vision (ICCV)
Year: 2023 | Conference Paper |
Cited by: Papers (2)
We propose VADER, a spatio- temporal matching, alignment, and change summarization method to help fight misinformation spread via manipulated videos. VADER matches and coarsely aligns partial video fragments to candidate videos using a robust visual descriptor and scalable search over adaptively chunked video content. A transformer- based alignment module then refines the temporal localization of ...Show More
SceneComposer: Any-Level Semantic Image Synthesis
Yu Zeng;Zhe Lin;Jianming Zhang;Qing Liu;John Collomosse;Jason Kuen;Vishal M. Patel
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Year: 2023 | Conference Paper |
Cited by: Papers (18)
We propose a new framework for conditional image synthesis from semantic layouts of any precision levels, ranging from pure text to a 2D semantic canvas with precise shapes. More specifically, the input layout consists of one or more semantic regions with free-form text descriptions and adjustable precision levels, which can be set based on the desired controllability. The framework naturally redu...Show More
EKILA: Synthetic Media Provenance and Attribution for Generative Art
Kar Balan;Shruti Agarwal;Simon Jenni;Andy Parsons;Andrew Gilbert;John Collomosse
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2023 | Conference Paper |
Cited by: Papers (3)
We present EKILA; a decentralized framework that enables creatives to receive recognition and reward for their contributions to generative AI (GenAI). EKILA proposes a robust visual attribution technique and combines this with an emerging content provenance standard (C2PA) to address the problem of synthetic image provenance – determining the generative model and training data responsible for an A...Show More
RoSteALS: Robust Steganography using Autoencoder Latent Space
2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2023 | Conference Paper |
Cited by: Papers (14)
Data hiding such as steganography and invisible watermarking has important applications in copyright protection, privacy-preserved communication and content provenance. Existing works often fall short in either preserving image quality, or robustness against perturbations or are too complex to train. We propose RoSteALS, a practical steganography technique leveraging frozen pretrained autoencoders...Show More
Video Manipulations Beyond Faces: A Dataset with Human-Machine Analysis
Trisha Mittal;Ritwik Sinha;Viswanathan Swaminathan;John Collomosse;Dinesh Manocha
2023 IEEE/CVF Winter Conference on Applications of Computer Vision Workshops (WACVW)
Year: 2023 | Conference Paper |
Cited by: Papers (5)
As tools for content editing mature, and artificial intelligence (AI) based algorithms for synthesizing media grow, the presence of manipulated content across online media is increasing. This phenomenon causes the spread of misinformation, creating a greater need to distinguish between “real” and “manipulated” content. To this end, we present Videosham, a dataset consisting of 826 videos (413 real...Show More
ARIA: Adversarially Robust Image Attribution for Content Provenance
Maksym Andriushchenko;Xiaoyang Rebecca Li;Geoffrey Oxholm;Thomas Gittings;Tu Bui;Nicolas Flammarion;John Collomosse
2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2022 | Conference Paper |
Image attribution – matching an image back to a trusted source – is an emerging tool in the fight against online misinformation. Deep visual fingerprinting models have recently been explored for this purpose. However, they are not robust to tiny input perturbations known as adversarial examples. First we illustrate how to generate valid adversarial images that can easily cause incorrect image attr...Show More
TAPESTRY: A De-Centralized Service for Trusted Interaction Online
Yifan Yang;Daniel Cooper;John Collomosse;Constantin Cătălin Drăgan;Mark Manulis;Jamie Steane;Arthi Manohar;Jo Briggs;Helen Jones;Wendy Moncur
We present a novel de-centralised service for proving the provenance of online digital identity, exposed as an assistive tool to help non-expert users make better decisions about whom to trust online. Our service harnesses the digital personhood (DP); the longitudinal and multi-modal signals created through users’ lifelong digital interactions, as a basis for evidencing the provenance of identity....Show More
OSCAR-Net: Object-centric Scene Graph Attention for Image Attribution
2021 IEEE/CVF International Conference on Computer Vision (ICCV)
Year: 2021 | Conference Paper |
Cited by: Papers (11)
Images tell powerful stories but cannot always be trusted. Matching images back to trusted sources (attribution) enables users to make a more informed judgment of the images they encounter online. We propose a robust image hashing algorithm to perform such matching. Our hash is sensitive to manipulation of subtle, salient visual details that can substantially change the story told by an image. Yet...Show More
ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity
Dan Ruta;Saeid Motiian;Baldo Faieta;Zhe Lin;Hailin Jin;Alex Filipkowski;Andrew Gilbert;John Collomosse
2021 IEEE/CVF International Conference on Computer Vision (ICCV)
Year: 2021 | Conference Paper |
Cited by: Papers (15)
We present ALADIN (All Layer AdaIN); a novel architecture for searching images based on the similarity of their artistic style. Representation learning is critical to visual search, where distance in the learned search embedding reflects image similarity. Learning an embedding that discriminates fine-grained variations in style is hard, due to the difficulty of defining and labelling style. ALADIN...Show More
Scene Designer: a Unified Model for Scene Search and Synthesis from Sketch
Leo Sampaio Ferraz Ribeiro;Tu Bui;John Collomosse;Moacir Ponti
2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)
Year: 2021 | Conference Paper |
Cited by: Papers (2)
Scene Designer is a novel method for searching and generating images using free-hand sketches of scene compositions; i.e. drawings that describe both the appearance and relative positions of objects. Our core contribution is a single unified model to learn both a cross-modal search embedding for matching sketched compositions to images, and an object embedding for layout synthesis. We show that a ...Show More
Magic Layouts: Structural Prior for Component Detection in User Interface Designs
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Year: 2021 | Conference Paper |
Cited by: Papers (1)
We present Magic Layouts; a method for parsing screen-shots or hand-drawn sketches of user interface (UI) layouts. Our core contribution is to extend existing detectors to exploit a learned structural prior for UI designs, enabling robust detection of UI components; buttons, text boxes and similar. Specifically we learn a prior over mobile UI layouts, encoding common spatial co-occurrence relation...Show More
Deep Image Comparator: Learning to Visualize Editorial Change
Alexander Black;Tu Bui;Hailin Jin;Vishy Swaminathan;John Collomosse
2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2021 | Conference Paper |
Cited by: Papers (6)
We present a novel architecture for comparing a pair of images to identify image regions that have been subjected to editorial manipulation. We first describe a robust near-duplicate search, for matching a potentially manipulated image circulating online to an image within a trusted database of originals. We then describe a novel architecture for comparing that image pair, to localize regions that...Show More
Sketchformer: Transformer-Based Representation for Sketched Structure
Leo Sampaio Ferraz Ribeiro;Tu Bui;John Collomosse;Moacir Ponti
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Year: 2020 | Conference Paper |
Cited by: Papers (53)
Sketchformer is a novel transformer-based representation for encoding free-hand sketches input in a vector form, i.e. as a sequence of strokes. Sketchformer effectively addresses multiple tasks: sketch classification, sketch based image retrieval (SBIR), and the reconstruction and interpolation of sketches. We report several variants exploring continuous and tokenized input representations, and co...Show More
Tamper-Proofing Video With Hierarchical Attention Autoencoder Hashing on Blockchain
Tu Bui;Daniel Cooper;John Collomosse;Mark Bell;Alex Green;John Sheridan;Jez Higgins;Arindra Das;Jared Robert Keller;Olivier Thereaux
IEEE Transactions on Multimedia
Cited by: Papers (17)
We present ARCHANGEL; a novel distributed ledger based system for assuring the long-term integrity of digital video archives. First, we introduce a novel deep network architecture using a hierarchical attention autoencoder (HAAE) to compute temporal content hashes (TCHs) from minutes or hour-long audio-visual streams. Our TCHs are sensitive to accidental or malicious content modification (tamperin...Show More
Inpainting of Wide-Baseline Multiple Viewpoint Video
Andrew Gilbert;Matthew Trumble;Adrian Hilton;John Collomosse
We describe a non-parametric algorithm for multiple-viewpoint video inpainting. Uniquely, our algorithm addresses the domain of wide baseline multiple-viewpoint video (MVV) with no temporal look-ahead in near real time speed. A Dictionary of Patches (DoP) is built using multi-resolution texture patches reprojected from geometric proxies available in the alternate views. We dynamically update the D...Show More
ARCHANGEL: Tamper-Proofing Video Archives Using Temporal Content Hashes on the Blockchain
Tu Bui;Daniel Cooper;John Collomosse;Mark Bell;Alex Green;John Sheridan;Jez Higgins;Arindra Das;Jared Keller;Olivier Thereaux;Alan Brown
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
Year: 2019 | Conference Paper |
Cited by: Papers (16)
We present ARCHANGEL; a novel distributed ledger based system for assuring the long-term integrity of digital video archives. First, we describe a novel deep network architecture for computing compact temporal content hashes (TCHs) from audio-visual streams with durations of minutes or hours. Our TCHs are sensitive to accidental or malicious content modification (tampering) but invariant to the co...Show More
An Internal Learning Approach to Video Inpainting
Haotian Zhang;Long Mai;Hailin Jin;Zhaowen Wang;Ning Xu;John Collomosse
2019 IEEE/CVF International Conference on Computer Vision (ICCV)
Year: 2019 | Conference Paper |
Cited by: Papers (48)
We propose a novel video inpainting algorithm that simultaneously hallucinates missing appearance and motion (optical flow) information, building upon the recent 'Deep Image Prior' (DIP) that exploits convolutional network architectures to enforce plausible texture in static images. In extending DIP to video we make two important contributions. First, we show that coherent video inpainting is poss...Show More
LiveSketch: Query Perturbations for Guided Sketch-Based Visual Search
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Year: 2019 | Conference Paper |
Cited by: Papers (38)
LiveSketch is a novel algorithm for searching large image collections using hand-sketched queries. LiveSketch tackles the inherent ambiguity of sketch search by creating visual suggestions that augment the query as it is drawn, making query specification an iterative rather than one-shot process that helps disambiguate users' search intent. Our technical contributions are: a triplet convnet archit...Show More
TAPESTRY: Visualizing Interwoven Identities for Trust Provenance
Yifan Yang;John Collomosse;Arthi Kanchana Manohar;Jo Briggs;Jamie Steane
2018 IEEE Symposium on Visualization for Cyber Security (VizSec)
Year: 2018 | Conference Paper |
Cited by: Papers (5)
In this paper we report our study involving an early prototype of TAPESTRY, a service to support people and businesses to connect safely online through the use of a Machine Learning generated visualization. Establishing the veracity of the person or business behind a pseudonomized identity, online, is a challenge for many people. In the burgeoning digital economy, finding ways to support good deci...Show More
Disentangling Structure and Aesthetics for Style-Aware Image Completion
2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition
Year: 2018 | Conference Paper |
Cited by: Papers (10)
Content-aware image completion or in-painting is a fundamental tool for the correction of defects or removal of objects in images. We propose a non-parametric in-painting algorithm that enforces both structural and aesthetic (style) consistency within the resulting image. Our contributions are two-fold: (1) we explicitly disentangle image structure and style during patch search and selection to en...Show More
Real-Time Full-Body Motion Capture from Video and IMUs
Charles Malleson;Andrew Gilbert;Matthew Trumble;John Collomosse;Adrian Hilton;Marco Volino
2017 International Conference on 3D Vision (3DV)
Year: 2017 | Conference Paper |
Cited by: Papers (70)
A real-time full-body motion capture system is presented which uses input from a sparse set of inertial measurement units (IMUs) along with images from two or more standard video cameras and requires no optical markers or specialized infra-red cameras. A real-time optimization-based framework is proposed which incorporates constraints from the IMUs, cameras and a prior pose model. The combination ...Show More
IEEE Account
Purchase Details
Profile Information
Need Help?
- US & Canada: +1 800 678 4333
- Worldwide: +1 732 981 0060
- Contact & Support
- About IEEE Xplore
- Contact Us
- Help
- Accessibility
- Terms of Use
- Nondiscrimination Policy
- Sitemap
- Privacy & Opting Out of Cookies
A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity.
© Copyright 2025 IEEE - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.