Deep Unsupervised Weighted Hashing for Remote Sensing Image Retrieval

Deep Unsupervised Weighted Hashing for Remote Sensing Image Retrieval

Weipeng Jing, Zekun Xu, Linhui Li, Jian Wang, Yue He, Guangsheng Chen
Copyright: © 2022 |Pages: 19
DOI: 10.4018/JDM.306188
Article PDF Download
Open access articles are freely available for download

Abstract

Deep unsupervised hashing methods are gaining attention in the field of remote sensing (RS) image retrieval due to the rapid growth in the volume of unlabeled RS data. Most previous unsupervised hashing research used only natural image-based pre-trained models to generate label matrices; however, this method cannot capture the semantic information of RS images well and limits the accuracy of retrieval. To solve this problem, the authors propose a deep unsupervised weighted hashing (DUWH) model that uses a similarity matrix updating strategy based on a weighted similarity structure to achieve the mutual optimization of the similarity matrix and hash network. The authors devise a novel combinatorial loss function to improve the hash performance that can be used to obtain higher quality hash codes by assigning different weights to the sample pairs with different difficulties. Experiments were conducted on two RS datasets to verify the excellent performance of the proposed method.
Article Preview
Top

Introduction

In recent years, remote sensing (RS) observation technology has developed rapidly, harvesting vast amounts of unprocessed RS images in the global region. Therefore, how to retrieve the required images accurately and efficiently in a large-scale RS image database has become an increasingly noteworthy direction (Tang et al., 2018). Although content-based image retrieval (CBIR) methods have made good research progress in the fields of medical images, traditional images, and video images, there are fewer techniques for content-based remote sensing image retrieval (CBRSIR). CBRSIR mainly includes the extraction of effective features and metrics of inter-image similarity (Demir & Bruzzone, 2014; Lu & Man, 2013). The representative features of RS images are extracted validly, and all similar images are retrieved by measuring the similarity between the query image and the target image. Among them, the hash-based approximate nearest neighbor search method has been widely used because of its high query efficiency and low storage cost (Indyk & Motwani, 1998). The hash algorithm in image retrieval represents the useful features of RS images as a series of binary hash codes, so as to come to reduce the search cost.

Generally, there are broadly two types of image-based hashing methods: supervised hashing and unsupervised hashing. The supervised method mainly combines the feature vector information of the data and the labeled similarity information between data to learn the hash function. Currently, most of the work still revolves around supervised hash learning, and representative methods include supervised discrete hashing (SDH) (Shen et al., 2015), fast supervised hashing (FastH) (Lin et al., 2014), ranking-based supervised hashing (RSH) (Wang et al., 2013), and deep supervised hashing. However, the production of high-quality label information needs significant cost and manual labor in practical application. The unsupervised hashing method does not utilize any supervised information but uses the internal information of all images alone for hash learning. Representative methods include spectral hashing (SH) (Weiss et al., 2008), shift-invariant kernelized locality-sensitive hashing (SKLSH) (Raginsky & Lazebnik, 2009), iterative quantization hashing (ITQ) (Gong et al., 2012), and unsupervised hashing based on deep learning. Unsupervised hashing is simple and easy to implement in the learning process because the label information is not used, which saves the cost of data annotation. In reality, most RS data have no semantic labels, so unsupervised hashing is more effective in future practical applications, which is also the focus of this work.

At present the depth network’s strong fitting ability has become an effective means to extract influence features from the unsupervised hash. Since data has no label information, how to accurately construct the semantic similarity structure between data is still an open problem. Some methods use machine learning methods to construct pseudo-labels as a way to learn similarities, however, the semantic information is weak in pseudo-labels and cannot reach satisfactory performance results (Dong et al., 2020; Hu et al., 2017; Song et al., 2015). Shen et al. (2018) adopted the model and pseudo-label alternate optimization method to update the data similarity graph for the first time; the construction method has a large localization, which affects the search performance. In the traditional image domain, Lin et al. (2021) used a pre-trained CNN model to obtain the initial label matrix, and excavated the potential neighbor relations behind the features during the training process, then updated the similarity pairs in the labels.

Complete Article List

Search this Journal:
Reset
Volume 35: 1 Issue (2024)
Volume 34: 3 Issues (2023)
Volume 33: 5 Issues (2022): 4 Released, 1 Forthcoming
Volume 32: 4 Issues (2021)
Volume 31: 4 Issues (2020)
Volume 30: 4 Issues (2019)
Volume 29: 4 Issues (2018)
Volume 28: 4 Issues (2017)
Volume 27: 4 Issues (2016)
Volume 26: 4 Issues (2015)
Volume 25: 4 Issues (2014)
Volume 24: 4 Issues (2013)
Volume 23: 4 Issues (2012)
Volume 22: 4 Issues (2011)
Volume 21: 4 Issues (2010)
Volume 20: 4 Issues (2009)
Volume 19: 4 Issues (2008)
Volume 18: 4 Issues (2007)
Volume 17: 4 Issues (2006)
Volume 16: 4 Issues (2005)
Volume 15: 4 Issues (2004)
Volume 14: 4 Issues (2003)
Volume 13: 4 Issues (2002)
Volume 12: 4 Issues (2001)
Volume 11: 4 Issues (2000)
Volume 10: 4 Issues (1999)
Volume 9: 4 Issues (1998)
Volume 8: 4 Issues (1997)
Volume 7: 4 Issues (1996)
Volume 6: 4 Issues (1995)
Volume 5: 4 Issues (1994)
Volume 4: 4 Issues (1993)
Volume 3: 4 Issues (1992)
Volume 2: 4 Issues (1991)
Volume 1: 2 Issues (1990)
View Complete Journal Contents Listing