位置:成果数据库 > 期刊 > 期刊详情页
目标提取与哈希机制的多标签图像检索
  • ISSN号:1006-8961
  • 期刊名称:《中国图象图形学报》
  • 时间:0
  • 分类:TP391[自动化与计算机技术—计算机应用技术;自动化与计算机技术—计算机科学与技术]
  • 作者机构:国防科学技术大学并行与分布处理重点实验室,长沙410073
  • 相关基金:国家自然科学基金项目(U1435219)
中文摘要:

目的哈希是大规模图像检索的有效方法。为提高检索精度,哈希码应保留语义信息。图像之间越相似,其哈希码也应越接近。现有方法首先提取描述图像整体的特征,然后生成哈希码。这种方法不能精确地描述图像包含的多个目标,限制了多标签图像检索的精度。为此提出一种基于卷积神经网络和目标提取的哈希生成方法。方法首先提取图像中可能包含目标的一系列区域,然后用深度卷积神经网络提取每个区域的特征并进行融合,通过生成一组特征来刻画图像中的每个目标,最后再产生整幅图像的哈希码。采用Triplet Loss的训练方法,使得哈希码尽可能保留语义信息。结果在VOC2012、Flickr25K和NUSWIDE数据集上进行多标签图像检索。在ND—CG(normalized discounted cumulative gain)性能指标上,当返回图像数量为1000时,对于VOC2012,本文方法相对于DSRH(deep semantic ranking hashing)方法提高2~4个百分点,相对于ITQ—CCA(iterative quantization-canonical correlation analysis)方法能提高3~6个百分点;对于Flickr25,本文方法比DSRH方法能提高2个左右的百分点;对于NUSWIDE,本文方法相对于DSRH方法能提高4个左右的百分点。对于平均检索准确度,本文方法在NUSWIDE和Flickr25上能提高2~5个百分点。根据多项评价指标可以看出,本文方法能以更细粒度来精确地描述图像,显著提高了多标签图像检索的性能。结论本文新的特征学习模型,对图像进行细粒度特征编码是一种可行的方法,能够有效提高数据集的检索性能。

英文摘要:

Objective Hashing is an effective means for large-scale image retrieval. Preserving the semantic similarity in hash codes (i. e. , the distance between the hash codes of two images) should be small when the images are similar to improve the retrieval performance. Conventional methods first extract the overall image feature and then generate a single hash code. Such methods cannot characterize the image content for multiple objects, which results in a low accuracy of multi-label image retrieval. This study proposes a new hash generation method with object proposals. Method We propose a new deep-network-based framework to construct hash functions that learn directly from images that contain multiple labels. The model first derives a series of interesting regions that may contain objects and then generates the features of each region through deep convolutional neural networks. It finally generates a group of hash codes to describe all the objects in an iraage. The compact hash code will be generated to represent the entire image. A novel triplet-loss based training method is adopted to preserve the semantic order of the hash codes. Result The image retrieval experiments on the VOC2012, Fliekr25K, and NUSWIDE datasets show that the NDCG ( normalized discounted ct,mulative gain) value nf our method can be improved by 2% to 4% unlike DSRH (deep semantic ranking hashing) and 3% to 6% unlike ITQ-CCA ( iterative quantization-eanonical correlation analysis) on VOC2012. Our method can attain the imprnvements by approximately 2% on Fliekr25 and 4% on NUSWIDE. Our method can obtain 2% to 5% on Ihe Flickr25 and NUSWIDE datasets over Ihe DSRH for the map evaluation. Thus, the new method can describe an image accurately in a fine-grained way, and the performam'e is improved significantly for multi-label image retrieval. Conclusion This study proposes a new model to learn compact features, and experiment results show that the fine-grained feature embedding of an image is practicable. Thus, our method outperforms

同期刊论文项目
同项目期刊论文
期刊信息
  • 《数码影像》
  • 主管单位:
  • 主办单位:中国图象图形学学会 中科院遥感所 北京应用物理与计算数学研究所
  • 主编:
  • 地址:北京市海淀区花园路6号
  • 邮编:100088
  • 邮箱:
  • 电话:010-86211360 62378784
  • 国际标准刊号:ISSN:1006-8961
  • 国内统一刊号:ISSN:11-3758/TB
  • 邮发代号:
  • 获奖情况:
  • 国内外数据库收录:
  • 被引量:0