删除或更新信息，请邮件至freekaoyan#163.com(#换成@)

基于词序列拼积木模型的图像句子标注研究

本站小编 Free考研考试/2021-12-21
本文二维码信息
二维码（扫一下试试看！）
基于词序列拼积木模型的图像句子标注研究
Image Annotation by Sentences Based on Word Sequence Blocks Building Model
投稿时间：2016-07-25
DOI：10.15918/j.tbit1001-0645.2017.11.07
中文关键词:自然语言生成词序列拼积木WSBB图像句子标注N元词序列语义相关性句法模式约束
English Keywords:natural language generationword sequence blocks building(WSBB)image annotation by sentencesN gram word sequencesemantic correlationsyntactic mode constraints
基金项目:国家自然科学基金资助项目（61373108，61173062）；教育部人文社科基金资助项目（16YJAZH029，17YJAZH117）；江西省科技厅科技攻关项目（20142BBG70011）；江西省社科规划基金资助项目（16TQ02）；江西省高校人文社科基金资助项目（XW1502、TQ1503）；江西省教育厅科技项目（GJJ160497，GJJ160509，GJJ160531）；江西省研究生创新基金（YC2016-S262）
作者单位
张红斌华东交通大学 软件学院, 江西, 南昌 330013
殷依华东交通大学 软件学院, 江西, 南昌 330013
姬东鸿武汉大学 计算机学院, 湖北, 武汉 430072
任亚峰武汉大学 计算机学院, 湖北, 武汉 430072
摘要点击次数:512
全文下载次数:489
中文摘要:
用句子标注图像，建立图像与文本间的跨媒体关联，以提升信息检索准确率，改善用户检索交互体验.利用KDES模型抽取图像特征，在多核学习模型中融合出MK-KDES特征，准确刻画图像视觉特性；设计自然语言生成模型：词序列拼积木，评估单词与图像内容的相关性，优选单词，并根据单词间的语义相关性与句法模式约束，将单词组合成N元词序列；把N元词序列输入模板生成句子.结果表明：MK-KDES-1特征聚焦于图像的纹理及形状视觉特性，它是改善句子BLEU-1评分的关键；而单词间的语义相关性与句法模式约束是提升句子BLEU-2评分的重要前提.
English Summary:
Based on image annotation by sentences, the cross-media correlations between the images and the texts were constructed to improve the information retrieval accuracy and users' retrieval experiences ultimately. The KDES model was applied to extract image features effectively and the MK-KDES features were obtained in turn by fusing the extracted features in the multiple kernel learning model to interpret the key visual characteristics of the images. A new natural language generation model named word sequence blocks building (WSBB) was designed to evaluate the semantic correlations between the words and the images. And several key words were summarized for generating sentences. According to the semantic correlations and syntactic mode constraints between words, many N gram word sequences were made up of those summarized words to better interpret the images. Finally, sentences were generated by inputting the N gram word sequences into the templates. Experimental results show that, the MK-KDES-1 feature can focus on describing the key texture and shape characteristics of the images, which helps to improve the BLEU-1 scores. Moreover, semantic correlation between the words is an important premise of improving the BLEU-2 scores as well as the syntactic mode constraints.
查看全文查看/发表评论下载PDF阅读器
相关话题/图像 华东交通大学 软件学院 江西 武汉大学

Free考研考试FreeKaoYan.Com
欢迎来到Free考研考试，"为实现人生的Free而奋斗"

© 2020 FreeKaoYan! . All rights reserved.