基于各类特征对齐迁移网络的多时相遥感图像分类

郭艳; 宋佳珍; 马丽; 杨敏

doi:10.3799/dqkx.2020.347

Volume 46 Issue 10

Nov. 2021

Turn off MathJax

Article Contents

Article Navigation > Earth Science > 2021 > 46(10): 3730-3739

Guo Yan, Song Jiazhen, Ma Li, Yang Min, 2021. Class-Wise Feature Alignment Based Transfer Network for Multi-Temporal Remote Sensing Image Classification. Earth Science, 46(10): 3730-3739. doi: 10.3799/dqkx.2020.347

Citation:

Guo Yan, Song Jiazhen, Ma Li, Yang Min, 2021. Class-Wise Feature Alignment Based Transfer Network for Multi-Temporal Remote Sensing Image Classification. Earth Science, 46(10): 3730-3739. doi: 10.3799/dqkx.2020.347

Citation:

PDF( 8737 KB)

Class-Wise Feature Alignment Based Transfer Network for Multi-Temporal Remote Sensing Image Classification

doi: 10.3799/dqkx.2020.347

Guo Yan^{1
,
,},
Song Jiazhen²,
Ma Li²,
Yang Min^{2
,
,}

1.
School of Computer Science, China University of Geosciences, Wuhan 430078, China
2.
School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China

Received Date: 2020-11-13
Available Online: 2021-11-03
Publish Date: 2021-11-03

Abstract

Abstract

A transfer neural network based on feature alignment is proposed for classification of multi-temporal remote sensing image. In the network, the mean vector and covariance matrix of the sample data of each class are used to describe the data distribution, and the domain shift in terms of the first and second statistics can be reduced. In addition, rectified linear unit is utilized as the activation function, which can produce sparse features and improve the classification performance. In the transfer neural network, both aligned features and adaptive classifiers can be obtained simultaneously and unsupervised domain adaptation is achieved when there is no labeled data in the target image. The experimental results of multi-temporal Hyperion hyperspectral remote sensing images and WorldView-2 multispectral remote sensing images demonstrate the effectiveness of the proposed transfer neural network.
- transfer neural network,
- classification,
- class-wise feature alignment,
- remote sensing

FullText(HTML)

References(36)

References

Bruzzone, L., Marconcini, M., 2010. Domain Adaptation Problems: A DASVM Classification Technique and a Circular Validation Strategy. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(5): 770-787. https://doi.org/10.1109/TPAMI.2009.57

Cheng, G.X., Niu, R.Q., Zhang, K.X., et al., 2018. Opencast Mining Area Recognition in High-Resolution Remote Sensing Images Using Convolutional Neural Networks. Earth Science, 43(Suppl. 2): 256-262(in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTotal-DQKX2018S2021.htm

Deng, B., Jia, S., Shi, D. M., 2020. Deep Metric Learning-Based Feature Embedding for Hyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 58(2): 1422-1435. https://doi.org/10.1109/TGRS.2019.2946318

Ganin, Y., Ustinova, E., Ajakan, H., et al., 2017. Domain-Adversarial Training of Neural Networks. Domain Adaptation in Computer Vision Applications. Springer International Publishing, Cham, 189-209. https://doi.org/10.1007/978-3-319-58347-1_10

Gao, C.X., Sang, N., 2014. Deep Learning for Object Detection in Remote Sensing Image. Bulletin of Surveying and Mapping, (S1): 108-111(in Chinese with English abstract). http://search.cnki.net/down/default.aspx?filename=CHTB2014S1025&dbcode=CJFD&year=2014&dflag=pdfdown

Glorot, X., Bordes, A., Bengio, Y., 2011. Deep Sparse Rectifier Neural Networks. In: Gordon, G. J., Dunson, D. B., Dudík, M., eds., Proceedings of International Conference on 14th Artificial Intelligence and Statistics, AISTATS 2011. JMLR, Cambridge, 315-323.

Jhuo, I. H., Liu, D., Lee, D.T., et al., 2012. Robust Visual Domain Adaptation with Low-Rank Reconstruction. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2012. IEEE Computer Society, Los Alamitos, 2168-2175. https://doi.org/10.1109/CVPR.2012.6247924

Li, W.K., Zhang, W., Qin, J.H., et al., 2020. "Expansion-Fusion" Extraction of Surface Gully Area Based on DEM and High-Resolution Remote Sensing Images. Earth Science, 45(6): 1948-1955(in Chinese with English abstract).

Li, Z. K., Tang, X. Y., Li, W., et al., 2020. A Two-Stage Deep Domain Adaptation Method for Hyperspectral Image Classification. Remote Sensing, 12(7): 1054-1073. https://doi.org/10.3390/rs12071054

Liu, D.W., Han, L., Han, X.Y., 2016. High Spatial Resolution Remote Sensing Image Classification Based on Deep Learning. Acta Optica Sinica, 36(4): 0428001(in Chinese with English abstract). doi: 10.3788/AOS201636.0428001

Liu, Z.X., Ma, L., Du, Q., 2020. Class-Wise Distribution Adaptation for Unsupervised Classification of Hyperspectral Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, 59(1): 508-521. https://doi.org/10.1109/TGRS.2020.2997863

Ma, L., Crawford, M. M., Zhu, L., et al., 2019. Centroid and Covariance Alignment-Based Domain Adaptation for Unsupervised Classification of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, 57(4): 2305-2323. https://doi.org/10.1109/TGRS.2018.2872850

Matasci, G., Volpi, M., Kanevski, M., et al., 2015. Semisupervised Transfer Component Analysis for Domain Adaptation in Remote Sensing Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 53(7): 3550-3564. doi: 10.1109/TGRS.2014.2377785

Pan, S. J., Yang, Q., 2010. A Survey on Transfer Learning. IEEE Transactions on Knowledge and Data Engineering, 22(10): 1345-1359. https://doi.org/10.1109/TKDE.2009.191

Rajan, S., Ghosh, J., Crawford, M.M., 2006. Exploiting Class Hierarchies for Knowledge Transfer in Hyperspectral Data. IEEE Transactions on Geoscience and Remote Sensing, 44(11): 3408-3417. https://doi.org/10.1109/TGRS.2006.878442

Sun, H., Liu, S., Zhou, S. L., et al., 2016. Transfer Sparse Subspace Analysis for Unsupervised Cross-View Scene Model Adaptation. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 9(7): 2901-2909. https://doi.org/10.1109/JSTARS.2015.2500961

Sun, Z., Wang, C., Wang, H. Y., et al., 2013. Learn Multiple-Kernel SVMS for Domain Adaptation in Hyperspectral Data. IEEE Geoscience and Remote Sensing Letters, 10(5): 1224-1228. https://doi.org/10.1109/LGRS.2012.2236818

Sun, B. C., Feng, J. S., Saenko, K., 2017. Correlation Alignment for Unsupervised Domain Adaptation. In: Advances in Computer Vision and Pattern Recognition, Springer, Berlin, 153-171. https://doi.org/10.1007/978-3-319-58347-1_8

Tong, X. Y., Xia, G. S., Lu, Q. K., et al., 2020. Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Models. Remote Sensing of Environment, 237: 111322. https://doi.org/10.1016/j.rse.2019.111322

Vakalopoulou, M., Karantzalos, K., Komodakis, N., et al., 2015. Building Detection in Very High Resolution Multispectral Data with Deep Learning Features. In: Proceedings of IEEE International Geoscience and Remote Sensing Symposium (IGARSS). IEEE, Milan, Italy, 1873-1876. https://doi.org/10.1109/IGARSS.2015.7326158

Wang, M., Deng, W. H., 2018. Deep Visual Domain Adaptation: A Survey. Neurocomputing, 312: 135-153. https://doi.org/10.1016/j.neucom.2018.05.083

Wang, Z. M., Du, B., Shi, Q., et al., 2019. Domain Adaptation with Discriminative Distribution and Manifold Embedding for Hyperspectral Image Classification. IEEE Geoscience and Remote Sensing Letters, 16(7): 1155-1159. https://doi.org/10.1109/LGRS.2018.2889967

Xing, C., Ma, L., Yang, X. Q., 2016. Stacked Denoise Autoencoder Based Feature Extraction and Classification for Hyperspectral Images. Journal of Sensors, 2016: 1-10. https://doi.org/10.1155/2016/3632943

Yang, H. L., Crawford, M. M., 2015. Spectral and Spatial Proximity-Based Manifold Alignment for MultitemporalHyperspectral Image Classification. IEEE Transactions on Geoscience and Remote Sensing, 54(1): 51-64. https://doi.org/10.1109/TGRS.2015.2449736

Yeh, Y. R., Huang, C. H., Wang, Y. C., 2014. Heterogeneous Domain Adaptation and Classification by Exploiting the Correlation Subspace. IEEE Transactions on Image Processing, 23(5): 2009-2018. https://doi.org/10.1109/tip.2014.2310992

Zhang, B.Y., Liu, Y.Y., Yuan, H.W., et al., 2018. A Joint Unsupervised Cross-Domain Model via Scalable Discriminative Extreme Learning Machine. Cognitive Computation, 10(4): 577-590. https://doi.org/10.1007/s12559-018-9555-z

Zhang, F., Du, B., Zhang, L.P., 2016. Scene Classification via a Gradient Boosting Random Convolutional Network Framework. IEEE Transactions on Geoscience and Remote Sensing, 54(3): 1793-1802. https://doi.org/10.1109/TGRS.2015.2488681

Zhang, L., 2019. Transfer Adaptation Learning: A Decade Survey. In: Computing Research Repository. arXiv preprint. arXiv: abs/1903.04687

Zhang, X., Yu, F. X., Chang, S. F., et al., 2015. Deep Transfer Network: Unsupervised Domain Adaptation: arXiv: 1503.00591[cs. CV]. https://arxiv.org/abs/1503.00591

Zheng, G.Z., Le, X.D., Wang, H.P., et al., 2017. Inversion of Water Depth from WorldView-02 Satellite Imagery Based on BP and RBF Neural Network. Earth Science, 42(12): 2345-2353(in Chinese with English abstract). http://www.researchgate.net/publication/322615468_Inversion_of_Water_Depth_from_WorldView-02_Satellite_Imagery_Based_on_BP_and_RBF_Neural_Network

Zhuang, F., Cheng, X., Luo, P., 2015. Supervised Representation Learning: Transfer Learning with Deep Autoencoders. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence, IJCAI 2015. AAAI Press, Palo Alto CA, 4119-4125.

程国轩, 牛瑞卿, 张凯翔, 等, 2018. 基于卷积神经网络的高分遥感影像露天采矿场识别. 地球科学, 43(增刊2): 256-262. doi: 10.3799/dqkx.2018.987

高常鑫, 桑农, 2014. 基于深度学习的高分辨率遥感影像目标检测. 测绘通报, (S1): 108-111. https://www.cnki.com.cn/Article/CJFDTOTAL-CHTB2014S1025.htm

李文凯, 张唯, 秦家豪, 等, 2020. 基于DEM和高分辨率遥感影像的"膨胀-融合"式地表沟壑提取. 地球科学, 45(6): 1948-1955. doi: 10.3799/dqkx.2020.004

刘大伟, 韩玲, 韩晓勇, 2016. 基于深度学习的高分辨率遥感影像分类研究. 光学学报, 36(4): 0428001. https://www.cnki.com.cn/Article/CJFDTOTAL-GXXB201604039.htm

郑贵洲, 乐校冬, 王红平, 等, 2017. 基于WorldView-02高分影像的BP和RBF神经网络遥感水深反演. 地球科学, 42(12): 2345-2353. doi: 10.3799/dqkx.2017.552

Relative Articles

Supplements(0)

Cited By

Proportional views

Proportional views

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142

Figures(5) / Tables(3)

Get Citation

PDF

XML

Article views (467) PDF downloads(33)

Class-Wise Feature Alignment Based Transfer Network for Multi-Temporal Remote Sensing Image Classification

doi: 10.3799/dqkx.2020.347

Abstract

References

Proportional views

Catalog

通讯作者: 陈斌, bchen63@163.com

Proportional views

Export File

Citation

Format

Content