Key Technology of Distributed Geospatial Information Operation
-
摘要: 为了提高分布式环境下海量空间数据的空间运算的效率，解决空间分析处理模块在设计上与底层的数据库服务协议、空间数据模型等透明一致的设计问题.分析了分布式空间运算具备的基本特征，从空间运算任务分解和分布式空间数据的划分方法、共享数据复制策略、基于负载的数据划分策略和空间运算框架的缓存机制等几个方面讨论分布式空间信息的运算技术体系，并提出现阶段可行的实现框架.基于本框架开发的系统用于实际应用中，较好地解决了分布式环境下的大规模复杂空间数据运算的效率问题.以分布式环境下的经典空间运算为例进行的试验表明：该框架设计新颖，提高了空间运算效率.Abstract: In order to improve spatial operation efficiency of massive data in distributed environment and to solve the interactive design problems of spatial analysis processing module designed to service agreement with the underlying database, spatial data models and so on. The basic characteristics of distributed computing are analyzed in this paper. The authors of this paper discuss the distributed computing spatial information technology system form the following aspects: apace computing task decomposition, distributed spatial data classification method, sharing data replication strategy, the data partitioning strategy based on the load and the caching mechanism of space computing framework. Based on this framework, the authors have developed the system for solving the practical problems, and solved the efficiency of large-scale spatial data operations in the complex distributed environment. At last, the distributed computing environment test of the classic space experiments has shown that, the framework is a design novelty, and can greatly reduce the spatial computing time in the distributed environments.
-
图 1 分布式环境下的空间数据裁剪运算策略
Fig. 1. The method of clipping spatial data in distributed environment
图 2 Master-worker模式下基于SDSS的动态负载调度
Fig. 2. Dynamic load attemper based on SDSS in master-worker model
图 4 分布式矢量空间分析运算服务平台结构
Fig. 4. Structure map of workstation for distributed spatial vector data analysis
表 1 服务节点配置情况
Table 1. The configure of service nodes
节点名称 IP地址 作用 node1 192.168.83.1 任务管理节点 node2 192.168.83.2 分布式节点 node3 192.168.83.3 分布式节点 node4 192.168.83.4 分布式节点 node5 192.168.83.5 分布式节点 node6 192.168.83.6 分布式节点 node7 192.168.83.7 分布式节点 node8 192.168.83.8 分布式节点 
下载: 导出CSV
表 2 测试数据
Table 2. The data for testing
序号 内容 类型 数量 1 居民点 点 2×104 2 居民点 点 6×105 3 国道 线 5×104 4 省道 线 8×104 5 县乡道 线 3×105 6 等高线 线 4×106 7 道路 线 7×103 8 省域 面 3×102 9 县域 面 3×103 10 土地覆盖 面 3×104 11 土地利用 面 2×105 12 土地利用 面 3×106
下载: 导出CSV
-
[1] Cai, D., 2004. A study on the computing models for spatial analysis in the GRID computing environment (Dissertation). East China Normal University, Shanghai (in Chinese). [2] Fang, Y., Wu, L., Xie, K.Q., et al., 2006. Research on distributed and cooperating GIS. Geography and Geo-Information Science, 22(3): 9-12, 54 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DLGT200603001.htm [3] Fu, Z.X., 2006. Research and implement of master-worker computation in grid (Dissertation). Fuzhou University, Fuzhou (in Chinese). [4] Gao, G.Y., 2004. Distributed geographic information system (Dissertation). Zhejiang University, Hangzhou (in Chinese). [5] Ma, X.J., Liu, C., Xie, K.Q., et al., 2006. A research on global spatial data directory in peer-to-peer networks. Geography and Geo-Information Science, 22(3): 22-25 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DLGT200603004.htm [6] Qian, W.N., 2003. Data management in peer-to-peer systems (Dissertation). Fudan University, Shanghai (in Chinese). [7] Qiu, T.Q., Chen, G.H., 2007. A generic approach to making P2P overlay network topology-aware. Journal of Software, 18(2): 381-390 (in Chinese with English abstract). doi: 10.1360/jos180381 [8] Wu, C.H., Meng, L.K., Deng, S.J., 2005. A new type of distributed GIS model. Computer Engineering and Applications, 8: 207-209 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-JSGG200508063.htm [9] Wu, X.C., 2009. Datacenter integration development technology: the next generation GIS architecture and development model. Earth Science—Journal of China University of Geosciences, 31(5): 624-630 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DQKX200903020.htm [10] Wu, X.C., Wu, L., 2006. Service-oriented distributed spatial information supporting system. Earth Science—Journal of China University of Geosciences, 31(5): 585-589 (in Chinese with English abstract). [11] Xu, S.W., Xie, Z., Huang, Z.C., 2006. Research and design of isomerism distributed multilevel spatial data center. Earth Science—Journal of China University of Geosciences, 31(5): 624-630 (in Chinese with English abstract). http://en.cnki.com.cn/Article_en/CJFDTOTAL-DQKX200605009.htm [12] Yang, F., Li, F.X., Yu, H.L., et al., 2007. A hybrid peer-to-peer lookup service algorithm on distributed hash table. Journal of Software, 18(3): 714-721 (in Chinese with English abstract). doi: 10.1360/jos180714 [13] 蔡砥, 2004. 网格计算环境下空间分析的计算模式研究(博士论文). 上海: 华东师范大学. [14] 方裕, 邬伦, 谢昆青, 等, 2006. 分布式协同计算的GIS技术研究. 地理与地理信息科学, 22(3): 9-12, 54. doi: 10.3969/j.issn.1672-0504.2006.03.002 [15] 付志祥, 2006. 网格环境下Master-Worker计算的研究和实现(硕士论文). 福州: 福州大学. [16] 高刚毅, 2004. 分布式地理信息系统研究(博士论文). 杭州: 浙江大学. [17] 马修军, 刘晨, 谢昆青, 等, 2006. P2P环境中的全局空间数据目录研究. 地理与地理信息科学, 22(3): 22-25. doi: 10.3969/j.issn.1672-0504.2006.03.005 [18] 钱卫宁, 2003. 对等计算系统中的数据管理(博士论文). 上海: 复旦大学. [19] 邱彤庆, 陈贵海, 2007. 一种令P2P覆盖网络拓扑相关的通用方法. 软件学报, 18(2): 381-390. https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB200702024.htm [20] 吴沉寒, 孟令奎, 邓世军, 2005. 一种新型的分布式GIS模型. 计算机工程与应用, 8: 207-209. https://www.cnki.com.cn/Article/CJFDTOTAL-JSGG200508063.htm [21] 吴信才, 2009. 数据中心集成开发技术: 新一代GIS架构技术与开发模式. 地球科学——中国地质大学学报, 34(3): 540-546. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX200903020.htm [22] 吴信才, 吴亮, 2006. 面向服务的分布式空间信息支撑平台. 地球科学——中国地质大学学报, 31(5): 585-589. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX200605001.htm [23] 徐世武, 谢忠, 黄志超, 2006. 分布式异构多级空间数据中心的研究与设计. 地球科学——中国地质大学学报, 31(5): 624-630. https://www.cnki.com.cn/Article/CJFDTOTAL-DQKX200605009.htm [24] 杨峰, 李凤霞, 余宏亮, 等, 2007. 一种基于分布式哈希表的混合对等发现算法. 软件学报, 18(3): 714-721. https://www.cnki.com.cn/Article/CJFDTOTAL-RJXB200703025.htm -
点击查看大图
图(5) / 表(2)
计量
- 文章访问数: 3107
- HTML全文浏览量: 111
- PDF下载量: 58
- 被引次数: 0
