文件名称:jqfbsdukj
- 所属分类:
- .net编程
- 资源属性:
- [Windows] [Visual.Net] [源码]
- 上传时间:
- 2014-01-22
- 文件大小:
- 582kb
- 下载次数:
- 0次
- 提 供 者:
- gis-*****
- 相关连接:
- 无
- 下载说明:
- 别用迅雷下载,失败请重下,重下不扣分!
介绍说明--下载内容均来自于网络,请自行研究使用
集群分布式多进程GP调度框架
我们经常会利用ArcGIS GP工具来进行一些大规模数据批处理工作,但是由于GP其实也是调用底层基于COM的AO,多线程的效率往往体现不出来,因为大家知道ArcGIS Engine GP是无法在多线程环境下高效稳定运行的,特别是当需要处理大规模数据集时,基于单台机器单进程程序就无法解决了。
本调度程序能够解决单一机器单进程调用效率低的问题,特别是基于COM的应用程序,本程序有以下特点。
1、 多机器进去调度器
2、 多进程调度
3、 能够解决GP不支持多线程调用的问题
集群分布式多进程GP框架提出了一个基于多机器、多进程、分布式的统一调度执行框架。也就是说,将要处理的数据由一台调度服务器去分配到多个机器、多个进程里面去并行执行,充分利用多机器,多CPU、多核的并行运算效率。
-GP distributed multi-cluster scheduling process fr a mework, we often use ArcGIS GP tools to carry out some large-scale data batch job, but because GP is actually calling the underlying COM-based AO, often reflected the efficiency of multi-threading does not come out, because we know ArcGIS Engine GP is not efficient and stable operation in a multi-threaded environment, especially when the need to process large data sets, based on a single machine single-process program can not be solved. The scheduler can solve the low efficiency of a single process on a single machine to call the question, especially COM-based applications, this program has the following characteristics. 1, 2 multiple machines into the scheduler, multi-process scheduling 3, can solve the problem GP does not support multi-threaded distributed multi-cluster call GP process execution fr a mework proposed a unified fr a mework based on multi-machine, multi-process, distributed. In other words, the data will be processed by a s
我们经常会利用ArcGIS GP工具来进行一些大规模数据批处理工作,但是由于GP其实也是调用底层基于COM的AO,多线程的效率往往体现不出来,因为大家知道ArcGIS Engine GP是无法在多线程环境下高效稳定运行的,特别是当需要处理大规模数据集时,基于单台机器单进程程序就无法解决了。
本调度程序能够解决单一机器单进程调用效率低的问题,特别是基于COM的应用程序,本程序有以下特点。
1、 多机器进去调度器
2、 多进程调度
3、 能够解决GP不支持多线程调用的问题
集群分布式多进程GP框架提出了一个基于多机器、多进程、分布式的统一调度执行框架。也就是说,将要处理的数据由一台调度服务器去分配到多个机器、多个进程里面去并行执行,充分利用多机器,多CPU、多核的并行运算效率。
-GP distributed multi-cluster scheduling process fr a mework, we often use ArcGIS GP tools to carry out some large-scale data batch job, but because GP is actually calling the underlying COM-based AO, often reflected the efficiency of multi-threading does not come out, because we know ArcGIS Engine GP is not efficient and stable operation in a multi-threaded environment, especially when the need to process large data sets, based on a single machine single-process program can not be solved. The scheduler can solve the low efficiency of a single process on a single machine to call the question, especially COM-based applications, this program has the following characteristics. 1, 2 multiple machines into the scheduler, multi-process scheduling 3, can solve the problem GP does not support multi-threaded distributed multi-cluster call GP process execution fr a mework proposed a unified fr a mework based on multi-machine, multi-process, distributed. In other words, the data will be processed by a s
(系统自动生成,下载前可以参看下载内容)
下载文件列表
NLog.dll
Solution.sln
Solution.v11.suo
WorkerClinet
............\App.config
............\FileOperation.cs
............\IWorerCommiter.cs
............\NLog.config
............\Properties
............\..........\AssemblyInfo.cs
............\TarFileWatcher.cs
............\WCFClient.cs
............\WorkerCommitClinet.csproj
............\WorkerCommiter.cs
............\YourJob.cs
............\bin
............\...\Debug
............\obj
............\...\Debug
............\...\.....\DesignTimeResolveAssemblyReferencesInput.cache
............\...\.....\TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
............\...\.....\TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
............\...\.....\TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
............\...\.....\WorkerClinet.csproj.FileListAbsolute.txt
............\...\.....\WorkerClinet.csprojResolveAssemblyReference.cache
............\...\.....\WorkerClinet.exe
............\...\.....\WorkerClinet.pdb
............\...\.....\WorkerCommitClinet.csproj.FileListAbsolute.txt
............\...\.....\WorkerCommitClinet.csprojResolveAssemblyReference.cache
............\...\.....\WorkerCommitClinet.exe
............\...\.....\WorkerCommitClinet.pdb
WorkerEntities
..............\IProcessManagerService.cs
..............\IProcessorReportService.cs
..............\IProcessorStratInfoService.cs
..............\IWCFMSMQService.cs
..............\IWCFServices.cs
..............\IWorkerAssign.cs
..............\IWorkerServerConnection.cs
..............\IWrokerServer.cs
..............\JobParameter.cs
..............\ProcessorEntity.cs
..............\Properties
..............\..........\AssemblyInfo.cs
..............\SPI
..............\...\IJobSPI.cs
..............\WorkerEntities.csproj
..............\bin
..............\...\Debug
..............\obj
..............\...\Debug
..............\...\.....\DesignTimeResolveAssemblyReferencesInput.cache
..............\...\.....\TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
..............\...\.....\TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
..............\...\.....\TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
..............\...\.....\WorkerEntities.csproj.FileListAbsolute.txt
..............\...\.....\WorkerEntities.dll
..............\...\.....\WorkerEntities.pdb
WorkerInstance
..............\App.config
..............\Client.cs
..............\GPJob.cs
..............\Program.cs
..............\Properties
..............\..........\AssemblyInfo.cs
..............\WorkerInstance.csproj
..............\bin
..............\...\Debug
..............\gp
..............\..\AEInit.cs
..............\..\AEUtil.cs
..............\..\FileParameter.cs
..............\..\GPUtil.cs
..............\..\InterpolationToolsFacotry.cs
..............\..\Setting.cs
..............\..\SpatialOperation.cs
..............\obj
..............\...\Debug
..............\...\.....\DesignTimeResolveAssemblyReferencesInput.cache
..............\...\.....\TemporaryGeneratedFile_036C0B5B-1481-4323-8D20-8F5ADCB23D92.cs
..............\...\.....\TemporaryGeneratedFile_5937a670-0e60-4077-877b-f7221da3dda1.cs
..............\...\.....\TemporaryGeneratedFile_E7A71F73-0F8D-4B9B-B56E-8E70B10BC5D3.cs
..............\...\.....\WorkerInstance.csproj.FileListAbsolute.txt
..............\...\.....\WorkerInstance.csprojResolveAssemblyReference.cache
..............\...\.....\WorkerInstance.dll
..............\...\.....\WorkerInstance.pdb
WorkerProcessManage
...................\App.config
...................\Command.cs
...................\IReportResult.cs
...................\Job
...................\...\Client
...................\...\......\ClientProxy.cs
...................\...\JobStartManager.cs
...................\...\ProcessManagerService.cs
...................\...\ProcessorReportService.cs
...................\...\RPCServer.cs
...................\...\RPCServerConnection.cs
...................\...\ReporServerConnection.cs
...................\...\WrokApply.cs