Resource scheduling method and recognition system based on key resources and data preprocessing

基于关键资源和数据预处理的资源调度方法及识别系统

Abstract

The invention provides a resource scheduling method based on key resources and data preprocessing. The method comprises the steps of: generating a node queue in the operation execution process of clusters; selecting a target node and a preparation operation task according to the generated node queue; searching the target node through a scheduling algorithm, reading corresponding task information in the preparation operation task, and scheduling an operation in the preparation operation task according to the task information so as to execute the operation. The invention furthermore discloses a resource scheduling system based on key resources and data preprocessing. According to the method and system provided by the invention, the waiting time of submitted operations in the clusters can be shortened, the operation failure rate is reduced, the node execution efficiency is improved and the resource usage rate is improved.
本发明提供了一种基于关键资源和数据预处理的资源调度方法,包括:在集群执行作业过程中生成节点队列;根据所述生成节点队列选取目标节点以及预备作业任务;通过调度算法寻找所述目标节点,并在所述预备作业任务中读取相应的任务信息,根据所述任务信息调度所述预备作业任务中的作业进行执行。本发明还提供了一种基于关键资源和数据预处理的资源调度系统。本发明能缩短已提交作业在集群中的等待时间,降低作业的失败率,提高节点的执行效率,提高资源的使用率。

Claims

Description

Topics

Download Full PDF Version (Non-Commercial Use)

Patent Citations (0)

    Publication numberPublication dateAssigneeTitle

NO-Patent Citations (0)

    Title

Cited By (0)

    Publication numberPublication dateAssigneeTitle