Data collecting method and ETL assembly

一种数据采集方法以及etl组件

Abstract

The embodiment of the invention discloses a data collecting method and an ETL assembly. The method comprises the steps that the when a data collecting period is reached, the current system time of a system is determined; according to the current system time and preset delay duration, the timestamp upper limit is figured out; according to the figured-out timestamp upper limit and preset first collection duration, the timestamp lower limit is figured out; data in time ranges marked by the timestamp upper limit and the timestamp lower limit in each service system is collected. By applying the data collecting method, data collection omitting can be avoided, and data collection integrity is improved.
本发明实施例公开了一种数据采集方法以及ETL组件,所述方法包括:数据采集周期到达时,确定本系统的当前系统时间;根据所述当前系统时间,以及预设的延迟时长计算出时间戳上限;根据计算出的时间戳上限,以及预设的第一采集时长计算时间戳下限;采集各业务系统中所述时间戳上限与时间戳下限所标示的时间范围内的数据。应用本发明,可以避免漏掉采集数据,提高数据采集的完整性。

Claims

Description

Topics

Download Full PDF Version (Non-Commercial Use)

Patent Citations (0)

    Publication numberPublication dateAssigneeTitle

NO-Patent Citations (0)

    Title

Cited By (0)

    Publication numberPublication dateAssigneeTitle