Progress

The number of a run’s payloads in each state, at one moment.

Usage

Source

Progress(
    *,
    payloads,
    unsubmitted,
    pending,
    done,
    faulted,
    rejected,
    unfetched,
    written,
    uploaded,
    unuploaded,
    retries,
    elapsed
)

The six states from unsubmitted to unfetched sum to payloads. After the run’s last job, the snapshot stops changing and is the run’s summary.

Attributes

payloads: int

The run’s payloads.

unsubmitted: int

The payloads not yet sent, including those that oxy holds back.

pending: int

The payloads whose job is pending.

done: int

The payloads whose job is done.

faulted: int

The payloads whose job faulted.

rejected: int

The payloads that the API rejected, so no job exists.

unfetched: int

The payloads whose job oxy stopped checking.

written: int

The done jobs that oxy wrote to the destination.

uploaded: int

The jobs whose Cloud Storage upload succeeded.

unuploaded: int

The jobs whose Cloud Storage upload failed.

retries: int

The requests that the run sent again.

elapsed: timedelta
The time since the run started, or the run’s length once it ends.

Methods

Name Description
__str__() Return the done count, every other count that is not zero, and the elapsed time.

__str__()

Return the done count, every other count that is not zero, and the elapsed time.

Usage

Source

__str__()

oxyscraper is not affiliated with or endorsed by Oxylabs. Oxylabs and Oxy are trademarks of Oxylabs.