astromodule.pipeline.Pipeline#

class Pipeline[source]#

A simple linear pipeline implementation with mapping and multiprocessing support.

Parameters:
*stages: PipelineStage

The stages of the pipeline

verbose: bool, optional

The verbosity flag, by default True.

Attributes:
storage: PipelineStorage

The object used to share resources between all pipeline stages

Methods

get_stages_requirements()

Use code inspection to find required resources based in the assignature of PipelineStage.run method.

map_run(key, array[, workers, validate])

Validates and executes all pipeline steps in a similar way to the run method, but using multiprocessing.

plot()

Plot the pipeline graph

run([validate])

Validates and executes all stages of the pipeline

set_stages_requirements(requirements)

Sets requirements attribute for all pipeline stages

validate([ignore])

Validates the pipeline by checking whether all requirements for all stages are satisfied

classmethod __new__(*args, **kwargs)#