astromodule.pipeline.Pipeline#
- class Pipeline[source]#
A simple linear pipeline implementation with mapping and multiprocessing support.
- Parameters:
- *stages: PipelineStage
The stages of the pipeline
- verbose: bool, optional
The verbosity flag, by default True.
- Attributes:
- storage: PipelineStorage
The object used to share resources between all pipeline stages
Methods
Use code inspection to find required resources based in the assignature of
PipelineStage.run
method.map_run
(key, array[, workers, validate])Validates and executes all pipeline steps in a similar way to the
run
method, but using multiprocessing.plot
()Plot the pipeline graph
run
([validate])Validates and executes all stages of the pipeline
set_stages_requirements
(requirements)Sets
requirements
attribute for all pipeline stagesvalidate
([ignore])Validates the pipeline by checking whether all requirements for all stages are satisfied
- classmethod __new__(*args, **kwargs)#