cursus.steps.configs.config_graph_construction_step

Graph Construction Configuration with Self-Contained Derivation Logic.

Configuration for the GraphConstruction Processing step — runs GraphStorm’s gconstruct to build a partitioned DGL heterograph from the node/edge parquets + gconstruct schema emitted by GraphFeatureProcessing. Runs the custom GraphStorm image (BYO container).

Three-tier field design (Tier-2/3 defaults from the Nexus launcher’s step.get(…) fallbacks: num_processes=20, num_parts=1, skip_nonexist_edges=True, volume_size_gb=125, max_runtime_seconds=86400).

class GraphConstructionConfig(*, author, bucket, role, region, service_name, pipeline_version, model_class='xgboost', current_date=<factory>, framework_version='2.1.0', py_version='py310', image_uri=None, subnets=None, security_group_ids=None, enable_network_isolation=None, source_dir=None, enable_caching=False, use_secure_pypi=False, max_runtime_seconds=86400, project_root_folder, processing_instance_count=1, processing_volume_size=125, processing_instance_type_large='ml.m5.4xlarge', processing_instance_type_small='ml.m5.2xlarge', use_large_processing_instance=True, skip_volume_kms=None, processing_source_dir=None, processing_entry_point='run_gconstruct.py', processing_script_arguments=None, processing_framework_version='1.2-1', graph_name, num_processes=20, num_parts=1, skip_nonexist_edges=True, gconstruct_config_filename='gconstruct_config.json', run_sanity_check=True, sanity_check_full=False, **extra_data)

Bases: ProcessingStepConfigBase

Config for the GraphStorm gconstruct (GraphConstruction) step. image_uri is inherited from BasePipelineConfig (the BYO GraphStorm ECR image) and required-in-practice (byo_container).

graph_name: str

num_processes: int

num_parts: int

skip_nonexist_edges: bool

gconstruct_config_filename: str

run_sanity_check: bool

sanity_check_full: bool

processing_entry_point: str

processing_volume_size: int

max_runtime_seconds: int

use_large_processing_instance: bool

model_config: ClassVar[ConfigDict] = {'arbitrary_types_allowed': True, 'extra': 'allow', 'protected_namespaces': (), 'validate_assignment': True}

Configuration for the model, should be a dictionary conforming to [ConfigDict][pydantic.config.ConfigDict].

property gconstruct_arguments: List[str]

CLI args mirroring the Nexus ContainerArguments (the fixed –conf-file/–output-dir are handled by the script’s own constant paths). Emitted as the step’s job_arguments.

model_post_init(context, /)

This function is meant to behave like a BaseModel method to initialize private attributes.

It takes context as an argument since that’s what pydantic-core passes when calling it.

Parameters:

• self (BaseModel) – The BaseModel instance.

• context (Any) – The context.