LightGBMMTTraining

LightGBM multi-task training with adaptive weighting and knowledge distillation

SageMaker step type	Training
Node type	internal (consumes upstream, produces downstream)
Container entry point	lightgbmmt_training.py
Interface file	steps/interfaces/lightgbmmt_training.step.yaml

Compute

Compute kind	estimator
SDK class	PyTorch (SageMaker DLC via image_uris.retrieve)

Functionality

LightGBMMT multi-task training for multi-label tabular classification with adaptive task weighting and knowledge distillation. Supports shared tree structures, JS-divergence weight adaptation, and per-task evaluation metrics.

Inputs (dependencies)

Input	Type	Required	Compatible producers
input_path	training_data	yes	TabularPreprocessing, StratifiedSampling, ProcessingStep, DataLoad, TemporalSplitPreprocessing
hyperparameters_s3_uri	hyperparameters	no	HyperparameterPrep, ProcessingStep
model_artifacts_input	processing_output	no	LightGBMMTTraining, MissingValueImputation, RiskTableMapping, FeatureSelection

Outputs

Output	Type
model_output	model_artifacts
evaluation_output	processing_output

Consumers (downstream steps)

Steps that declare this step as a compatible input source:

• LightGBMMTModelEval

• LightGBMMTModelInference

• LightGBMMTTraining

• ModelCalibration

• Package

• Payload

• PercentileModelCalibration

Framework requirements

Package	Version
lightgbm	>=3.3.0
scikit-learn	>=0.23.2,<1.0.0
pandas	>=1.2.0,<2.0.0
pyarrow	>=4.0.0,<6.0.0
boto3	>=1.26.0
pydantic	>=2.0.0,<3.0.0
scipy	>=1.7.0
numpy	>=1.19.0
matplotlib	>=3.0.0

---

← Back to the Step Catalog