load_data_gold
modelloader
def modelloader(data_frame: DataFrame, load_config: LoadConfig,
model_config: Model, config_manager: ConfigManager)
Loads data into the gold layer of a data platform using the specified configurations and model.
This function handles loading a DataFrame into the data platform's "gold" layer.
It configures logging, saves metadata, and uses the provided model configuration
to apply necessary transformations and loading procedures. Proper initialization
of LoadConfig
, Model
, and ConfigManager
is required before calling this function.
Arguments:
data_frame
DataFrame - The data to be loaded into the platform.load_config
LoadConfig - Configuration settings for the loading process.model_config
Model - Model configuration required for transformations and validations.config_manager
ConfigManager - Manages configuration details and ensures proper initialization.
Returns:
str
- A string indicating the outcome of the loading process, or None if successful.
Raises:
Exception
- Ifload_config.model_object_name
is missing.Exception
- Ifconfig_manager
is not properly initialized.Exception
- Ifmodel_config
is not provided.Exception
- If any other error occurs during the loading process andModel
5 is set to True.