data.configmanager
ConfigManager Objects
@dataclass
class ConfigManager(DataClassFromDictMixin)
from_yaml
@classmethod
def from_yaml(cls, yaml_string: str)
Create a Model instance from a YAML string.
from_yaml_file
@classmethod
def from_yaml_file(cls, file_path: str = "Files/Configuration/config.yaml")
Create a Model instance from a YAML file.
save_log
def save_log(save_to_table: bool = True)
Save log to lakehouse file storage and optionally to a table.
Arguments:
save_to_table
- Whether to also save logs to the logging table (default: True)
save_log_to_lakehouse
def save_log_to_lakehouse(save_to_table: bool = True)
Legacy method name for backward compatibility.
Arguments:
save_to_table
- Whether to also save logs to the logging table (default: True)
save_log_file_to_table
def save_log_file_to_table(batch_id: str)
Read a log file and save its contents to the logging table in bulk. This is more efficient than writing each log entry individually.
Arguments:
batch_id
- The batch ID to associate with all log entries