Copy data between workspaces
To copy data between lakehouses in different Workspaces, the Copy_Data_Lakehouses notebook can be used. This notebook requires the following parameters:
| Parameter | Example | Description |
|---|---|---|
| source_workspace | FB-Company-PRD | The workspace to get the data from |
| destination_workspace | FB-Company-TST | The workspace to copy the data into |
| source_lakehouse | Bronze | The lakehouse to get the data from |
| destination_lakehouse | Bronze | The lakehouse to copy the data into |
| source_schema | his | The schema in the source |
| destination_schema | his | The schema in the destination |
| opt_filter_table | None | Filter the tables to copy by supplying the first characters to filter on (very basic filtering. Will just look for tables that start with this string) |
| max_worker | 5 | The copy instruction will be done in parallel. Default is 5 tables at once |
Limitations
Copy into a workspace that has "prd", "prod" or "production" in it's name will be prevented. Normally you don't want to use this way to copy data into a production workspace. Is your workspace not called this way (even if it is a production workspace) data will be copied.
The destination table has to exist.
Table will be overwritten. Schema is also overwritten.