tools for kakaohealthcare data engineers
Commands
| Command |
Description |
| khc-de-tools.add-dl-full-workflow |
khc: Add full loading workflow for the data lake |
| khc-de-tools.add-dl-inc-workflow |
khc: Add incremental loading workflow for the data lake |
| khc-de-tools.add-dw-full-workflow |
khc: Add full loading workflow for the data warehouse |
| khc-de-tools.add-dw-inc-workflow |
khc: Add incremental loading workflow for the data warehouse |
| khc-de-tools.add-dm-full-workflow |
khc: Add full loading workflow for the data mart |
| khc-de-tools.add-dm-inc-workflow |
khc: Add incremental loading workflow for the data mart |
Extension Settings
This extension contributes the following settings:
de-tools.use-metadata: Whether to use metadata or not.de-tools.metadb-connection-string: Connection string for metadb.
Release Notes
0.1.0
Initial release
0.2.0
dl workflow 생성시 repository 의 config.yml 을 이용하도록 수정함.
0.2.1
디렉토리 생성시 상위 디렉토리가 존재하지 않으면 함께 생성하도록 수정함.
0.3.0
schema validation 적용함.
0.4.0
workflow file 에서 참조된 file이 존재하는지 여부를 체크함.
0.5.0
Jinja 템플릿이 적용된 SQL 미리보기 기능을 추가함.
0.6.0
Gcloud dataproc Cluster 생성 기능 추가함.
0.6.1
Gcluod dataproc trino cluster 생성 기능 추가.
0.7.0
workflow.json 에서 참조하는 file로 이동 기능 추가 (F12 또는 context menu - go to source file).
Gcluod dataproc cluster 생성 시 network tag config 참조하도록 수정.
| |
