![]()
Airflow + Spark 테스트 환경 구성 (Docker)1. Airflow Docker 환경 준비curl -LfO 'https://airflow.apache.org/docs/apache-airflow/2.7.2/docker-compose.yaml'mkdir airflowcd airflowmkdir -p ./dags ./logs ./plugins ./configecho -e "AIRFLOW_UID=$(id -u)" > .envdocker compose up airflow-initdocker compose run airflow-worker airflow infoWeb UI 접속 후, API 테스트:ENDPOINT_URL="http://localhost:8080/"curl -X GET --user "ai..
![]()
osubuntu 22.04mariadb10.6spring cloud data flow2.11.5mariadb 준비docker pull mariadbdocker run -p 3306:3306 --name ygmariadb -e MARIADB_ROOT_PASSWORD=root -d mariadbdocker exec -it {containerId} mariadb -uroot -pcreate database task;scdf 다운로드wget https://repo.maven.apache.org/maven2/org/springframework/cloud/spring-cloud-dataflow-server/2.11.5/spring-cloud-dataflow-server-2.11.5.jarwget https://re..
1. hbase configWrite-Ahead Log (WAL) Codec Classorg.apache.hadoop.hbase.regionserver.wal.IndexedWALEditCodec2. HUE phoenix editor 추가hue configHue Service Advanced Configuration Snippet (Safety Valve) for hue_safety_valve.ini[notebook][[interpreters]][[[phoenix]]]name=phoenixinterface=sqlalchemyoptions='{"url": "phoenix://ygbaek07.gitcluster.com:8765", "tls": false, "connect_args": "{\"authentica..
![]()
1. ozone cli 기초volume 리스트 확인$ kinit -kt ozone.keytab om/`hostname`@GOODMIT.COM$ ozone sh volume list[ { "metadata" : { }, "name" : "s3v", "admin" : "om", "owner" : "om", "quotaInBytes" : -1, "quotaInNamespace" : -1, "usedNamespace" : 1, "creationTime" : "2024-04-26T05:13:02.161Z", "modificationTime" : "2024-04-26T05:13:02.161Z", "acls" : [ { "type" : "USER", "name" : "om", "ac..
