BigData
- Hive) 테이블 컬럼명 변경 2023.12.28
- spark) spark shell에서 df 값이 달라지는 이슈 2023.12.28
- spark) Caused by: java.io.NotSerializableException 2023.12.19
- kafka) kafka topic 메시지 보존 기간 설정 2023.12.19
- kafka) Exception in thread "main" joptsimple.UnrecognizedOptionException: after is not a recognized option kafka topic 삭제주기 2023.12.19
- pyspark) kafka spark structured streaming HA 구성 시 중요사항 2023.12.18 2
- pyspark) pyspark.sql.utils.StreamingQueryException: assertion failed: Concurrent update to the commit log. Multiple streaming jobs detected for 0 2023.12.18
- spark kafka structured streaming 중 java.lang.IllegalStateException: Set() are gone. Kafka option 'kafka.group.id' has been set on this query, it is not recommended to set this option. 2023.12.18
- apache hive 엔진 tez 교체 2023.09.08
- yarn-site.xml 튜닝 2023.09.07