BigData/Hadoop

Yarn timelineserver 설정

개발자웅이 2023. 7. 26. 16:29

yarn timelineserver를 설정해보겠습니다.

 

hadoop이 설치되어있음을 가정합니다.

https://developer-woong.tistory.com/36

 

hadoop 설치 (정리모음버전)

centos7 기준입니다. 6대의 서버가 준비되어있고, ntp설정, ip설정 및 호스트네임 등록, jdk 설정, zookeeper 설치가 완료됨을 가정합니다. https://developer-woong.tistory.com/37 centos linux ntp enable centos7 기준입니

developer-woong.tistory.com

 

1. yarn-site.xml 수정

action server: mast02 (yarn 동작서버)

user: hadoop

pwd: /opt/apps/hadoop-3.2.1/etc/hadoop

cmd:

# 해당 컨피그들 추가  
vi yarn-site.xml

       <property>
                <name>yarn.timeline-service.enabled</name>
                <value>true</value>
        </property>
        <property>
                <name>yarn.timeline-service.hostname</name>
                <value>mast02</value>
        </property>
        <property>
                <name>yarn.timeline-service.http-cross-origin.enabled</name>
                <value>true</value>
        </property>
        <property>
                <name> yarn.resourcemanager.system-metrics-publisher.enabled</name>
                <value>true</value>
        </property>
        <property>
                <name>yarn.timeline-service.generic-application-history.enabled</name>
                <value>true</value>
        </property>
        <property>
                <name>yarn.timeline-service.address</name>
                <value>mast02:10200</value>
        </property>
        <property>
                <name>yarn.timeline-service.webapp.address</name>
                <value>mast02:8188</value>
        </property>
        <property>
                <name>yarn.timeline-service.webapp.https.address</name>
                <value>mast02:8190</value>
        </property>
        
 cd /opt/apps/hadoop-3.2.1

 

2. 설정파일 재 배포 및 yarn restart

action server: mast02 (yarn 동작서버)

user: hadoop

pwd: /opt/apps/hadoop-3.2.1/etc/hadoop

cmd:

# hadoop 클러스터 서버들에게 배포 
scp -P 22002 ./capacity-scheduler.xml hadoop@mast01:/opt/apps/hadoop-3.2.1/etc/hadoop
scp -P 22002 ./capacity-scheduler.xml hadoop@mast03:/opt/apps/hadoop-3.2.1/etc/hadoop
scp -P 22002 ./capacity-scheduler.xml hadoop@work01:/opt/apps/hadoop-3.2.1/etc/hadoop
scp -P 22002 ./capacity-scheduler.xml hadoop@work02:/opt/apps/hadoop-3.2.1/etc/hadoop
scp -P 22002 ./capacity-scheduler.xml hadoop@work03:/opt/apps/hadoop-3.2.1/etc/hadoop

# mast02서버 실행(yarn이 동작하는 서버)
sbin/yarn-daemon.sh start timelineserver

 

결과확인

mast02:8188

 

 

반응형