2017-12-13 6 views
0

3 명의 직원과 1 명의 마스터가있는 Hadoop 2.7.4 클러스터를 구성했습니다. 클러스터에서 여러 작업을 실행해야합니다. 한 작업은 완료하는 데 많은 시간이 걸리지 만 다른 작업은 작은 작업입니다. Fair Scheduler가 내 사건에 가장 적합하다는 것을 알게되었습니다. 나는 실-site.xml의 Fair Scheduler class 다시 시작 클러스터를 업데이트 할 때 오류를 다음과 같은 원인 난에 액세스 할 때 http://localhost:8088/cluster (자원 관리자 웹 UI)Apache Hadoop 2.7.4, Fair Scheduler 원인 오류 구성

HTTP ERROR 500 

Problem accessing /cluster/. Reason: 

    org.apache.hadoop.yarn.server.resourcemanager.scheduler.QueueMetrics.getReservedMB()J 
Caused by: 

java.lang.NoSuchMethodError: org.apache.hadoop.yarn.server.resourcemanager.scheduler.QueueMetrics.getReservedMB()J 
    at org.apache.hadoop.yarn.server.resourcemanager.webapp.dao.UserMetricsInfo.<init>(UserMetricsInfo.java:76) 
    at org.apache.hadoop.yarn.server.resourcemanager.webapp.MetricsOverviewTable.render(MetricsOverviewTable.java:111) 
    at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69) 
    at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79) 
    at org.apache.hadoop.yarn.webapp.View.render(View.java:235) 
    at org.apache.hadoop.yarn.webapp.view.HtmlBlock$Block.subView(HtmlBlock.java:43) 
    at org.apache.hadoop.yarn.webapp.hamlet.Hamlet._(Hamlet.java:30347) 
    at org.apache.hadoop.yarn.server.resourcemanager.webapp.AppsBlockWithMetrics.render(AppsBlockWithMetrics.java:29) 
    at org.apache.hadoop.yarn.webapp.view.HtmlBlock.render(HtmlBlock.java:69) 
    at org.apache.hadoop.yarn.webapp.view.HtmlBlock.renderPartial(HtmlBlock.java:79) 
    at org.apache.hadoop.yarn.webapp.View.render(View.java:235) 
    at org.apache.hadoop.yarn.webapp.view.HtmlPage$Page.subView(HtmlPage.java:49) 
    at org.apache.hadoop.yarn.webapp.hamlet.HamletImpl$EImp._v(HamletImpl.java:117) 
    at org.apache.hadoop.yarn.webapp.hamlet.Hamlet$TD._(Hamlet.java:845) 
    at org.apache.hadoop.yarn.webapp.view.TwoColumnLayout.render(TwoColumnLayout.java:71) 
    at org.apache.hadoop.yarn.webapp.view.HtmlPage.render(HtmlPage.java:82) 
    at org.apache.hadoop.yarn.webapp.Dispatcher.render(Dispatcher.java:208) 
    at org.apache.hadoop.yarn.webapp.Dispatcher.service(Dispatcher.java:167) 
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) 
    at com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263) 
    at com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178) 
    at com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91) 
    at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62) 
    at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:900) 
    at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:834) 
    at org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebAppFilter.doFilter(RMWebAppFilter.java:172) 
    at com.sun.jersey.spi.container.servlet.ServletContainer.doFilter(ServletContainer.java:795) 
    at com.google.inject.servlet.FilterDefinition.doFilter(FilterDefinition.java:163) 
    at com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:58) 
    at com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118) 
    at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113) 
    at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) 
    at org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter.doFilter(StaticUserWebFilter.java:109) 
    at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) 
    at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:594) 
    at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationFilter.doFilter(DelegationTokenAuthenticationFilter.java:291) 
    at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:553) 
    at org.apache.hadoop.yarn.server.security.http.RMAuthenticationFilter.doFilter(RMAuthenticationFilter.java:82) 
    at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) 
    at org.apache.hadoop.http.HttpServer2$QuotingInputFilter.doFilter(HttpServer2.java:1263) 
    at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) 
    at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45) 
    at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) 
    at org.apache.hadoop.http.NoCacheFilter.doFilter(NoCacheFilter.java:45) 
    at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) 
    at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) 
    at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) 
    at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) 
    at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) 
    at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) 
    at org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) 
    at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) 
    at org.mortbay.jetty.Server.handle(Server.java:326) 
    at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) 
    at org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) 
    at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) 
    at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) 
    at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) 
    at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) 
    at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) 
+0

아직 'hadoop classpath'를 거치지 않으셨습니까? hadoop classpath에'hadoop-yarn-server-resourcemanager' jar가 있는지 확인하십시오. –

답변

1

그것은 2.7.5에서 수정되었습니다 2.7.4 버전에서 문제의 ! JIRA