Replace the Method waitForCompltetion() in Job Class by another Method

Question

I am currently using hadoop 2.7.2

I was wondering if there is another method from the class Job in org.apache.hadoop.mapreduce.job that can replace the method waitForCompletion(), because in my project, waitForCompletion() calls for another method called getProxy() that should be in the RPC class in the package org.apache.hadoop.ipc in hadoop-common-2.7.2, but it doesn't exist.

However there is a link that proves the existence of the getProxy() method in RPC: https://hadoop.apache.org/docs/r1.0.4/api/org/apache/hadoop/ipc/RPC.html

If you want to have a detailed description of the source problem here is the link:

hadoop mapreduce java program exception: java.lang.NoSuchMethodError

Any help will be appreciated. Thank you

Answer 1

Can you try adding the below dependency and run once.

<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
  <modelVersion>4.0.0</modelVersion>
  <parent>
    <groupId>ncku.hpds.tzulitai</groupId>
    <artifactId>distributed-svm</artifactId>
    <version>0.0.1-SNAPSHOT</version>
  </parent>
  <artifactId>cascade-svm-mr</artifactId>
  <name>cascade-svm-mr</name>
  <description>The Cascade SVM approach, implemented with MapReduce</description>
  <build>
  <plugins>
    <plugin>
        <artifactId>maven-compiler-plugin</artifactId>
        <version>2.3.2</version>
        <configuration>
            <source>1.7</source>
            <target>1.7</target>
        </configuration>
    </plugin>
   </plugins>
  </build>
  <dependencies>
    <dependency>
        <groupId>tw.edu.ntu.csie</groupId>
        <artifactId>libsvm</artifactId>
        <version>3.17</version>
    </dependency>
            <!-- BIG DATA -->
        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-common</artifactId>
            <version>2.7.2</version>
        </dependency>

        <dependency>
            <groupId>org.apache.hadoop</groupId>
            <artifactId>hadoop-client</artifactId>
            <version>2.7.2</version>
        </dependency>
  </dependencies>
</project>