org.apache.avro.mapred.tether

Class TetherJob

java.lang.Object

org.apache.hadoop.conf.Configured

org.apache.avro.mapred.tether.TetherJob

All Implemented Interfaces:

Configurable

public class TetherJob
extends Configured

Constructs and submits tether jobs. This may be used as an API-based method to launch tether jobs.

Field Summary

Fields

Modifier and Type	Field and Description
static String	TETHER_EXEC
static String	TETHER_EXEC_ARGS
static String	TETHER_EXEC_CACHED

Constructor Summary

Constructors

Constructor and Description
TetherJob()

Method Summary

Methods

Modifier and Type	Method and Description
static URI	getExecutable(JobConf job) Get the URI of the application's executable.
static RunningJob	runJob(JobConf job) Submit a job to the map/reduce cluster.
static void	setExecutable(JobConf job, File executable) Set the URI for the application's executable.
static void	setExecutable(JobConf job, File executable, List<String> args, boolean cached) Set the URI for the application's executable (i.e the program to run in a subprocess and provides the mapper/reducer).
static RunningJob	submitJob(JobConf conf) Submit a job to the Map-Reduce framework.

Methods inherited from class org.apache.hadoop.conf.Configured

getConf, setConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TETHER_EXEC

public static final String TETHER_EXEC

See Also:

Constant Field Values

TETHER_EXEC_ARGS

public static final String TETHER_EXEC_ARGS

See Also:

Constant Field Values

TETHER_EXEC_CACHED

public static final String TETHER_EXEC_CACHED

See Also:

Constant Field Values

Constructor Detail

TetherJob

public TetherJob()

Method Detail

getExecutable

public static URI getExecutable(JobConf job)

Get the URI of the application's executable.

setExecutable

public static void setExecutable(JobConf job,
                 File executable)

Set the URI for the application's executable. Normally this in HDFS.

setExecutable

public static void setExecutable(JobConf job,
                 File executable,
                 List<String> args,
                 boolean cached)

Set the URI for the application's executable (i.e the program to run in a subprocess and provides the mapper/reducer).

Parameters:

job - - Job

executable - - The URI of the executable

args - - A string of additional arguments

cached - - If true, the executable URI is cached using DistributedCache - if false its not cached. I.e if the file is already stored on each local file system or if its on a NFS share

runJob

public static RunningJob runJob(JobConf job)
                         throws IOException

Submit a job to the map/reduce cluster. All of the necessary modifications to the job to run under tether are made to the configuration.

Throws:

IOException

submitJob

public static RunningJob submitJob(JobConf conf)
                            throws IOException

Submit a job to the Map-Reduce framework.

Throws:

IOException