Package org.apache.avro.mapred.tether
Class TetherJob
java.lang.Object
org.apache.hadoop.conf.Configured
org.apache.avro.mapred.tether.TetherJob
- All Implemented Interfaces:
Configurable
Constructs and submits tether jobs. This may be used as an API-based method
to launch tether jobs.
-
Field Summary
-
Constructor Summary
-
Method Summary
Modifier and TypeMethodDescriptionstatic URI
getExecutable
(JobConf job) Get the URI of the application's executable.static org.apache.avro.mapred.tether.TetheredProcess.Protocol
getProtocol
(JobConf job) Extract from the job configuration file an instance of the TRANSPROTO enumeration to represent the protocol to use for the communicationstatic RunningJob
Submit a job to the map/reduce cluster.static void
setExecutable
(JobConf job, File executable) Set the URI for the application's executable.static void
setExecutable
(JobConf job, File executable, List<String> args, boolean cached) Set the URI for the application's executable (i.e the program to run in a subprocess and provides the mapper/reducer).static void
setProtocol
(JobConf job, String proto) Determines which transport protocol (e.g http or sasl) used to communicate between the parent and subprocessstatic RunningJob
Submit a job to the Map-Reduce framework.Methods inherited from class org.apache.hadoop.conf.Configured
getConf, setConf
-
Field Details
-
TETHER_EXEC
- See Also:
-
TETHER_EXEC_ARGS
- See Also:
-
TETHER_EXEC_CACHED
- See Also:
-
TETHER_PROTOCOL
- See Also:
-
-
Constructor Details
-
TetherJob
public TetherJob()
-
-
Method Details
-
getExecutable
Get the URI of the application's executable. -
setExecutable
Set the URI for the application's executable. Normally this in HDFS. -
setExecutable
Set the URI for the application's executable (i.e the program to run in a subprocess and provides the mapper/reducer).- Parameters:
job
- - Jobexecutable
- - The URI of the executableargs
- - List of additional arguments; Null if no argumentscached
- - If true, the executable URI is cached using DistributedCache - if false its not cached. I.e if the file is already stored on each local file system or if its on a NFS share
-
getProtocol
Extract from the job configuration file an instance of the TRANSPROTO enumeration to represent the protocol to use for the communication- Parameters:
job
-- Returns:
- - Get the currently used protocol
-
runJob
Submit a job to the map/reduce cluster. All of the necessary modifications to the job to run under tether are made to the configuration.- Throws:
IOException
-
submitJob
Submit a job to the Map-Reduce framework.- Throws:
IOException
-
setProtocol
Determines which transport protocol (e.g http or sasl) used to communicate between the parent and subprocess- Parameters:
job
- - job configurationproto
- - String identifying the protocol currently http or sasl- Throws:
IOException
-