Package org.apache.accumulo.core.client.mapreduce

Class AccumuloMultiTableInputFormat

java.lang.Object

org.apache.hadoop.mapreduce.InputFormat<K,V>

org.apache.accumulo.core.client.mapreduce.AbstractInputFormat<Key,Value>

org.apache.accumulo.core.client.mapreduce.AccumuloMultiTableInputFormat

public class AccumuloMultiTableInputFormat
extends AbstractInputFormat<Key,Value>

This class allows MapReduce jobs to use multiple Accumulo tables as the source of data. This InputFormat provides keys and values of type Key and Value to the Map function. The user must specify the following via static configurator methods:

• AbstractInputFormat.setConnectorInfo(Job, String, AuthenticationToken)
• AbstractInputFormat.setScanAuthorizations(Job, Authorizations)
• AbstractInputFormat.setZooKeeperInstance(Job, ClientConfiguration)
• setInputTableConfigs(Job, Map)

Other static methods are optional.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.accumulo.core.client.mapreduce.AbstractInputFormat

AbstractInputFormat.AbstractRecordReader<K,V>

Field Summary

Fields inherited from class org.apache.accumulo.core.client.mapreduce.AbstractInputFormat

CLASS, log

Constructor Summary

Constructors

Constructor	Description
AccumuloMultiTableInputFormat()

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.mapreduce.RecordReader<Key,Value>	createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
static void	setInputTableConfigs(org.apache.hadoop.mapreduce.Job job, Map<String,InputTableConfig> configs)	Sets the InputTableConfig objects on the given Hadoop configuration

Methods inherited from class org.apache.accumulo.core.client.mapreduce.AbstractInputFormat

getAuthenticationToken, getClassLoaderContext, getClientConfiguration, getInputTableConfig, getInputTableConfigs, getInstance, getLogLevel, getPrincipal, getScanAuthorizations, getSplits, getTabletLocator, getToken, getTokenClass, isConnectorInfoSet, setClassLoaderContext, setConnectorInfo, setConnectorInfo, setLogLevel, setMockInstance, setScanAuthorizations, setZooKeeperInstance, setZooKeeperInstance, validateOptions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

AccumuloMultiTableInputFormat

public AccumuloMultiTableInputFormat()

Method Details

setInputTableConfigs

public static void setInputTableConfigs(org.apache.hadoop.mapreduce.Job job,
 Map<String,InputTableConfig> configs)

Sets the InputTableConfig objects on the given Hadoop configuration

Parameters:

job - the Hadoop job instance to be configured

configs - the table query configs to be set on the configuration.

Since:

1.6.0

createRecordReader

public org.apache.hadoop.mapreduce.RecordReader<Key,Value> createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit,
 org.apache.hadoop.mapreduce.TaskAttemptContext context)
                                                                       throws IOException,
InterruptedException

Specified by:

createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<Key,Value>

Throws:

IOException

InterruptedException