edu.umd.cloud9.example.hits
Class HubsAndAuthoritiesSchimmy
java.lang.Object
org.apache.hadoop.conf.Configured
edu.umd.cloud9.example.hits.HubsAndAuthoritiesSchimmy
- All Implemented Interfaces:
- Configurable, Tool
public class HubsAndAuthoritiesSchimmy
- extends Configured
- implements Tool
Main driver program for running the schimmy version of Kleinberg's
Hubs and Authorities/Hyperlink-Induced Topic Search (HITS) algorithm
Command line arguments are:
- [basePath]: the base path
- [numNodes]: number of nodes in the graph
- [start]: starting iteration
- [end]: ending iteration
- [useCombiner?]: 1 for using combiner, 0 for not
- [useInMapCombiner?]: 1 for using in-mapper combining, 0 for not
- [useRange?]: 1 for range partitioning, 0 for not
- [num Mappers]: number of mappers to use
- [numReducers]: number of reducers to use. This should remain constant between iterations
The starting and ending iterations will correspond to paths
/base/path/iterXXXX and /base/path/iterYYYY. As a
example, if you specify 0 and 10 as the starting and ending iterations, the
driver program will start with the graph structure stored at
/base/path/iter0000; final results will be stored at
/base/path/iter0010.
- Author:
- Mike McGrath
- See Also:
HubsAndAuthorities
|
Method Summary |
int |
HACalc(String path,
int iter,
int jter,
int nodeCount,
boolean useCombiner,
boolean useInmapCombiner,
boolean useRange,
int mapTasks,
int reduceTasks)
|
static void |
main(String[] args)
|
int |
Norm(String path,
int iter,
int jter,
int nodeCount,
boolean useCombiner,
boolean useInmapCombiner,
boolean useRange,
int mapTasks,
int reduceTasks)
|
int |
run(String[] args)
|
HubsAndAuthoritiesSchimmy
public HubsAndAuthoritiesSchimmy()
run
public int run(String[] args)
throws Exception
- Specified by:
run in interface Tool
- Throws:
Exception
HACalc
public int HACalc(String path,
int iter,
int jter,
int nodeCount,
boolean useCombiner,
boolean useInmapCombiner,
boolean useRange,
int mapTasks,
int reduceTasks)
throws IOException
- Throws:
IOException
Norm
public int Norm(String path,
int iter,
int jter,
int nodeCount,
boolean useCombiner,
boolean useInmapCombiner,
boolean useRange,
int mapTasks,
int reduceTasks)
throws IOException
- Throws:
IOException
main
public static void main(String[] args)
throws Exception
- Throws:
Exception