STUDENT INFORMATION MANAGEMENT SYSTEM USING SHELL SCRIPT
PROJECT ON STUDENT INFORMATION MANAGEMENT SYSTEM USING SHELL SCRIPT
for this click the given link
https://drive.google.com/open?id=0B44BYhgt7b4CRnJUcUZ0d2gwM3JOVTRxUEl2dk1MeWlCWHRB
MapReduce
Optimization Techniques Map Reduce && Hive: • Indexing • Partitioning • Bucketing • Denormalization • Vectorization =SET hive.vectorized.execution.enabled=true • Input format selection(Type of file to be used) • Unit Testing • Sampling. MAPREDUCE COUNTERS: • Counters in MR are useful for gathering statistics about MR jobs like quality control and application level. • Each counter is defined by MP framework. • Counters are useful for problem solving diagnosis. • Each counter in MR is named by ‘ENUM’. • Hadoop counters validate the following: It reads and written the correct number of bytes. Each MR job has run correct number of tasks ornot. Counters also validate amount of CPU or memory consumed is appropriate for our jobs & cluster nodes or not. Different types of counters in hadoop: Built-in or pre-defined counters User-defined counters or custom counters Built-in counters: • Apache hadoop contains some built-...
Comments
Post a Comment