Hadoop & Big Data
Oil & Gas
US Citizen, Green Card, OPT-EAD, CPT, H-1B,
H4-EAD, L2-EAD, GC-EAD
To Be Discussed Later
W-2 (Consultant must be on our company payroll. C2C is not allowed)
· Strong hands on, Expert in Hadoop/Hive/HBase.
· Should have knowledge on Apache Spark and Map reduce.
· Defining Hadoop Job Flows.
· Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
· Design and implement column family schemas of Hive and HBase within HDFS.
· Assign schemas and create Hive tables.
· Managing and deploying HBase clusters.
· Develop efficient pig and hive scripts with joins on datasets using various techniques.
· Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
· Build new hadoop clusters