Hadoop & Big Data
Oil & Gas
US Citizen, Green Card, OPT-EAD, CPT, H-1B,
H4-EAD, L2-EAD, GC-EAD
To Be Discussed Later
W-2 (Consultant must be on our company payroll. C2C is not allowed)
· Strong hands on, Expert in Hadoop/Hive/HBase.
· Should have knowledge on Apache Spark and Map reduce.
· Defining Hadoop Job Flows.
· Build distributed, reliable and scalable data pipelines to ingest and process data in real-time. Hadoop developer deals with fetching impression streams, transaction behaviours, clickstream data and other unstructured data.
· Design and implement column family schemas of Hive and HBase within HDFS.
· Assign schemas and create Hive tables.
· Managing and deploying HBase clusters.
· Develop efficient pig and hive scripts with joins on datasets using various techniques.
· Apply different HDFS formats and structure like Parquet, Avro, etc. to speed up analytics.
· Build new hadoop clusters
DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract