Job ID:
J36993
Specialized Area:
Hadoop & Big Data
Job Title:
Big Data Developer
Location:
Virginia Beach,VA
Duration:
10 Months
Domain Exposure:
Telecom, IT/Software
Work Authorization:
US Citizen, Green Card, OPT-EAD, CPT, H-1B,
H4-EAD, L2-EAD, GC-EAD
Client:
To Be Discussed Later
Employment Type:
W-2 (Consultant must be on our company payroll. C2C is not allowed)
o Cleanse, manipulate and analyze large datasets (Structured and Unstructured data - XMLs, JSONs, PDFs) using Hadoop platform.
o Develop Python, PySpark, Spark scripts to filter/cleanse/map/aggregate data.
o Manage and implement data processes (Data Quality reports)
o Develop data profiling, deduping logic, matching logic for analysis
o Programming Languages experience in Python, PySpark and Spark for data ingestion
o Programming experience in BigData platform using Hadoop platform
* Present ideas and recommendations on Hadoop and other technologies best use to management
Qualifications:
* 5+ years of experience in processing large volumes and variety of data (Structured and unstructured data, writing code for parallel processing, XMLS, JSONs, PDFs)
* 3+ years of programming experience in Python, Spark for data processing and analysis.
* Strong SQL experience is a must
* 3+ years of experience - using Hadoop platform and performing analysis. Familiarity with Hadoop cluster environment and configurations for resource management for analysis work
* Detail oriented. Excellent communication skills (verbal and written)
* Must be able to manage multiple priorities and meet deadlines
DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract