Job ID:
J36993
Specialized Area:
BIG Data
Job Title:
Sr Big Data Engineer w Spark, Scala, Python
Location:
Reston,VA
Duration:
18 Months
Domain Exposure:
Insurance, Government, Aerospace/ Airlines
Work Authorization:
US Citizen, Green Card, OPT-EAD, CPT, H-1B,
H4-EAD, L2-EAD, GC-EAD
Client:
To Be Discussed Later
Employment Type:
W-2 (Consultant must be on our company payroll. C2C is not allowed)
e Senior Big Data Engineer independently designs and builds Big Data solutions leveraging Cloudera Big Data technology stack. With minimal supervision, performs Development activities, technical documentation, system performance support, and internal customer support. Takes complete technical ownership of a given project and provides guidance and support to other team members. Works with Solutions Architects, Big Data Administrators and other Big Data and BI team members Required Qualifications
• Advanced Level experience (5+ years ) with Java , Python/Scala programming languages
• Advanced Level experience (3+ years ) in Hadoop, Yarn, HDFS, MapReduce, Sqoop, Oozie , Hive, Spark and other related Big Data technologies
• Experience tuning Hadoop/Spark parameters for optimal performance
• Experience with Big Data querying tools including Impala
• Advanced experience with SQL and at least one major RDBMS (Oracle, DB2 etc.)
• Advanced experience with shell scripting
• 5+ years of full-time, industry experience and at least 3+ years of Solution Design and Development experience using various Hadoop components
• Rigor in high code quality, automated testing, and other engineering best practices, ability to write reusable code components Preferred Qualifications
• BS/MS in Mathematics, Engineering, or Computer Science
• Experience working on Data Science projects, building data pipelines for Machine Learning
• Knowledge of Data pre-processing activities for machine learning
• Experience working with large data environments – petabytes or hundreds/thousands of terabytes
• Apache Hbase, KUDU experience will be a plus
• Working knowledge of U.S. Healthcare Industry
• Past experience with data warehouse/data analytics solutions and technologies, especially ETL tools
DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract