W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    Hadoop & Big Data

  • Job Title:

    Hadoop-Spark-Engineer

  • Location:

    New York,NY

  • Duration:

    8 Months

  • Domain Exposure:

    Healthcare, Insurance, Retail, IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description

Job Requirements:

  • Take full engineering responsibility from Dev to Test to Deploy
  • Lead the architecture, design, and development of components and services to enable Machine Learning at scale
  • Identify and recommend the most appropriate paradigms and technology choices for batch and realtime ML scenarios
  • Write highly efficient Spark jobs to process TB of data
  • Collect heuristics and optimize Spark jobs on large Hadoop clusters
  • Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR
  • Partner with a x-functional team of Architects, Data scientists, Data engineers, Analysts, PMs, and customers
  • Write clean, efficient code and deployment artifacts in Java or Python or Chef
  • Teach and mentor other engineers on the team

Education and Experience:

  • BS in Computer Science.
  • Strong CS fundamentals including data structures, algorithms, and distributed systems.
  • A minimum of 5+ years of experience on distributed computing and on solving complex cluster computing problems
  • Deep hands-on experience with Spark 2.0 and Hadoop
  • Deep hands-on experience with SMACK architecture or similar
  • Strong programming experience in core Java
  • Strong experience with DevOps tools and processes
  • Strong Experience with RDBMS, NoSQL, or Graph Databases.
  • Working knowledge of AWS architecture, concepts, and tools
  • Some experience with Python and Chef
  • Experience with Agile methodologies
  • Amazon EMR experience would be a big plus
  • Excellent communication skills

Apply Now
Equal Opportunity Employer

DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract