W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    Hadoop

  • Job Title:

    Hadoop & Spark Engineer

  • Location:

    Quincy,MA

  • Duration:

    8 Months

  • Domain Exposure:

    Insurance, Retail, Education, IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description
  • Design, Engineer & Evangelize Apache Hadoop, Kafka & Spark across the enterprise. '
  • Experience in implementing applications leveraging common patterns including SEDA, Kappa, Lambda and similar architectures.
  • Perform optimization and tuning of Kafka & Spark Work on creating best practices, standards,
  • Integration patterns and on-boarding process automation
  • Design monitoring solutions and baseline statistics reporting
  • Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms
  • Work with Enterprise Architecture team in identifying and implementing use cases best suited for Kafka
  • Provide technical expertise in scoping end to end business requirements and assist in reflecting them in implementation for different Kafka connectors
  • Conduct technical reviews of integration implementation for all SDLC phases to assess the quality of integration solutions built on Kafka
  • Provide input into technical infrastructure design for achieving high scalability of integration solutions
  • Act as liaison to vendors and align product road maps to business process & application integration road map
  • Experience with platform engineering and administrations - Unix / Linux Experience with scripting and orchestration - Puppet / Ansible / Python / Shell
  • Experience managing (Operational engineering & administration) Cloudera / Hortonwork Distribution of Hadoop
  • Experience with Confluent Kafka platform
  • Experience supporting linux in a production environment
  • Work as a responsible member of engineering team in leading various infrastructure initiatives and also mentor junior staff
  • Requiring a minimum of 10 years of IT experience including 5 years with Hadoop & Spark, 3 years with Kafka, and a bachelors degree in computer science

Apply Now
Equal Opportunity Employer

DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract