W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    BIG Data

  • Job Title:

    Big Data Engineer

  • Location:

    South Plainfield, NJ,NJ

  • Duration:

    6 Months

  • Domain Exposure:

    Healthcare, Insurance, Education

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)

  • Bench Recruiter:

    Andrew Green




Job Description

Job Summary

Duration : Long Term

Our client is embracing Big Data technologies to enable data-driven decisions. We’re looking to expand our Big Data Engineering team to keep pace. As a Sr. Big Data Engineer you will work with a variety of talented teammates and be a driving force for building solutions. You will be working on projects related to consumer behavior, commerce, and consumer touchpoints.

Responsibilities:

  • Design and implement distributed data processing pipelines using Spark, Hive, Python, and other tools and languages prevalent in the Hadoop ecosystem. Ability to design and implement end to end solution.
  • Experience publishing RESTful API’s to enable real-time data consumption using OpenAPI specifications
  • Experience with open source NOSQL technologies such as HBase, DynamoDB, Cassandra
  • Familiar with Distributed Stream Processing frameworks for Fast & Big Data like ApacheSpark, Flink, Kafka stream
  • Build utilities, user defined functions, and frameworks to better enable data flow patterns.
  • Work with architecture/engineering leads and other teams to ensure quality solutions are implements, and engineering best practices are defined and adhered to.
  • Experience in Business Rule management systems like Drools

Required Experience, Skills and Qualifications

Qualification:

  • MS/BS degree in a computer science or related discipline
  • 6+ years’ experience in large-scale software development
  • 3+ year experience in Big Data technologies
  • Strong programming skills in Java/Scala, Python, Shell scripting, and SQL
  • Strong development skills around Spark, MapReduce, and Hive
  • Strong skills around developing RESTful API

Apply Now
Equal Opportunity Employer

DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract