W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    AWS

  • Job Title:

    AWS Big Data Engineer

  • Location:

    San Rafael,CA

  • Duration:

    10 Months

  • Domain Exposure:

    Healthcare, Banking & Finance, IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description
 
Job Description:
 
  Responsibilities
  • Design, build and maintain Big Data workflows/pipelines to process billions of records into and out of our data lake
  • Fine tune application performance
  • Troubleshoot and resolve data processing issues
  • Engage in application design and data modeling discussions
  • Participate in developing and enforcing data security policies
  • Implements, troubleshoots, and optimizes distributed solutions based on modern big data technologies like Hive, Hadoop, Spark, Python, Elastic Search, Storm, Kafka, Oozie WFs etc. in both an on premise and cloud deployment model to solve large scale processing problems
  • Provide technical leadership in the area of big data systems development including data ingestion, data curation, data storage, high-throughput data processing, analytics, user access, and security
  • Proficiency in Amazon AWS big data technologies including S3, RDS, RedShift, Elasticsearch, Lambda, AWS Glue
  • Conduct code reviews in accordance with team processes and standards
  • Works on a geographically dispersed team embracing Agile and DevOps strategies for themselves and others while driving adoption to enable greater technology and business value
 
Required Skills:
  • Hadoop, HDFS, Hive, Python, REST API/ SOAP API, Spark2, Oozie WFs
  • Advanced level expertise in any one modern software development language, for example, Java, Python, Ruby, Node.js, etc.
  • Keen understanding of big data and parallelization accompanied with a stellar record of delivery
  • Experience working within the AWS Big Data/Hadoop Ecosystem (EMR is preferred), AWS Glue
  • Experience with on-premises to cloud migrations including re-hosting, re-platforming and re-factoring
  • Experience with orchestration template technologies such as AWS CloudFormation
 
Preferred Skills:
  • 4 + years experience working within the AWS Big Data/Hadoop Ecosystem (EMR is preferred)
  • Managing traditional enterprise platforms for application runtimes, integration middleware and relational databases

Apply Now
Equal Opportunity Employer

DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract