W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J36993

  • Specialized Area:

    Hadoop & Big Data

  • Job Title:

    Big Data Engineer / Architect

  • Location:

    Boston,MA

  • Duration:

    7 Months

  • Domain Exposure:

    Manufacturing, Government, IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description

Requirements/Responsibilities:

  • Experience communicating (orally and in writing) technical concepts with peers, business stakeholders and senior leaders in a meaningful way to promote understanding and dialogue.
  • Design and implementation experience with enterprise cloud based data solutions using technologies like: AWS, Apache Spark into HBase Hadoop databases.
  • Experience working in AWS environments leveraging EC2, S3, Lambda, RDS, etc.
  • Experience with data ingestion from a myriad of data sources: Datasets will typically originate from large RDBMS and unstructured data sources (multi-Terabyte) through the development of highly-efficient reusable code.
  • Perform data movement/development leveraging Apache Spark up to and through data publication.
  • Experience in dealing with structured, semi-structured and unstructured data in batch and real-time environments.
  • Role is also responsible for filtering, tagging, joining, parsing, and normalizing data sets throughout the end-to-end process.
  • Accountable for establishing and following leading practices around secure code development and testing to ensure the platform is free of most common coding vulnerabilities.
  • Participate and perform code reviews.
  • The ideal candidate will have broad knowledge of Hadoop tools such as Kafka, Flume, Sqoop and Oozie; Knowledge of data formats and ETL and ELT processes in a Hadoop environment including Hive, Parquet, MapReduce, YARN, HBase and other NoSQL databases.
  • General knowledge of how data science tools such as R Studio, Anaconda, H2o, Tableau leverage data throughout the big data ecosystem.

 

Top 5 Qualifications:

Quick list of top five skill sets and experience, health insurance domain knowledge and experience is very helpful.

 

  1. Experienced in AWS and Cloudera (particularly hue, impala, HDFS, hive, hbase, oozie , spark, yarn).
  2. Experienced in jupyterhub, jupyter notebook.
  3. Experienced in SQL and large data joins.
  4. Python as programming language, R is nice to have.
  5. Wide knowledge of tools in analytics and ML space, such as tableau, exploratory, RStudio, etc.

Apply Now
Equal Opportunity Employer

DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract