W-2 Jobs Portal

  • W-2 Open Positions Need to be Filled Immediately. Consultant must be on our company payroll, Corp-to-Corp (C2C) is not allowed.
Candidates encouraged to apply directly using this portal. We do not accept resumes from other company/ third-party recruiters

Job Overview

  • Job ID:

    J37554

  • Specialized Area:

    Hadoop & Big Data

  • Job Title:

    Hadoop Admin

  • Location:

    chicago,IL

  • Duration:

    6 Months

  • Domain Exposure:

    Government, Education, IT/Software

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2 (Consultant must be on our company payroll. C2C is not allowed)




Job Description

Job Description

Job Describtion

  • Knowledge of UNIX/LINUX OS because Hadoop
  • Knowledge of configuration management and automation tools like Puppet or Chef
  • Knowledge of cluster monitoring tools like Ambari, Ganglia, or Nagios.
  • Knowing of core java is a plus for a Hadoop admin but not mandatory
  • Good understanding of OS concepts, process management and resource scheduling
  • Basics of networking, CPU, memory and storage.
  • Good hold of shell scripting
  • Familiarity with components in Hadoop ecosystem like Apache Pig, Apache Hive, Apache
  • Discover the root cause for a given problem
  • Conduct systems tests for security, performance, and availability.
  • Develop and maintain design and troubleshooting documentation.
  • Specific Tasks from request history
  • Create and configure Hive databases on S3 and Impala database and drop unused databases
  • Deployment in QA and Prod
  • Software Installation such as Kafka and Zookeeper and patching and Cloudera Hadoop Software
  • Update Spark configuration to use Python
  • Run Oozie workflow and restart failed jobs
  • Collate Hadoop Users and usage data
  • Check/troubleshoot data availability in Hive tables used by applications
  • Adjust HDFS Storage Space, compression, table Restructuring
  • MarkLogic NoSQL Software Install
  • Change Disk Health Checker Max Disk Utilization Percent
  • Troubleshoot connectivity issues with applications or tools (ex: qlikview, qlicksense, SAS, Discoverant, Cognos ETC, Informatica, alation and R) and memory issues for Spark, Impala
  • Backup existing tables in S3 and execute the attached script
  • Configure Cloudera Manager alerts
  • Data movement between environments / Refreshes
  • Monitor and maintain/adjust the Dynamic resource pool

Apply Now
Equal Opportunity Employer

DIGITAL TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. DIGITAL TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will DIGITAL TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract