Big Data Administrator - Chennai - CD @ Cd Cloudenablers

Job Description

What you will do

• Responsible for Design, Implementation and On-going Support of Big Data Platforms (Hadoop, Hbase, HIVE, Spark).
• Administration and periodic maintenace of multiple big data clusters set-up in AWS/Azure cloud environments.
• Own the platform architecture and the reliability, availability, scalability, operations automation and infrastructure optimization.
• Mentor Hadoop engineers and administrators, help with troubleshooting and root cause analysis
• Meet performance and SLA requirements of the Hadoop clusters
• Design metrics and monitor real-time performance of clusters, capacity planning, performance tuning
• Evaluate and recommend tools, modelling, configurations etc. for continuous improvement
• Respond to outages during business and after-hours. Participates in 24x7 on-call rotation process
• Develop scripts and tools to automate common Hadoop administration tasks
• Develop and maintain operational best practices for smooth operation of large Hadoop clusters

What you will need:

• 3+ Years of experience in deploying and administering secure, multi-tenant Hadoop clusters
• Expertise with YARN, Spark, Kafka, Storm, Zookeeper, Hive, Hbase
• Understanding of YARN and Spark, Kerberos and Sentry
• Sound understanding in Hadoop ecosystem components like HDFS, map-reduce, Spark, Oozie , Zookeeper and Ambari/Cloudera manager
• Experience in optimization, capacity planning & architecture of a large multi-tenant cluster
• Experience with AWS, Azure cloud environments, setting up secure virtual netwroks, LB, auto-scaling etc.
• Expertise with one or more of the following languages: Python, Scala, Java, Ruby and in Shell scripting
• Experience with multiple open source tool sets in the Big Data space
• Experience in tool Integration, automation, configuration management
• Excellent verbal and written communication skills, analytical and problem solving skills

Perks and Benefits 

Not a constraint for right candidate

Job Classification

Industry: IT-Software / Software Services,
Functional Area: IT Software - Other,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time

Education

Under Graduation: Any Graduate in Any Specialization
Post Graduation: Post Graduation Not Required
Doctorate: Doctorate Not Required

Contact Details:

Company: CD CLOUDENABLERS

+ View Contact

Keyskills:   Java Hive Cloudera Hadoop SCALA Big Data Oozie Spark Hdfs YARN HBase