TheDataTeam is looking for a Technical Lead - Big Data who will be responsible for the following :
- To lead the technical discussion during the requirements gathering phase
- Coordinate with Solution Architect to arrive at a technical solution for the problem statement.
- Lead the team for task estimation, planning, tracking and resolving technical blocker issues.
- Proactively keep the Project Managers and Client stakeholders updated
- Should prepare Low Level Design Document
- Should participate in preparing High Level Design Document
- Manage CICD Pipelines
- Periodic Code Review and Code merge
- Manage cloud deployments
- Track and help the clientvendor to complete the UAT
Key skills :
- Should have minimum 7+ years of IT experience; at least 2-3 years of exp on BigData Ecosystem Should have good knowledge on Spark, NoSQL ,OozieAirflow,ScalaJava
- Core Java or Python Skills is must
- Experience on AWS
- Experience on developing complex data processing pipelines
- Hands on experience on either one of the Hadoop Distributions MapR, Cloudera and or Cloud (AWS EMR, Azure HD Insights, Qubole, etc)
- Got to have practical knowledge of Data Driven Approaches, Data Security Approaches
- Worked as Technical Lead for a minimum of 3 or more projects.
- Experience on performance tuning of Spark Jobs
- Assist in documenting requirements and resolving technical clarification with client
- Experience on CICD Deployments
- Good knowledge on Linux and Bash commands
- Experience on documenting LLD Documents
Keyskills: scala python big data cloud aws nosql spark java ci/cd pipeline
Our client is the leading catalyst for digital transformation worldwide. Partnering with Fortune 500 companies, they deliver fast, end-to-end business and technology transformation solutions, with measurable results for clients across financial services, payments, retail, automotive, healthc...