Exp: 9.5 to 13 years Skill: Scala, Spark Location : Bangalore/Hyderabad/Kolkata/Pune/Chennai Technical Skills : Python , SparkSQL , Kubernetes , Apache Hudi , Risk Management , Apache Iceberg Roles & Responsibilities : This position for Open Visanet - Morocco program, the candidate should develop ETL pipelines using spark, scala, Golang and java. Token provisioning messages are the critical scope of this program. Candidate should develop the related pipeline, deploy them in PSE and Prod environments. - Develop and optimize big data solutions using Spark and Spark in Scala to meet project requirements and enhance performance. - Collaborate with cross-functional teams to design, implement, and maintain scalable data processing pipelines. - Provide technical expertise in Spark and Spark in Scala to troubleshoot and resolve complex data processing issues. - Implement best practices for data processing and storage to ensure data integrity and security. - Utilize Python and SparkSQL to develop and maintain data processing scripts and queries. - Leverage Kubernetes for container orchestration and management of big data applications. - Integrate Apache Hudi and Apache Iceberg for efficient data storage and retrieval in big data environments. - Apply risk management principles to identify and mitigate potential risks in data processing and storage. -Qualifications - Possess strong expertise in Spark and Spark in Scala with hands-on experience in developing and optimizing big data solutions. - Demonstrate proficiency in Python and SparkSQL for data processing and querying. - Have experience with Kubernetes for container orchestration and management. - Show familiarity with Apache Hudi and Apache Iceberg for data storage and retrieval. - Apply risk management principles to ensure data integrity and security. - Exhibit strong problem-solving skills to troubleshoot and resolve complex data processing issues,
Employement Category:
Employement Type: Full time Industry: IT Services & Consulting Role Category: Not Specified Functional Area: Not Specified Role/Responsibilies: Scala, Spark Job in Cognizant at All India