Azure/ AWS with Databricks & PySpark
- Genpact
- 6 to 10 Yrs
- Other Karnataka
- 3 months ago
- Email to a friend
- Report this job
Job Description
- 5 - 7 Years 1 Opening Bangalore Role description We are seeking a highly skilled and experienced Data Engineer with expertise in Azure or AWS cloud platforms, Databricks, and PySpark. The ideal candidate will have a strong background in building and supporting data pipelines and architectures, with an emphasis on ensuring data quality and driving end-to-end data solutions. This role will work closely with cross-functional teams to support BI and analytical reporting needs on data lake and data warehouse platforms. Key Responsibilities: Perform source-to-target data analysis and data mappings across cloud platforms. Collaborate with administrators, developers, data engineers, and analysts to ensure seamless functionality delivery. Conduct requirements analysis, coordinating closely with project managers and development teams to drive the project lifecycle. Work with Scrum Masters on maintaining product backlogs and assist with sprint planning. Design, build, and test data pipelines for both real-time and batch processing to meet project needs. Support the development and evolution of the Enterprise Data Platform (EDP) architecture, contributing to the data platform roadmap and architecture initiatives. Ensure data quality and integrity across Azure/AWS cloud data environments, focusing on BI and analytical reporting use cases. Identify potential risks early and communicate them to stakeholders, helping to develop mitigation plans. Build capacity to support data engineering activities as required. Follow agile methodologies and DevOps practices to deliver product features and solutions efficiently. Maintain adherence to prescribed development processes and best practices. Skills and Qualifications: 6+ years of experience in data engineering or a related field, delivering data solutions in cloud environments. Proven experience in Azure or AWS cloud environments, with expertise in Databricks and PySpark. Hands-on experience with Cloud BI solutions and familiarity with visualization tools (e.g., Power BI or similar). Strong knowledge of agile methodologies and experience with DevOps, DataOps, or DevSecOps practices. Proficiency in using PySpark on Databricks for building scalable data processing solutions. Excellent written, verbal, and interpersonal communication skills. Strong analytical skills with experience in documenting business requirements. Ability to work effectively with cross-functional teams across regions and time zones, leveraging multiple communication methods (Email, MS Teams, meetings). Exceptional prioritization and problem-solving skills. Skills Azure/ AWS, Pyspark, Databricks About UST UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worlds best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients organizations. With over 30,000 employees in 30 countries, UST builds for boundless impacttouching billions of lives in the process.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & Consulting
Role Category: Not Specified
Functional Area: Not Specified
Role/Responsibilies: Azure/ AWS with Databricks & PySpark
Contact Details:
Company: UST GlobalLocation(s): Other Karnataka
+ View Contact
Fraud Alert to job seekers!
₹ Not Specified
Genpact
Genpact Headstrong Capital Markets is a global consulting and IT services company with a specialized focus in capital markets. With more than 20 years of experience consulting with 9 of the worlds top 10 investment banks, we are the world’s leading technology services provider for the fin...
Plugin template missing! Fix or contact support.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in