Lead I - Data Engineering - (Bigdata, Sql,)
- Uplers
- 4 to 8 Yrs
- Other Karnataka
- 8 days ago
- Email to a friend
- Report this job
Job Description
- 5 - 7 Years 7 Openings Bangalore Role description Job Title: Senior Data Engineer Job Description: We are looking for a Senior Data Engineer with expertise in Big Data, Data Pipelines, and Cloud Platforms to join our team. In this role, you will be responsible for developing data frameworks, APIs, and data systems that provide the business with increased flexibility and agility. You will drive proof-of-concept evaluations, design scalable data solutions, and collaborate with stakeholders to deliver high-quality data insights. Key Responsibilities: Develop and maintain data pipelines, frameworks, applications, and APIs using industry best practices. Drive Proof of Concept (POC) and Proof of Technology (POT) evaluations to assess new methodologies. Build and manage data quality monitoring processes to ensure the health of big data systems. Monitor and review KPIs, alarms, and other system health metrics for successful production systems. Collaborate with business stakeholders to understand reporting needs, propose, design, and develop creative data solutions that provide required insights and improve processes. Influence the team with your experience and ideas to educate and help others grow in their roles. Stay updated with the latest development tools, technologies, patterns, and methodologies, and share knowledge with key stakeholders. Publish and update technical architecture, user, and process documentation to ensure clarity across teams. Must Have Skills: Scala/Python (PySpark): 4+ years of hands-on experience with Scala or Python (specifically PySpark) for big data processing. Distributed Databases: Strong experience working with distributed databases and managing large-scale data systems. Kafka: Experience in handling streaming data via Kafka or structured streaming. SQL: Solid professional experience with SQL and query optimization to enhance database performance. Big Data Technologies: Expertise in Hadoop, Spark, and other big data frameworks. Data Processing & Manipulation: Hands-on experience in data processing, transformation, and data manipulation techniques. GCP Cloud: Expertise with Google Cloud Platform (GCP) and GCP data processing tools like GCS, DataProc, BigQuery, Hive, etc. Orchestration Tools: Experience with orchestration tools such as Airflow, Automic, Autosys, etc. Data Ingestion Frameworks: Experience building frameworks for data ingestion and consumption patterns. Lambda Architecture: Exposure to Lambda architecture for real-time and batch data processing. Good to Have Skills: Visualization Tools: Exposure to data reporting and visualization tools such as Tableau, PowerBI, Looker, etc. Cloud Certifications: Certifications in GCP or other cloud platforms are a plus. Functional Programming: Good understanding of functional programming principles and multi-threading. Additional Comments: This role requires a candidate who thrives in a collaborative environment, with a passion for helping teams become more productive and efficient. Excellent communication skills are essential for working effectively with various stakeholders and explaining complex technical solutions. The ideal candidate will be adaptable and willing to stay current with the latest trends and innovations in the data engineering space. Apply Today! Skills Bigdata, Sql, Hadoop, Spark About UST UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worlds best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients organizations. With over 30,000 employees in 30 countries, UST builds for boundless impacttouching billions of lives in the process.,
Employement Category:
Employement Type: Full timeIndustry: IT Services & Consulting
Role Category: Not Specified
Functional Area: Not Specified
Role/Responsibilies: Lead I - Data Engineering - (Bigdata, Sql,)
Contact Details:
Company: UST GlobalLocation(s): Other Karnataka
+ View Contact
Fraud Alert to job seekers!
₹ Not Specified
Similar positions
Uplers
Uplers is a one-stop digital services company delivering end-to-end web, design, digital marketing, and email production services to businesses and agencies across 52+ Nations. Backed by a team of 550+ digital expert.
Plugin template missing! Fix or contact support.
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in