Job Description
Greetings from Encora !!
Please send resumes to so*********k@en***a.com
Location : Bangalore
candidate with 5+ years of experience for a Cloud data engineer r. Candidate must have 3 to 5 years of strong work experience in GCP or AWS. The primary responsibility will be to configure cloud infrastructure and build required for optimal data extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS data services.
Responsibilities and Skillsets
- 3+ years of experience with big data processing frameworks like Hadoop, Spark, Kafka, etc.
- 3+ years of strong hands on experience in configuring and maintaining AWS cloud or GCP cloud services: EC2, EMR, RDS, Redshift, Dataproc, BigQuery
- 3+ years of experience in handling, analysing, and transforming large, disconnected datasets using Python and Pyspark.
- Experience with data pipeline and workflow management tool like Airflow
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience building and optimizing big data data pipelines, architectures, and data sets.
- 3+ years of experience of working in data warehousing projects and must have good understanding of dimensional modelling. Prior working experience as an ETL developer is preferred.
- 5+ years of advanced SQL experience working with relational databases like Oracle and MS SQL Server.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency, and workload management.
- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
- Excellent knowledge of Linux, AIX, or other Unix flavors
- Deep understanding of Hadoop and Spark cluster security, networking connectivity and IO throughput along with other factors that affect distributed system performanceRoles and Responsibilities
Job Classification
Industry: IT-Software, Software Services
Functional Area: IT Software - ERP, CRM,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time
Education
Under Graduation: Any Graduate in Any Specialization
Post Graduation: Any Postgraduate in Any Specialization
Doctorate: Doctorate Not Required
Contact Details:
Company: ENCORA INNOVATION LABS INDIA PRIVATE LIMITED
Address: 10,,Brigade South Parade,MG Road,Bangalore, , , BANGALORE, Karnataka, India
Location(s): Bengaluru
Keyskills:
cloud
data
GCP
AWS