Job Description
The Job
The company is seeking to hire a Senior Data Engineer who provide software-as-a-service helps automotive dealerships and sales teams better understand and predict exactly which customers are ready to buy, the reasons why, and the key offers and incentives most likely to close the sale. Its micro-marketing engine then delivers the right message at the right time to those customers, ensuring higher conversion rates and a stronger ROI.
Key responsibilities include:
Build & support data ingestion and processing pipelines.
This will entail extract, load, and transform of big data from a wide variety of sources, both batch & streaming, using latest data frameworks and technologies
Build real-time monitoring dashboards and alerting systems.
Warehouse this data, build data marts, data aggregations, metrics, KPIs, business logic that leads to actionable insights into our product efficacy, marking platform, customer behaviour, retention etc.
Your Profile
Experience in Big Data and Data Engineering.
Strong knowledge of advanced SQL, data warehousing concepts, DataMart designing.
Have strong experience in in modern data platform components such as Spark, Python, etc.
Experience with setting up and maintaining Data warehouse (Google BigQuery, Redshift, Snowflake) and Data Lakes (GCS, AWS S3 etc.).
Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.
Experience with data pipeline and workflow management tools: Airflow, Dataflow, Dataproc, etc.
Experience with Distributed Versioning Control environments such as GIT, Azure DevOps
Building Docker images and fetch/promote and deploy to Production. Integrated Docker container orchestration framework using Kubernetes by creating pods, config Maps, deployments using terraform.
Should be able to convert business queries into technical documentation.
Good to have experience in one of the Cloud providers GCP, Azure, AWS.
Exposure to any Business Intelligence (BI) tools like Tableau, Dundas, Power BI etc.
Agile software development methodologies.
Employement Category:
Employement Type: Full time
Industry: KPO
Functional Area: IT
Role Category: Datawarehousing Consultants
Role/Responsibilies: Senior Data Engineer-python/sql/big Data- Leading Information Services Group-gurgaon
Contact Details:
Company: Edge Executive Search
Location(s): Mumbai