Azure Data engineer @ Premier Consultants

Job Description

ob Title: Azure Data Engineer

Job Summary: As an Azure data engineer, you will be responsible for developing, implementing, and managing data solutions on the Microsoft Azure platform. You will work closely with data architects, data analysts, and other stakeholders to understand business requirements and design scalable and efficient data pipelines, data lakes, data warehouses, and analytical solutions.

Key Responsibilities:

Design and Development:

Design and implement data pipelines for ingesting, transforming, and processing data from various sources into Azure data services such as Azure Data Lake Storage, Azure SQL Database, Azure Synapse Analytics, etc.
Develop data processing solutions using Azure services like Azure Databricks, Azure Data Factory, Azure Stream Analytics, and Azure Functions.
Implement data security, governance, and compliance measures in Azure data solutions.
Data Modeling and Optimization:

Design and optimize data models for performance, scalability, and reliability.
Implement data partitioning, indexing, and optimization techniques to enhance query performance in Azure SQL Database, Azure Synapse Analytics, and other Azure data services.
Data Integration and ETL:

Build and maintain ETL (Extract, Transform, Load) processes to move data between on-premises systems and Azure cloud services.
Integrate external data sources and APIs with Azure data solutions.
Monitoring and Optimization:

Monitor data pipelines and data workflows for performance, reliability, and efficiency.
Troubleshoot and resolve issues related to data ingestion, processing, and storage in Azure data solutions.
Optimize data processing workflows to reduce latency and improve throughput.
Collaboration and Documentation:

Collaborate with cross-functional teams including data scientists, business analysts, and software engineers to deliver end-to-end data solutions.
Document technical specifications, data architectures, and data flows.
Provide technical guidance and support to junior team members.

Employement Category:

+ View Contact

Keyskills:   azure adf data engineer