Senior Data Engineer with experience in both AWS and Azure Databricks includes the following responsibilities:
Collect, analyze, and report on structured and unstructured data from multiple sources
Design and build data pipelines, reporting tools, information dashboards, and other end-user information portals
Ensure stakeholders can access and manipulate data for routine and ad hoc analysis
Work and communicate proactively with team members, technical leads, and project managers
Use modern data engineering techniques and methods with Advanced Analytics to support business decisions for clients
Strong experience as an AWS and Azure Data Engineer with AWS and Azure Databricks experience
Expert proficiency in Python, PySpark, and other programming and scripting languages
Hands-on experience with AWS and Azure data lake and analytics solutions, Kinesis, DynamoDB, Event/IoT Hubs, and Cosmos
In-depth understanding of AWS and Azure cloud services and technologies
Experience preparing data for data science, machine learning, and AI use cases
Strong understanding of data modeling and defining conceptual, logical, and physical data models
Working knowledge of RESTful APIs, OAuth2 authorization framework, and API security best practices
Strong written and verbal communication skills
Ability to manage competing priorities in a fast-paced environment
Self-motivated and able to work independently
Qualifications:
2+ years of hands-on experience designing and implementing multi-tenant solutions using both AWS and Azure Databricks
5+ years of experience in software development, data engineering, or data analytics
Bachelor's or master's degree in a relevant field or equivalent work experience
Ability to resolve issues
Microsoft Certified: Azure Data Engineer Associate (nice to have)
Employement Category:
Employement Type: Full time Industry: IT - Software Role Category: Application Programming / Maintenance Functional Area: Not Applicable Role/Responsibilies: AWS or Azure - Data Engineer - Databricks
Contact Details:
Company: B.l.consultants Hiring Location(s): Multi-City, India