Data Modeler - Hyderabad / Secunderabad @ Collabera Technologies

• Experience in a Data Engineer role (5+ years), with a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
• Build and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet functional non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, data quality checks, minimize Cloud cost, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Data Bricks, No-SQL.
• Build analytics tools that utilize the data pipeline to provide actionable insights, operational efficiency and other key business performance metrics..
• Document and communicate standard methods and tools used.
• Work with other data engineers, data ingestion specialists, and experts across the company to consolidate methods and tool standards where practical.. - Youre experienced using the following softwaretools:. - Relational SQL and NoSQL databases, including COSMOS.
• Data pipeline and workflow management tools: Data Bricks (Spark), ADF, Dataflow. - Stream-processing systems: Storm, Streaming-Analytics, IoT Hub, Event Hub.
• Big data tools: Hadoop, HDI, Spark. - Object-orientedobject function scripting languages: Python, Scala, SQL. . Technical Expertise . - ADF pipelines. - Databricks. - Azure storage.
• SQL Warehouse Database design. - SSIS. - SSAS Tabular. - Azure Functions. - Azure active directory.
• Azure DevOps CLIENT BUSINESS PROBLEM TO SOLVE : To work on clients digital twin transformation

Job Requirements

• Data Modeling and Design, MS Azure, Data Bricks, ADF pipelines, SSIS, SSAS Tabular, Azure active directory, Azure Functions.