Software Engineer II - Hyderabad @ Microsoft

Responsibilities

• You will work with design and build automated systems with pipelines, transformations, data quality analytics and control logic.
  
• Contribute to the design and development of data platform components to validate and improve data quality, detect anomalies, and predict missing values.
  
• Use machine learning to perform intelligent imputation and classification
  Generate, process, log and correlate events across multiple sources.
  
• Work with engineering teams and data scientists to integrate insights with automation and deliver near term business impact.

Required Qualifications:

• Bachelor s degree in Computer Science, Engineering, or closely related field.
  
• 4+ years of experience designing and developing software.
  
• 2+ years of experience with data aggregation platforms based on technologies such as Spark, SQL, Azure Data Lake, Hadoop, Cosmos, etc.

Preferred Qualifications:

• Proficient with C#, test-driven development, refactoring and object-oriented development.
  
• Strong scripting skills to perform data/file manipulation Python experience is a plus.
  
• Solid understanding in raw and processed stream design, relational database design and dimensional models.
  
• Familiarity with machine learning and predictive analytics methods.
  
• Demonstrated ability to create and ship high quality code by using engineering best practices.
  
• Experience using scalable data ingestion and transformation systems in batch and near real time environments.
  
• Experience with SQL, relational modeling, and big data tools such as Cosmos, Hive, Scope or Spark.
  
• Experience with machine learning and predictive analytics is a plus.