Desired Candidate Profile
Data Engineer- As data engineer, you will build and evolve the next gen data platform to process and report petabyte scale data from RBS systems, our catalog, and various other interfacing systems. You will own end to end projects to plan, design, and execute critical features of this platform.
The ideal candidate will have strong experience in heterogeneous technologies in DW space (map/reduce, columnar DBs etc.,). You should be an expert with Data warehouse architectures, data modeling, and data processing using distributed compute solutions.
BASIC QUALIFICATIONS
Bachelor's degree or higher in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering).
3+ years of relevant experience in building DW/BI systems
Demonstrated ability in data modeling, ETL development, and Data warehousing.
Strong experience with Big Data Technologies (Hadoop, Hive, Hbase, Pig, Spark, etc.)
Proficiency in one or more scripting languages E.g. Python
Expertise in a BI solution like Tableau, Quicksight
Hands on experience in modelling databases (particularly nosql), working on indexes, materialized views, performance tuning / optimization of queries, data migration scripts, etc.
Experience in developing backend components in Python/Java/C++ including RESTful APIs with knowledge of JSON based messaging format
Strong technical and analytical aptitude; Excellent oral and written communication skills.
A desire to work in a fast paced, intellectually curious environment
Should be well-versed in SQL, to explore different data sources, clean-up and data pull.
Understand the use of docker/Kubernetes in developing applications for cloud deployment
Use of Microservices based Architecture
Follow coding best practices with unit testing using established unit test framework - TestNG/JUnit
Adopt the development agile practice in the team to maintain high quality of code established with code reviews
Adapt to development of applications using source control tools such as Git/GitHub
Should be able to perform Exploratory Data Analysis and get actionable insights from the data, with impressive visualization (Tableau, Looker etc)
PREFERRED QUALIFICATIONS
Experience in building large scale DW/BI systems for internet companies
Experience with AWS services including S3, Redshift, EMR and RDS.
Machine Learning and Predictive Analytics
Contact Details:
Keyskills:
Java
Hive
NoSQL
Hadoop
Big Data
Spark
Pig
HBase
Python
SQL