Works independently under limited supervision and applies knowledge of subject matter in Applications Development.
Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions.
Second level professional with direct impact on results and outcome
Data Engineer with 3 years of experience. Main technologies will be Python and Kafka.
Also used with be Spark, Scala, and the Hadoop framework.
This work will be on an investment portfolio tax optimization project.
Responsibilities:
Technical expertise in the design, development, coding, testing, and debugging of software.
Ensures that software meets or exceed specified standards and enduser requirements.
Iterative feature development on an agile team.
Develop testable features with lean requirements and supervision.
Daily agile SCRUM participation.
Required Skills:
Significant development experience with Python and Kafka
Experience with Scala
Development experience on the Apache Spark platform
Development experience on the Hadoop stack
Experience with GIT version control
Ability to troubleshoot issues independently
Ability to mentor and lead others, and also take directions from others
Years of experience: 3 6 Years
Primary Skill: Python, Hadoop, Spark
Secondary Skill: Kafka, Scala
Data Analysis
Hadoop Hive
SQL
Python
Keyskills: Data analysis Version control GIT CGI Coding Debugging SCALA Hadoop SQL Python