Application Architect ( Big Data ) - Ernakulam @ Prevalent AI India

Role Purpose Key Accountabilities:
The Role of the Application Architect (Big Data) is to provide hands-on leadership in the design and enhancement
of the platform leveraging his/her experience of Big Data technologies predominantly on Hadoop and Spark
platforms.

Prevalents Security Insight Platform (SIP) is based on open source big data technologies designed to ingest,
process and analyze peta byte scale data on a distributed architecture. The platform is deployable on prem, and
private/public clouds.

The right candidate would be involved in planning, designing and strategizing the roadmap and providing strong
technical and engineering expertise and leadership. The ideal candidate would also be a self-starter and self motivated individual with strong consulting, technology skills,

commitment to quality, positive work ethic and a "can do" attitude.

Provide hands-on leadership in the design and enhancement of the platform
Provide technical leadership to project team(s) to perform design to deployment related activities, provide guidance, perform reviews, prevent and resolve technical issues
Conduct performance benchmarking, performance tuning and analyze system bottlenecks and propose solutions to eliminate them;
Perform detailed analysis of business problems and technical environments and use this in designing solutions;
Collaborate with multiple teams from Prevalent/customer to arrive at technical and tactical decisions.

Develop proof of concepts and reference implementations
Develop and govern repeatable design strategies and patterns to ensure consistent solutions
Develop strong partnership with business, product and engineering leaders to define business, product and technology architecture
Guide engineering team and validate their work
Gain deep understanding of domain and industry best practices to develop technical vision and strategy
Be the bridge between data scientists, engineers and the organizational needs

Skills Experience:
Experience and knowledge about data architectures and analyzing significantly large volumes of data.
Strong experience in developing Spark jobs on Hadoop ecosystem.
Thorough experience on Hadoop, HBase, and/or MapReduce experience.
Strong hands on experience with Scala programming using Spark streaming, Dataframes.
Work in a fast-paced agile development environment.
Excellent key-skill on Spark, Hadoop.
Excellent coding skills in Scala and/or Python.
Familiarity with machine learning landscape.
Exceptional skills in architecting scalable data driven systems and driving technical decisions.
An analytical bent of mind and ability to learn-unlearn-relearn.

Knowledge:
Expert knowledge of Hadoop and Spark Architecture is a must.
Proficiency in Linux environment.
Working knowledge of MapReduce, HBase, Hive.
Knowledge of Python and Scala is good to have.
In depth of knowledge of specified multiple technological areas, including knowledge of applicable
processes, methodologies, standards, products and frameworks.
Database theories, structures, categories, properties, and best practices.
Knowledge of installing, configuring, maintaining and securing Hadoop.