Involved in building and designing of new data pipelines for ingestion using Sqoop and transformation using Apache Spark with Java/PySpark.
Experience in Big Data ecosystem related technologies like Storm, development of Spark streaming with Kafka, NiFi, HBase, Phoenix and Hive.
Experience in Apache spark(core structured streaming ) using scala
Experience in Administration, configuration management, monitoring, debugging and performance tuning of Hadoop applications, YARN and HDFS.
Exploring with the Spark on improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, SparkSQL, Data Frames.
Managing and monitoring data using Hive/ HQL.
experience in Apache Spark experience in java Python experience + Recruiter
Keyskills: Engineering services Performance tuning Db2 Configuration management Debugging Monitoring Financial services SQL Python HBase
Ness Technologies Ness is a leading custom software development company. Ness understands that for companies to grow, to differentiate, to stay relevant, its critical to find new ways to engage, retain and build loyalty with customers -- continually delivering better services, experiences and co...