Data Streaming (java+Spark+Pyspark+Scala) + @ Gharondaa Advisors

Home > Embedded / System Software

Data Streaming (java+Spark+Pyspark+Scala) +

Gharondaa Advisors
3 to 6 Yrs
Multi-City, India
2 years ago
Email to a friend
Report this job

Job Description

: Spark/Scala/PySpark developer who knows how to fully exploit the potential of our Spark cluster. Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data. Responsibilities: Create Scala/Spark/Pyspark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scaladoc-style documentation with all code Design data processing pipelines Skills: Pyspark Scala (with a focus on the functional programming paradigm) Apache Spark 2.x, 3.x -Apache Spark RDD API -Apache Spark SQL DataFrame API -Apache Spark Streaming API Spark query tuning and performance optimization SQL database integration (Postgres, and/or MySQL) Experience working with HDFS, AWS ( S3, Redshift, EMR , IAM , Polices , Routing) CI-CD Pipleline, Jenkins, Gitlab /Bitbucket Deep understanding of distributed systems (e.g. partitioning, replication, consistency, and consensus)

Employement Category:

Employement Type: Full time
Industry: IT - Software
Role Category: Embedded / System Software
Functional Area: Not Applicable
Role/Responsibilies: Data Streaming (java+Spark+Pyspark+Scala) +

Contact Details:

Company: Gharondaa Advisors
Location(s): Multi-City, India

+ View Contact

Login

Candidates can login here to view contacts and apply.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach Resume Max 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Candidates are expected to provide most recent and accurate profile information, inappropriate content is strictly prohibited!

Keyskills: java scala spark

Job seems aged, it may have been expired!
Fraud Alert to job seekers!

₹ Not Specified

Job application

We will notify the employer with your details. You can also attach a resume or a cover letter.

Sign In Sign Up

Email:

Password:

Password too short

To create your profile, apply for a job or make a registration

Your name (*)

Email (*)

Mobile (*)

Preferred City (* max. 2 w/comma)

Designation / Expected Role

Current / Recent Company (*)

Experience (*)

Expected Salary (*)

Desired Industry (*):

Functional area / Department (*):

Enter Skills (key skills, subjects, technologies & roles to use in search)

Write briefly about yourself, your experience and education (*)

Attach ResumeMax 2.38 MB (RTF, PDF, DOC, DOCX formats only parsed)

Please, check the file size and type.

Add social media [ + ]

Create password

I agree with website service terms and conditions

Gharondaa Advisors

\r\nCompany : Spritle\r\nLocation : Maduravoyal, Chennai,

Data Streaming (java+Spark+Pyspark+Scala) + @ Gharondaa Advisors

Home > Embedded / System Software