Big Data Developer - Chennai - Tango It
- Tango It Solutions
- 3 - 8 years
- Chennai
- 5 years ago
- Email to a friend
- Report this job
Job Description
Job Description for Senior Data EngineerJob Title:
- Senior Data Engineer.
Reports To: CTO
About Company:
- Tango IT is an AI based product company operating from Chennai. We started our journey as an AI service provider and provided a solution to NPCI for UPI payments analytics.
- Currently we are into retail analytics. We have a SAAS product called Tango Eye for instore video analytics. we service clients like Nykaa, NPCI, Sangeetha mobiles, Specs makers and many more.
- We are seed funded company.
- Technology partners are NVIDIA and Amazon.
- For more details can visit our website www.tangoeye.io
Job Overview:
- 3 to 5 years of Experience in DATA ENGINEERING, responsible for building and maintaining optimized and highly scalable distributed processing using big data framework that facilitate deeper analysis and reporting systems.
Tech Stacks:
- Big Data, Apache Spark, Apache Kafka, AWS cloud computing, NoSQL experience (good in database query), Python and Scala, Shell scripting.
Responsibilities and Duties:
- Experience in developing Apache spark Scala distributed application
- Should have real time experience in handling large volumes of data (both structured and unstructured)
- Expertise in distributing data workloads to handle TB of data for machine learning Jobs (parallel execution)
- Should have experience in building large scale spark application using Scala
- Experience in both streaming and batch data processing workloads using Apache Spark
- Experience in working Hive database and optimising it
- Expertise in presto analytical query engine
- Should have experience in handling/optimising various file formats like parquet, Avro etc
- Ability to resolve ongoing issues with operating the cluster
- Create and maintain optimal data pipeline workflow in AWS
- Ability to optimise HDFS file system operation
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using big data tools
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Working knowledge of message queuing using Apache Kafka
- Experience with big data tools: HDFS, Hive, Apache Spark, Kafka
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience with stream-processing systems: Spark-Streaming
- Experience with object-oriented and functional programming language: Python, Java
- Follow business targets and Scrum.
- If worked on Pyspark application also, is an added advantage
Qualifications
- Education: Any Degree
- Other skills: Problem Solving Approach, project and Time Management skills.
- Personal characteristics: Passion to learn and work in teams in a Startup Environment
- Certifications: Any relevant certifications like Hortonworks/Cloudera Hadoop Certifications.
Interested Candidates pls call on +91 6380909*** or can mail on: sn**a@ta******h.co.in
Job Classification
Industry: IT-Software, Software ServicesFunctional Area: IT Software - Other,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time
Education
Under Graduation: Any Graduate in Any SpecializationPost Graduation: MCA in Computers, M.Tech in Civil, Computers, Electrical, Electronics/Telecommunication, Mechanical, Post Graduation Not Required
Doctorate: Doctorate Not Required, Any Doctorate in Any Specialization
Contact Details:
Company: Tango It SolutionsAddress: Tango IT Solutions India Private Limited 30 Co Operative Colony Road Alwar pet, Chennai Tamil Nadu 600028
Location(s): Chennai
Website: https://www.tangoeye.io/
Keyskills: Pyspark AWS Python Hive Presto SCALA Kafka Spark Hdfs Avro Machine Learning
Tango It Solutions
*Tango IT is an AI based product company operating from Chennai. We started our journey as an AI service provider and provided a solution to NPCI for UPI payments analytics.* Currently we are into retail analytics. We have a SAAS product called Tango Eye for instore video analytics. we service ...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in