Job Opportunity | Cloud Data Architect | Fresh
- Fresh Gravity Software
- 7 - 10 years
- Pune
- 5 years ago
- Email to a friend
- Report this job
Job Description
Greetings from Fresh Gravity!Title: Consultant, Sr.Consultant- Cloud Data Architect
Job Location:Pune, Bangalore Kolkata
Apply on-9********4@jo*s.workablemail.com
Key Responsibilities include:
- Perform technology stack evaluation and suggest optimal stack for the client requirements/use cases.
- Identify, design, and implement process improvements, automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Perform current state analysis in the client's environment and provide assessment report and roadmap for future state.
- Perform technical reviews of data engineering processes including technical architecture, solution design, and resource models.
- Create and maintain optimal data pipeline architecture for our clients.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using SQL and 'Big data' technologies.
- Experience in development of data pipelines to integrate data from Azure/AWS/GCP.
- Work with different stakeholders including the executive, product, data and design teams to assist with data-related technical issues and support their data infrastructure needs.
- Ability to confidently work with client architects and technical teams in guiding implementations and making recommendations
- Should be able to keep the data separated and secure as required by the client.
- Develop and manage data processes to ensure that data is available and usable.
- Create and automate data pipelines and platforms.
- Manage and monitor data quality via automated testing frameworks (like Data Driven Testing).
- Actively manage risks to data and ensure there is a data recovery plan.
- Build data repositories such as: data warehouses, data lakes, and operational data stores, etc.
Required Technical Skills:
- Candidates should have approx. 8+ years of work or research experience in software development.
- Expert level experience with Python or any other programming languages like: Scala, or Java.
- Experience in development of data pipelines and data lake implementation in either of the following: AWS/Azure/GCP.
- Expertise in any of the cloud platforms/services - AWS cloud services (S3, EC2, EMR, RDS, Redshift, Glue) or MS cloud services: BLOB, Data Lakes, Event Hubs, Parser, API Manager.
- Exposure in at least any one of the following technologies: Hadoop ecosystem (HDFS, Pig, MapReduce), Spark, WSO2, Oozie, Hortonworks Data Platform (HDP).
- Good to haveexpertise in Hive or in any NoSQL databases like HBase, MongoDB, Cassandra.
- Experience in Snowflake or Google Big Query is a big plus.
- Good to have experience with any data pipeline and workflow management tools like Snap Logic, Stream Sets, Azkaban, Luigi, Airflow, etc.
- Good to have experience with any stream-processing systems like Storm, Spark-Streaming, Kafka, AWS Kinesis etc.
- Experience with Informatica Big Data Management, Intelligent Data lake platforms is a plus.
- Strong analytic skills related to working with unstructured datasets.
- Experience in creating secure, performant, and well-modeled data stores.
- Knowledge in common analytical platform architectural patterns (Star Schema, data integration patterns, ABAC, data quality frameworks etc.).
- Knowledge in Data lake design patterns and technology options (schema on read, metadata capture, search framework etc.).
Job Classification
Industry: IT-Software, Software ServicesFunctional Area: IT Software - System Programming,
Role Category: Programming & Design
Role: Programming & Design
Employement Type: Full time
Education
Under Graduation: B.Tech/B.E. in Any SpecializationPost Graduation: Post Graduation Not Required, Any Postgraduate in Any Specialization
Doctorate: Doctorate Not Required
Contact Details:
Company: Fresh Gravity Software Services, India Pvt. LtdLocation(s): Pune
+ View Contact
Keyskills: s3 snowflake Azure cloud security glue talend Hadoop EMR Solution Design kinesis redshift EC2 aws Solution Architecture
Fraud Alert to job seekers!
₹ Not Disclosed
Fresh Gravity Software
Fresh Gravity is at the cutting-edge of digital transformation. We drive digital success for our clients by enabling them to adopt transformative technologies that make them nimble, adaptive and responsive to the changing needs of their businesses. Our unparalleled expertise in helping clients in di...
Job Listings
We are in open beta version of website, please let us know if any issues, at: info(at)indigojobs.in