Location
Hyderabad | India
Job description
We have a very urgent requirement for “AWS Data Engineer ” . Please find below the full Job Description, if this job opportunity interests you, I urge you to email me your updated resume with mobile number and the best time to call you. As we have multiple job opening, I further request you to share this email with your friends and industry colleagues and help us in hiring for the same.
Solugenix is an information technology services firm that has a rich history of providing comprehensive technology services and solutions for more than five decades.
As a pioneer in IT services, we’ve partnered with some of the biggest global corporations across many industries. Our history was built on a foundation of partnerships with global brands like McDonald’s, Microsoft, CITI Group, Johnson & Johnson, Herbalife, Sony Pictures Entertainment, and many others. Whether it’s providing dedicated support centers, staffing quality teams, or delivering business service solutions, clients can always count on Solugenix.
Position Title: AWS Data Engineer
Required Experience: 5+years
Job Location: Hyderabad / Chennai / Indore
Position Type: Contract or Full Time
Job Description (Job Summary/Roles & Responsibilities) :
- Design, develop, and maintain scalable and reliable data pipelines using AWS services, PySpark, and AWS lake formation.
- Implement ETL processes to extract, transform, and load data from various sources into data lakes or data warehouses.
- Collaborate with cross-functional teams to understand data requirements, identify data sources, and define data ingestion strategies.
- Optimize and tune data pipelines to ensure high performance, scalability, and data quality.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
- Collaborate with data scientists and analysts to provide them with clean, transformed, and reliable data for analysis and modelling.
- Develop and maintain data documentation, including data lineage, data dictionaries, and metadata management.
- Stay up-to-date with industry trends and best practices in data engineering, AWS services, PySpark, Athena, and AWS Lake.
- Work in a team environment with the product, QE/QA, and cross-functional teams to deliver a project throughout the whole software development cycle.
- Provide technical support for data-related issues and incidents.
- Collaborate with other teams to resolve issues and ensure data integrity.
Mandatory Skills :
- 5+ years Experience as a Data Engineer on the AWS
- Strong technical expertise in Python and PySpark
- Experience with Big Data Tools such as Hadoop and Apache Spark (Pyspark)
- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, SQS, SNS, AWS Lake Formation, RDS, Redshift, Cloud Watch, Cloud Trail, Lambda, Step Functions,
- Solid understanding of data modeling, database design, and architecture.
- Experience with version control systems and collaborative development practices.
- Responsible for building, test, QA & UAT environments using Cloud Formation.
- Build & implement CI/CD pipelines for the EDP Platform using Cloud Formation and Jenkins
Desired Skills :
- AWS Certified Big Data - Specialty certification is a plus.
- Knowledge in Data bricks in preferable.
Education & Certifications:
J
Job tags
Salary
