Location
Bangalore | India
Job description
About Aidetic
We are a dynamic technology services startup that partners with cuttingedge SaaS startups at the forefront of innovation in AI/ML Cloud Computing and Digital Transformation. Our client base consists of exciting SaaS startups hailing from the United States and Europe. Our primary objective is to accelerate innovation across various industries by collaborating with these forwardthinking companies.
(Visit to know more about the company.)
About the Role
As a data engineer you will be responsible for designing developing and maintaining the architecture and infrastructure needed to manage and process large and complex data sets. You will work with data scientists and business stakeholders to understand their needs and requirements and translate them into technical solutions that drive business outcomes. You will build pipelines that collect store process and analyze data ensuring its availability accuracy and security.
Years of Experience
3 5 years
Responsibilities
- Proficient in Cloud Data platforms and systems;
- Develop and maintain robust and scalable data pipelines using Pyspark or Scala and Python;
- Collaborate with cross functional teams to understand data requirements and transform them into technical solutions;
- Experience ( as developer) in using DevOps processes in Jenkins/Bitbucket/AzureDevOps;
- Experence in catalogs like Hive Metastore OR Apache Atlas or Utility Catalog;
- Troubleshoot and resolve datarelated issues ensuring data reliability and accuracy;
- Utilize Databricks to manage and orchestrate data workflows;
- Experienc in Hadoop ecosystem onprem (Cloudera) with SQL in Hadoop ecosystem will be an added advantage;
- Monitor and enhance data infrastructure to meet evolving business needs;
- Stay uptodate with the latest industry trends and best practices to contribute to our data engineering strategy.
Qualifications (Musthave skills)
- Bachelors degree in Computer Science Information Technology or a related field.
- Proven experience as a Data Engineer with a focus on Python SQL PySpark and Databricks.
- Strong proficiency in Python and SQL with the ability to write efficient code.
- Familiarity with Databricks and related certifications will be preferred.
- Solid understanding of data modeling ETL processes and data warehousing.
- Excellent problemsolving skills and attention to detail.
- Effective communication and collaboration skills.
- Ability to work independently and as part of a team.
- A passion for data and a desire to continuously improve data infrastructure .
Salary
This role comes with a market competitive salary which will remain aligned to your performance degree of professionalism cultural fit and alignment with Aidetic s longterm business strategy.
Benefits
- Startup Environment: Join our small team of 50 young professionals in a dynamic and impactful startup setting.
- Growth Opportunities: Expand your skills and advance your career rapidly in our closeknit team where you can take on diverse responsibilities.
- Direct Impact: Your contributions shape the companys success and future growth making your work meaningful and recognized.
- Fun and Social Activities: Engage in regular teambuilding activities and events fostering strong relationships with colleagues.
- Transparency and Communication: Experience a culture of transparency open communication and opportunities to provide feedback.
- Entrepreneurial Spirit: Develop an entrepreneurial mindset and gain firsthand experience in building a company.
- Company Culture: Join a team that celebrates achievements supports one another and creates an environment for success.
- Vacation and Holidays: Enjoy a generous vacation policy and holiday allowances prioritizing your worklife balance and wellbeing.
- Competitive Compensation: We offer a highly competitive salary to attract top talent in the industry. Your hard work and contributions will be rewarded accordingly.
python,sql,data modeling,databricks,data warehousing,pyspark,gcp,aws,azure,hive,data infrastructure
Job tags
Salary
