Digitas India
Location
Mumbai | India
Job description
Role- Lead Data Engineer
Experience - 6 +Years Locations- Mumbai/Pune/Ahmedabad Overview: As a Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS . Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be crucial in enabling data-driven decision-making processes. You should have been responsible for the end-to-end execution of at least 1-2 projects, demonstrating a profound ability to navigate through challenges and deliver solutions that drive our business objectives. Key Responsibilities: Design and implement robust, scalable data engineering pipelines within GCP, tailored for web analytics. Integrate a variety of marketing & enterprise data sources, including AWS Aurora , SAP and Salesforce ensuring seamless data flow and accessibility. Execute at least 1-2 end-to-end data engineering projects, from conceptualization to deployment, demonstrating project management and technical prowess. Employ advanced SQL, Python, and Bash scripting to optimize data processing, analysis, and automation tasks. Collaborate with cross-functional teams to identify data needs, design solutions, and enhance data-driven decision-making capabilities. Maintain and ensure the integrity and reliability of data pipelines, implementing best practices in data security and compliance. Qualifications: Bachelors/ Masters in computer/allied stem engineering fields with relevant 4-6 years of proven experience as a Data Engineer, with a focus on web analytics data engineering pipelines. Hands-on experience with GCP & AWS , including its data processing and analytics services (Pubsub , Dataflow, Bigquery , Cloud functions , Cloud run , Bigtable , Glue , Redshift , S3 , SQS etc) Strong proficiency in integrating data from diverse sources using API’s. Advanced knowledge of SQL, Python, and Bash scripting is essential. Demonstrated ability to execute end-to-end projects, showcasing effective project management and technical skills. Excellent problem-solving abilities, with a keen eye for detail and a commitment to high-quality outcomes. Strong communication skills, with the ability to convey complex technical concepts in a clear, concise manner.Job tags
Salary
