Live Connections
Location
Bangalore | India
Job description
Role : Lead Data Engineer Job Description :Lead Data Engineer, you will play a pivotal role in designing, implementing, and managing complex data pipelines within Google Cloud Platform (GCP) & AWS .Your expertise in integrating SAP, Salesforce and other cloud databases and marketing platforms , will be crucial in enabling data-driven decision-making processes.You should have been responsible for the end-to-end execution of at least 1-2 projects, demonstrating a profound ability to navigate through challenges and deliver solutions that drive our business objectives.Key Responsibilities :- Design and implement robust, scalable data engineering pipelines within GCP, tailored for web analytics.- Integrate a variety of marketing & enterprise data sources, including AWS Aurora , SAP and Salesforce ensuring seamless data flow and accessibility.- Execute at least 1-2 end-to-end data engineering projects, from conceptualization to deployment, demonstrating project management and technical prowess.- Employ advanced SQL, Python, and Bash scripting to optimize data processing, analysis, and automation tasks.- Collaborate with cross-functional teams to identify data needs, design solutions, and enhance data-driven decision-making capabilities.- Maintain and ensure the integrity and reliability of data pipelines, implementing best practices in data security and compliance.Qualifications :- Bachelors/ Masters in computer/allied stem engineering fields with relevant 4-6 years of proven experience as a Data Engineer, with a focus on web analytics data engineering pipelines.- Hands-on experience with GCP & AWS , including its data processing and analytics services (Pubsub , Dataflow, Bigquery , Cloud functions , Cloud run , Bigtable , Glue , Redshift , S3 , SQS etc)- Strong proficiency in integrating data from diverse sources using API's.- Advanced knowledge of SQL, Python, and Bash scripting is essential.- Demonstrated ability to execute end-to-end projects, showcasing effective project management and technical skills.- Excellent problem-solving abilities, with a keen eye for detail and a commitment to high-quality outcomes.- Strong communication skills, with the ability to convey complex technical concepts in a clear, concise manner. (ref:hirist.tech)
Job tags
Salary
