logo

JobNob

Your Career. Our Passion.

Data Engineer-Lead


USEReady


Location

Bangalore | India


Job description

About Company: We are a data and analytics firm that provides the strategies, tools, capability and capacity that businesses need to turn their data into a competitive advantage. USEReady partners with cloud and data ecosystem leaders like Tableau, Salesforce, Snowflake, Starburst and Amazon Web Services, and has been named Tableau partner of the year multiple times. Headquartered in NYC, the company has 450 employees across offices in the U.S., Canada, India and Singapore and specializes in financial services. USEReady's deep analytics expertise, unique player/coach approach and focus on fast results makes the company a perfect partner for a cloud-first, digital world. About Job

( Job Description) Mentor a team of developers in building and maintaining high-quality, scalable, and secure data pipelines and analytics applications on the Databricks platform Work closely with data engineers, business stakeholders to understand their needs and design and develop solutions that meet those needs Design, develop, and test data pipelines and analytics applications using Databricks and other relevant technologies Responsibilities: Technical Leadership: Lead and mentor a team of data engineers, providing guidance and support on technical aspects and best practices. Define and implement the data architecture for the organization, ensuring scalability, performance, and security. Evaluate and adopt new technologies and tools within the Databricks ecosystem. Data Pipeline Development: Design and develop complex data pipelines for ingesting, processing, and transforming large datasets. Ensure data quality and consistency throughout the data pipeline. Optimize data pipelines for performance and resource efficiency. Collaboration and Communication: Collaborate with cross-functional teams (business stakeholders, downstream user teams) to understand data needs and translate them into technical implementation. Communicate effectively with stakeholders about data architecture, pipeline design, and operational challenges. Document data pipelines and procedures for maintainability and knowledge sharing. Problem-Solving and Innovation: Identify and troubleshoot issues within the data pipelines and infrastructure. Proactively propose improvements and optimizations to the data platform. Stay up-to-date on the latest trends and advancements in big data technologies. Qualifications 7 + years of experience as a data engineer, with at least 2 years in a lead role. Proven experience working with the Databricks platform. Databricks certification is must have. Strong knowledge of big data technologies and frameworks (Spark, Kafka, etc.). Experience with cloud platforms (AWS, Azure, GCP) is a plus. Proficiency in programming languages like Python, Scala, or Java. Excellent communication and collaboration skills. Ability to work independently and as part of a team


Job tags



Salary

All rights reserved