Huquo Consulting
Location
Delhi | India
Job description
Position : Data EngineerLocation : GurgaonExperience : Min 4+ yearsRole & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects.- Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with stewards / data custodians / end users etc- Demonstrated experience of building efficient data pipelines using tools or technologies like - Spark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.- Understand the need for both batch and stream ingestion of the data from source databases - like SQLServer, Oracle, MySQL etc. and build scripts logics for reusable data transformations.- Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency.- Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts.- Lead Data Engineering Projects to manage and implement data-driven communication systems- Proficient in data engineering , data management principles- Good combination of technical skills, communication skills, and business acumen.Candidate Profile :- 4 to 8 years of relevant experience in data engineering tools- Programming Languages - SQL, Python- Technologies - Spark/ Azure Data factory /Azure Data Lake Storage/ Databricks, Delta Lake , Python, SQLServer/Snowflake and experience with other cloud providers - AWS/GCP- B.S. Degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering or other science field), Information Systems, Information Processing or engineering.- Ability to work independently (ref:hirist.tech)
Job tags
Salary
