Location
Canada | United States
Job description
Job Position: Data Engineer.
Minimum Experience : 3 Years
Education: Degree in Computer Science, IT, or similar field; a master's is a plus
Data Engineer Duties and Responsibilities
- Creating optimal pipeline architectures for data extraction, transformation, and loading (ETL) from various data sources using technologies like Azure Synapse, Azure Data-factory and MS SQL.
- Working with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues.
- Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
- Hand-on experience with major Cloud Computing Platforms
- Preferred - AZURE
- Good to have AWS & GCP
- Support performance tests (performance)
- Assisting/Building analytical tools using PowerBI that utilize the data pipeline, providing actionable insights into key business performance metrics.
- Ability to perform root cause analysis on external and internal processes and data.
- Demonstrated experience working in Agile methodologies, including Scrum or Kanban, with a focus on iterative development, cross-functional collaboration, and delivering value incrementally.
- Proficiency in SQL Server administration, including database deployment, query optimization, and high availability strategies. Familiarity with T-SQL language for querying and manipulating data within SQL databases.
Good To Have
- Experience in scripting for automation (e.g. Python) and advanced SQL skills.
- Familiarity with big data technologies like Hadoop, Spark, and Kafka.
- Data engineering certification (e.g IBM Certified Data Engineer) is a plus
Job tags
Salary
