Data Engineer

Location

Toronto, ON | Canada

Job description

-About 2+ years of professional experience in Data Engineering, Data modeling, Data mining, and Statistical Data Analysis
-Data Engineer with demonstrated ability in designing and building scalable Data Pipelines with proficient knowledge in Python programming, Exploratory Data Analysis, Structured Machine Learning algorithms, and Power BI Visualization
-Good at setting up Data Lake in Azure and setup Kafka messaging between Azure Data Lake and trusted third-party providers in maintaining hash tables on Oracle DB
-Well-versed in migrating data and databases from on-prem infrastructure to the Azure data lake. Raw data is transferred to Azure Storage containers and processed by Azure functions and then stored in Cosmos DB
-Demonstrated expertise and hands-on experience in building scalable and optimized data pipelines along with optimizing the performance of database queries
-Excellent in Ingestion of large Datasets using Python, writing Python codes to automate the interaction, and downloading data as per the data frequency from REST API, Azure Storage, FTP servers, or any client-side application which acts as a data source
-Proficient in SQL, Python, and Azure cloud technologies and very comfortable with working with large data sets can perform a variety of data analyses, cleaning and ingestion, and curation using Python and visualize them using Tableau and Power BI for analysis
-Experience in statistical and predictive modeling using R. Conducted Exploratory data analysis and different statistical analyses including hypothesis testing, regression analysis, chi-squared test, t-test, z- test, and ANOVA test.
-Experienced in retrieving various data from different Data servers and validating it, cleaning it, and manipulating and transforming the data using, Python scripts, Excel Macros, and Advanced Excel
-Expertise in tackling complex business problems using Data Analytics and Business Intelligence tools, analyzing business problems, and finding creative solutions using a data-driven approach
-Superior skill in Advanced Excel on conditional formatting, count, data validation, index, match, sum, pivot table, VLOOKUP, and data table
-Savvy in using Advanced Tableau user to analyze the data, develop Dashboards, and generate sophisticated reports to exhibit data visualization results
-Experienced in developing, maintaining, and processing large databases with complex relationships between tables. Written several advanced SQL queries for extracting relevant data for predictive analytics
-Worked in an Agile environment and exhibited strong communication skills and a keen understanding of project timelines and dependencies. Team player with excellent interpersonal skills, self-motivated, dedicated, and understanding.
Employment Type: Full-Time
Salary: $ 55.00 Per Hour

Job tags

Salary

$55 per hour