Chabez Tech
Location
Smyrna, GA | United States
Job description
Title: Senior Azure Data Engineer
Location: Atlanta, GA
Duration: Long term
NOTE: Candidate should be very strong on Azure, Snowflake, SQL queries
Job Responsibilities:
• Design, develop, and implement robust and scalable data solutions using Azure technologies, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks, and/or Azure Synapse Analytics.
• Proficient in programming languages like Spark (with either Python or Scala), SQL
• Experience with Databases like Sql Server, Teradata, Snowflake, Synapse.
• Good understanding of data engineering principles, data modelling, data warehousing, and ETL/ELT processes which includes data testing, validation and reconciliation processes.
• Hands-on experience with data integration and data transformation frameworks, tools, and methodologies.
• Experience with version control systems like Git, GitHub etc
• Collaborate with cross-functional teams and business teams to understand business requirements and translate them into technical designs and solutions.
• Build and maintain data pipelines, data integrations, and data transformations to enable efficient data processing, storage, and retrieval.
• Optimize data infrastructure and solutions for performance, scalability, and cost-efficiency, ensuring high availability and reliability.
• Conduct data profiling, data validation, and data cleansing activities to ensure data integrity and accuracy.
• Mentor and provide technical guidance to junior data engineers, freshers/interns, fostering knowledge sharing and skills development within the team.
Good to have:
• Experience with version control systems, CI/CD pipelines, and automated testing frameworks.
• Knowledge in streaming technologies, pipelines and frameworks like Kafka, EventHub, Azure Stream Analytics.
Role: Azure Data Engineer
Location: Atlanta, GA
Duration: Long Term
Experience Required: 10+ years
• Experience in technical leadership in architecture, design, and engineering in the modernization of legacy Data Ingestion, ETL, and databases to new technologies in the Public Cloud Azure and Big Data Space
• Strong understanding across any of the Cloud Azure and its components (compute, storage, data, serverless compute,) to deliver end-to-end infrastructure architecture solutions for the clients
• Experience in defining technical direction and roadmap for Cloud migrations and managing the implementation and big data technology solutions.
• Experience designing, developing, or maintaining a big data application.
• Produce solutions that are models of performance, scalability, and extensibility.
• Can create a proof of concepts, demos, and/or scripts from scratch or leveraging reusable components.
• At least 5 years of experience in Data warehousing and designing solutions on Modern Data Lake.
• At least 5 years of Experience with major Big Data technologies and frameworks including but not limited to Hadoop, Apache Spark, Hive, Kafka, Apache Sqoop, ZooKeeper, and HBase.
• Proficiency in any of the programming languages: Scala, Python, or Java
• Hands-on Experience with Spark (Python/Scala), and SQL.
• Practical expertise in performance tuning and optimization
• Experience working on Production grade projects with Terabyte to Petabyte size data sets.
• Experience reviewing and implementing Agile standards and practices.
Thanks & Regards
Shankar, US IT Recruiter
ChabezTech LLC | M & K Technovation
4 Lemoyne Dr #102, Lemoyne, PA 17043, USA
Email: shankar(at)chabeztech.com |
Role: Azure Data Engineer
Location: Atlanta, GA
Duration: Long Term
Experience Required: 10+ years
• Experience in technical leadership in architecture, design, and engineering in the modernization of legacy Data Ingestion, ETL, and databases to new technologies in the Public Cloud Azure and Big Data Space
• Strong understanding across any of the Cloud Azure and its components (compute, storage, data, serverless compute,) to deliver end-to-end infrastructure architecture solutions for the clients
All your information will be kept confidential according to EEO guidelines.
Job tags
Salary