Location
Bangalore | India
Job description
Key Skills and Experience:
2 - 5 years of relevant experience with following skillsets
• Ability to build and optimize data sets, 'big data' data pipelines and architectures.
• In-depth knowledge and a sound understanding of cloud systems.
• Proficiency in analytics and database querying tools
• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.
• Work together with data scientists and analysts to understand the needs for data and create effective data workflows.
• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
• Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Perform data transformation and processing tasks to prepare the data for analysis and reporting in Azure Databricks or Azure Synapse Analytics for large-scale data transformations using tools like Apache Spark.
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
• Effectively communicate with project team members and sponsors throughout the project lifecycle (status updates, gaps/risks, roadblocks, testing outcomes)
• Experience working in Managed services environment providing application support, with strong knowledge on IT Service Management (ITSM) process including incident, request, and problem management.
• Azure certification is a plus.
Job tags
Salary
