Data Engineer

Location

Ash, Surrey | United Kingdom

Job description

Overview:

The Data Engineer plays a crucial role in our organization responsible for developing and maintaining scalable data pipelines and infrastructure to support our datadriven initiatives. They collaborate with data scientists and analysts to ensure data availability integrity and reliability enabling informed decisionmaking and business growth.

Key Responsibilities:

• Design and develop robust scalable data pipelines for ingesting integrating and transforming large volumes of structured and unstructured data
• Implement ETL processes to efficiently extract load and transform diverse data sources
• Create and maintain data models and schema designs to support analytics and reporting requirements
• Optimize data infrastructure and architecture for performance reliability and costeffectiveness
• Collaborate with crossfunctional teams to understand data requirements and implement solutions
• Implement data security and compliance measures to protect sensitive information
• Monitor and troubleshoot data pipeline and infrastructure issues
• Document data processes data flow and infrastructure components
• Keep abreast of emerging technologies and best practices in data engineering
• Contribute to the continuous improvement of data quality consistency and accuracy

Required Qualifications:

• Bachelors or Masters degree in Computer Science Engineering or related field
• Proven experience in data engineering database development or related roles
• Proficiency in SQL and database technologies for data manipulation and optimization
• Strong programming skills in Python for data processing
• Experience with data modeling Data clearing visualization text processing Image processing
• Knowledge of Big Data technologies such as Hadoop Spark or Hive
• Handson experience with cloud platforms like AWS (quicksight glue RDS)
• Expertise in ETL tools and processes to manage data pipelines
• Familiarity with data visualization tools like Power BI or similar
• Excellent problemsolving analytical and communication skills
• Ability to work effectively in a collaborative agile environment
• Strong attention to detail and commitment to delivering highquality solutions

sql,python,etl,data modeling,big data,data warehousing,aws,spark,data visualization,visualization,processing,excel,power bi

Job tags

Salary