Location
Buckinghamshire | United Kingdom
Job description
Sector: Analytics / Data
Location: Buckinghamshire
Type: Interim
Ref: BBBH70272_1706877906
Salary: Negotiable
Our client is looking for a Data Engineer with AWS experience who will play a crucial role in the design, development, and maintenance of data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.
Key Responsibilities:
- Data Integration: Develop and maintain data pipelines to extract, transform, and load (ETL) data from various sources into AWS data stores for both batch and streaming data ingestion.
- AWS Expertise: Utilize your expertise in AWS services such as Amazon EMR , S3, AWS Glue, Amazon Redshift, AWS Lambda, and more to build and optimize data solutions.
- Data Modeling: Design and implement data models to support analytical and reporting needs, ensuring data accuracy and performance.
- Data Quality: Implement data quality and data governance best practices to maintain data integrity.
- Performance Optimization: Identify and resolve performance bottlenecks in data pipelines and storage solutions to ensure optimal performance.
- Documentation: Create and maintain comprehensive documentation for data pipelines, architecture, and best practices.
- Collaboration: Collaborate with cross-functional teams, including data scientists and analysts, to understand data requirements and deliver high-quality data solutions.
- Automation: Implement automation processes and best practices to streamline data workflows and reduce manual interventions.
Must have: AWS, ETL, EMR, GLUE, Spark/Scala, Java, Python,
Good to have: Cloudera - Spark, Hive, Impala, HDFS , Informatica PowerCenter, Informatica DQ/DG, Snowflake Erwin
Job tags
Salary
