Data Engineer

Location

Scotland | United Kingdom

Job description

Data Engineer

• Aridhia
• Scotland, UK
• 15/02/2024

Full timeData Engineering Business Intelligence Software Engineering DevOps

Job Description

Data Engineer

Aridhia Informatics provides a platform of cloud services designed to support best practice in health and clinical research. At its core, Aridhia’s Digital Research Environment (DRE) provides secure, cloud-based Workspaces and FAIR Data Services to allow distributed, multi-disciplinary research teams to share data and collaborate.

As a Data Engineer at Aridhia you will support our customers in using automation to make their data more findable, accessible, interoperable, and reusable (FAIR data). Your technical and analytical skills will enable hospitals, pharmaceutical companies, and universities to provide biomedical researchers access to the best data for their projects, while respecting patient privacy, consent and confidentiality.

Within a multidisciplinary agile team, you will apply and further develop your data engineering and development skills to design, create and maintain data processing pipelines on time and at scale. You will be expected to participate fully in teams that will include members from multiple, international customer and partner organisations.

In this position, you will be responsible for managing and working on a wide range of varied work packages across different projects. In this position, a strong passion for learning is essential. The ideal candidate will be someone who not only enjoys learning but actively seeks out opportunities to expand their knowledge and expertise.

If you thrive in a dynamic and fast-paced environment, are eager to take on new challenges, and have a knack for handling diverse work packages effectively, we encourage you to apply and become an integral part of our team.

What you’ll be doing

• Be involved in client projects to build project specific solutions that run within our Digital Research Environment (DRE).
• Manage and maintain the curation process pipelines for clients to integrate their data into the Aridhia DRE platform.
• Facilitate the data transfer process through integration with various internal and external API endpoints.
• Assist in the deployment of customer tools and applications to the Aridhia DRE platform.
• Assist in the development and maintenance of custom business process flows using Camunda.
• Provide feedback on the User Experience of the Aridhia DRE platform from a Data Engineer’s perspective for continual improvement to the product.

Working Hours

• Monday to Friday
• Start time: between 08:00 and 10:00
• Finish time: between 16:00 and 18:30

What you’ll bring

Essential

• A versatile and experienced, problem-solving data engineer with expertise in writing SQL (we use PostgreSQL).
• Experience with semi-structured data formats (CSV, JSON, XML).
• A track record of delivering data solutions to customers.
• Expertise in building and maintaining reliable data processing pipelines.
• Experience in at least one other programming language for data engineering and data science (Python/R).
• Experience with basic Linux command line tools and Shell scripts.
• Demonstrable ability to work with a variety of data infrastructure, including transactional and analytical databases and data APIs.
• Experience with version control software (Git).
• Experience adapting and designing data models/schemas.
• Evidence of testing and quality analysis of data integration solutions.
• Creative, enjoys problem solving, strong attention to detail.
• Ability to create rapid prototype solutions.
• Ability to take initiative and lead multiple projects.
• Ability to support and train less experienced members of the team.
• Good written and verbal communication skills.
• Willingness to present problems and solutions to customers. Very occasional travel to customer sites required.
• A desire to understand the business and where it is heading.
• Desire to learn and develop new skillsets in the area of data science, working with statistical. and machine learning (we use R, Shiny, Python).

Desirable Qualifications/Skills

• Experience in Azure Cloud Services (or other similar cloud platforms).
• Experience with healthcare data schemas such as FHIR and OMOP.
• Experience with Camunda.
• Experience applying machine learning for data engineering tasks.
• Experience with image processing and/or machine learning with images.

About Aridhia

Delivering the Aridhia Digital Research Environment (DRE), the trusted, secure, self-service, cloud-enabled digital research environment for biomedical, precision medicine and healthcare researchers Aridhia DRE delivers secure, auditable workspaces for research teams to engage personally, collaboratively and productively around data from multiple systems and sources in order to address complex data challenges. Commit to Rapid, Efficient and Collaborative Innovation Driven by Data. Aridhia DRE makes it easy to assemble your people, tools and data assets in secure, open source analytic workspaces to accelerate data-driven projects like never before. Choose the Innovation Environment that Suits your Specific Requirements Promote innovation at a project or organisational level: centralise and simplify your collaborative project analysis with a tailored digital research environment as the base for all projects within your organisation’s ecosystem. Find out more at www.aridhia.com

Job tags

Salary