Principal Data Engineer

Location

Fitzrovia, Greater London | United Kingdom

Job description

Principal Data Engineer

About us

Here at Xiatech, we believe that a great work-life balance leads to a contented and productive team. We enable all our teams to work remotely in order that they enjoy the flexibility and freedom to work at a time and place convenient to their lifestyle. Of course, when it comes to the serious stuff of doing business, everyone at Xiatech makes themselves available and delivers to a high standard.

Using the latest in Open Source, Microservices, Big Data and Cloud technologies, Xiatech has developed Xfuze, an innovative Hyper-Integration Platform.

Xfuze ( provides organisations with three core capabilities in a single platform:

1. Real-time system integration
2. Real-time, single view of data
3. Real-time, actionable insights, including predictive analytics

The Role

We’re looking for a Principal Data Engineer to define and develop the features and functionality of the Xfuze Platform, including involvement in the roadmap, orchestration, and prioritisation of new requirements. 

You will lead data engineers as a Technical Leader in the company and build up the Xfuze platform. You will inspire your team and they will look up to you technically to guide them. 

You will work closely with the CTO, CDO, client business teams, Xfuze platform teams, stakeholders, and your peers in the technical development team, ensuring all requirements and views are represented in delivering the final Xfuze product. 

The ideal candidate will be passionate about tech and keep abreast of industry trends and emerging technologies . They will be comfortable working with different tools as needed and sharing that knowledge with others.

This is a fantastic opportunity for a driven individual looking for a role in a company which can offer career progression, personal development and on-the-job training. This exciting role will have a genuine impact from day one and will enable the right person to progress their career in a rapidly expanding organisation.

Key Responsibilities

• Provide technical leadership to a team of data engineers, fostering a culture of collaboration, innovation, and excellence.
• Define the data engineering strategy & roadmap , including breaking this down into epics and stories for the squads you work with.
• Design and implement scalable and efficient data architectures that support the business objectives.
• Work with Product Owners to prioritise and orchestrate work between squads and engineers, including setting non-functional requirements.
• Drive change and continuously improve the company’s data engineering practices & maturity.
• Provide governance through the technical design authorities.
• Evaluate and select tools and technologies that align with the organisation's strategy.
• Set and track technical metrics to assess the performance of the team and the solutions they build. 
• Help the organisation scale by improving our onboarding , training, and SDLC processes.
• Hands-on building of our next-generation XFuze platform using agile methodologies. 
• Data Quality engineering , implementing patterns that clean and enrich data in reliable ways.
• Mentor and improve the technical skills of other team members through peer reviews.
• Work with clients to analyse requirements and implement solutions.

Your Knowledge & Experience

• 7+ years experience in Data Engineering/Architecture (or similar).
• Broad knowledge of different technical areas (DevOps, Engineering, Architecture, Various Datastores, etc).
• Strong proficiency in SQL & Python .
• Experience working with Spark (Pyspark) , data streaming, and big data solutions. Experience with Databricks is a bonus.
• Designing and building data warehouses & data lakes , including data modeling and mapping using techniques such as medallion and star schema (Experience with BigQuery a bonus).
• Data pipeline/ETL Development , building ingestion pipelines that produce scalable data products as outputs for analytics.
• Orchestration frameworks such as Dataform , Airflow, and GCP Workflows.
• Cloud platforms , especially GCP services such as GCS, Cloud Functions, and Dataproc.
• Familiarity with containerization and IaC tools (e.g. Docker , Kubernetes, Terraform ).
• Worked within an agile environment (Scrum, Kanban, etc).
• Previous experience in the retail domain is highly desirable.
• Excellent communication and presentation skills.

Your Personality

• Innovative
• Driven
• Resilient
• Insightful
• Empathetic
• Analytical
• Self-Starter
• Creative
• Problem solver

If you would like the opportunity to join an established UK-based Software as a Service organisation who believe in using the latest leading-edge technology to drive business growth, please enquire now by emailing [email protected]

If you receive an offer of employment, this will be conditional upon satisfactory completion of a right to work & identity check, a reference check and a basic criminal record check for any unspent convictions.

Xiatech is proud to be an equal opportunity employer and prohibits discrimination and harassment of any kind.

We have an awesome Talent Acquisition Specialist, and exclusive terms signed with a Recruitment Agency. We’re unable to work with other recruiters at this time so please don’t reach out regarding our roles.

Job tags

Salary