Senior Data Engineer
London Bridge
£90,000
We are looking for a Senior Data Engineer.
At Hyde, we see a future that creates a great home for everyone. We are a leading provider of affordable homes. We are doers - professional, ambitious and open. Together, our values reflect an organisation built on a culture of achievement.
As a Senior Data Engineer, you will be responsible for continuously developing new and improved data engineering capabilities. You will take a lead in developing and maintaining data pipelines between systems of record, the data integration platform and the data lake using best practises and within a dataops methodology.
The Senior Data Engineer will ensure a consistency in the approach to maintaining and building all data flows across the organisations data management platform, and that the data is well curated for varying levels of analytics use cases.
Duties of a Senior Data Engineer:
- Sole Senior Data Engineer for the engineering team and responsible for operating inside the agreed dataops process.
- Work with the Lead and Senior Engineers to leverage data for use in a cross section of analytics use cases, from descriptive to prescriptive analytics.
- Own and extend the data pipelines through the collection, storage, processing, and transformation of large data-sets.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Ensure that the infrastructure required for optimal integration, extraction, transformation, and loading of data from a wide variety of data sources is built and maintained.
- Collaborate and support the Senior Engineer to define the business's data requirements, which will ensure that the collected data is of a high quality and optimal for use across the business.
- Design, develop and maintain solutions to keep data separated and secure across on premise and cloud-based infrastructure and software.
- Collaborate with the senior analytics and data team colleagues through the Senior Engineer to analyse and understand data sources, participate in design, and provide insights and guidance on database technology and data modelling best practices.
- Design, and develop algorithms for real-time data processing within the business and create the frameworks that enable quick and efficient data acquisition.
- Keep track of industry best practices and trends and apply knowledge in order to take advantage of process and system improvement opportunities.
- Ensure that Data Governance procedure are well defined and applied through the data engineering team.
- Ensure that all development occurs within a CICD approach.
The successful candidate will have multi system skills: Confluent, Kafka, Redshift or Clojure.
We offer an award-winning flexible benefits package, a 35-hour working week, a fantastic pension scheme and the opportunity to work for an organisation whose social purpose is to help provide people with a home.
Candidates must be able to commute to the London Bridge office 2-3 days per week when we reopen.
Guidant is acting as an Employment Agency in relation to this vacancy.
