Job type
ContractLocation
United KingdomWorking Pattern
Full-timeSpecialism
Data & Advanced AnalyticsIndustry
Government & Public ServicesPay
£441 per day outside IR35
Data Engineer - Contract Opportunity
Your new company
Hays Technology currently working with a large scale, Global technology consultancy organisation who are partnered with a UK Government body – supporting them with their ongoing digital journey.
This organisation are currently looking for an experienced Data Engineer/Developer to join them and support with the deployment of a data lakehouse on top of both an AWS cloud and on-prem platform.
The ideal candidate will have experience with the Apache Nifi tool - although this isn't an absolute must if you meet all of the other criteria.
- This role on offer is for 8 months (with potential extensions)
- The role will be working on a hybrid basis (up to 3 days per week on site at any of three locations based between Bath and London as required)
Your new role
- To work as a data pipeline / ETL developer within the context of deploying a data lakehouse architecture on both a cloud (AWS) and on prem platform.
- Developing data models for the pipeline, and handling non-functional aspects such as security, performance, and meta data labelling.
- Working in a collaborative development team, in agile sprints within a SDLC, to develop unit/integration tests for the pipelines.
What you'll need to succeed
- Experience building data pipelines within lakehouse architectures
- Experience with event sourcing/change data capture and event driven architectures
- Familiarity with Java / Groovy and object orientated design principles
- Working in an SDLC with an integrated development team on CICD tooling (Git)
- Experience with Apache Nifi
- AWS experience, including familiarity with EMR, S3, SQS
- Awareness of domain driven design approaches and architecture
- Linux awareness and scripting skills
- Postgress / PLSQL knowledge
What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion about your career.
