Banner Default Image
Back to job search

Data Architect - Iceberg / Hudi / Delta Lake

  • Location:

    London

  • Sector:

    Data and Analytics

  • Job type:

    Contract

  • Job functions:

    Data Architect

  • Salary:

    £900 - £1000 per day

  • Contact:

    Liam Grier

  • Contact email:

    liam.grier@lafosse.com

  • Job ref:

    LFA - 78192_1655741123

  • Published:

    7 days ago

  • Duration:

    6 months

  • Expiry date:

    2022-08-01

  • Startdate:

    ASAP

Data Architect - Iceberg / Hudi / Delta Lake

A Data Architect is required to join an exciting new programme, focused on promoting global financial integrity. Previous experience with AWS and modern data architecture frameworks - Apache Hudi, Apache Iceberg, and/or Databricks Delta Lake would be highly desirable, as well as previous e-commerce or gaming industry experience.

Deliverables:

  • Translate business needs into data architectural requirements and designs

  • Undertake data profiling and source system analysis to present clear insights and support end use of the data

  • Make recommendations to ensure product requirements are met

  • Support to the selection of appropriate technologies

  • Review and agree proposed data architectural designs

  • Provide detailed data architectural design and technical requirements to our cloud delivery partners

  • Work with the scrum teams and product owners to resolve development blockers

  • Review and provide collaborative input and support on the development and test environments to be built

Key skills and experience:

  • Experience developing data architectures and data models supporting real time data pipelines

  • Implementing data pipelines for data driven business decision supported by ML and NLP

  • Data architecture across the full product development lifecycle with exposure to a wide array of technologies, methodologies, and business environments

  • Data streaming (i.e. Kafka) technology, SQL (i.e. PostgreSQL) and non-SQL database (i.e. CouchDB) technology which supports processing stream data, record keeping, and reporting

This role have been deemed inside IR35. Please apply for more information.