Data Architect - Iceberg / Hudi / Delta Lake
A Data Architect is required to join an exciting new programme, focused on promoting global financial integrity. Previous experience with AWS and modern data architecture frameworks - Apache Hudi, Apache Iceberg, and/or Databricks Delta Lake would be highly desirable, as well as previous e-commerce or gaming industry experience.
Deliverables:
- Translate business needs into data architectural requirements and designs
- Undertake data profiling and source system analysis to present clear insights and support end use of the data
- Make recommendations to ensure product requirements are met
- Support to the selection of appropriate technologies
- Review and agree proposed data architectural designs
- Provide detailed data architectural design and technical requirements to our cloud delivery partners
- Work with the scrum teams and product owners to resolve development blockers
- Review and provide collaborative input and support on the development and test environments to be built
Key skills and experience:
- Experience developing data architectures and data models supporting real time data pipelines
- Implementing data pipelines for data driven business decision supported by ML and NLP
- Data architecture across the full product development lifecycle with exposure to a wide array of technologies, methodologies, and business environments
- Data streaming (i.e. Kafka) technology, SQL (i.e. PostgreSQL) and non-SQL database (i.e. CouchDB) technology which supports processing stream data, record keeping, and reporting
This role have been deemed inside IR35. Please apply for more information.
