Banner Default Image
Back to job search

Data Engineering Lead

The Role

As a Data Engineer Team Lead you will supervise and contribute to the setup of intra-day financial reporting facilities. You would be the go to point for python development best practices. Contribute actively to the definition of data quality metrics across different data-sets. Collaborate closely with business stakeholders to define dashboards and follow through on the dataset implementations and delivery.

What you will do

  • Maintain python scripts for diverse financial reporting needs.

  • Setup and maintain a Data pipeline with Airflow for intra-day reporting.

  • Contribute to the definition of data quality metrics.

  • Setup dashboards for data quality and business reporting.

  • Diagnose, mitigate and prevent production incidents and performance issues on the reporting dashboards.

  • Coach and mentor other members of your team on best practices.

  • Ensure deliveries by the team are timely and up to standards.

  • Liaise with DevOps engineers for infrastructure configuration.

What you will need

  • Fluency in python.

  • Experience with cloud infrastructure

  • Experience writing complex queries against Microsoft SQL Server and Postgresql.

  • Experience with Docker.

  • Experience with Kubernetes.

  • Experience with Airflow deployments and management.

  • Good communication skills both written and oral.

  • Good time management, supervision and delegation skills.