Banner Default Image
Back to job search

Data Engineer

  • Location:

    London

  • Sector:

    Business Intelligence, Data and Analytics

  • Job type:

    Permanent

  • Job functions:

    Engineer, Data Scientist, Analyst, Developer, Data Analyst

  • Salary:

    £60000 - £70000 per annum

  • Contact:

    William Sutton

  • Contact email:

    william.sutton@lafosse.com

  • Job ref:

    65313_1634125016

  • Published:

    5 days ago

  • Expiry date:

    2021-11-24

  • Startdate:

    ASAP

As a Data Engineer, within an established company that have maintained their startup mentality, you will be responsible for architecting, building, launching and maintaining scalable data pipelines to support our data processing, analytics and product needs. You will own the systems that collect and transform data from several operational sources, creating data integration and transformation services and APIs. You will also maintain ongoing reliability, performance, and support of the data infrastructure. This includes monitoring the computing environments and providing solutions based on application needs and anticipated growth.

  • Bachelor's degree in computer science, software engineering or equivalent
  • Experience designing, building and launching highly available, distributed data platforms
  • Working knowledge of message queuing, stream processing and 'big data' stores
  • Software engineering principles, including continuous integration and deployment pipelines and technologies, preferably Azure DevOps and GIT
  • Proficiency with cloud services, ideally Azure
  • Database experience in Snowflake, Cassandra or HBase
  • Expert SQL skills, and fluidity with modern scripting language is essential (Python and Node.js)
  • Experience working with Azure Data Factory and Logic Apps
  • Proficiency with Big Data systems such as Hadoop, Spark, Databricks, and technologies such as Azure Functions
  • Experience designing and developing solutions that employ microservices architecture and containerization approaches for packaging applications, operating systems and infrastructure (preferably Docker)
  • Familiarity managing data platform infrastructure as code (Terraform, Ansible or Chef)
  • Familiarity with BI tools such as PowerBI and Tableau
  • Experience handling sensitive data
  • Good people and communication skills