Senior Data Engineer
- Countries
- Hybrid, UK
- Job Types
- software & tech
- Experience
- late
- Organization Types
- logistics & supply chain
- Location
- UK - Hybrid
- Posted Date
- Company
- Kpler
AI Summary
Job Description
As a Senior Data Engineer, you will design, build, and operate production-grade data pipelines and cloud infrastructure on AWS. You will ingest, process, and serve large-scale data, ensuring data integrity and event streaming. Responsibilities include setting technical direction, mentoring engineers, and evaluating new data tools.
Hard Requirements
- 5+ years of data engineering experience
- Designing, operating, and owning production-grade data pipelines and infrastructure
- Strong Python skills
- Hands-on experience with Docker, Kubernetes, AWS, Airflow, and PostgreSQL
- Practical experience with event streaming (Kafka/Flink)
- Practical experience with Infrastructure as Code (Terraform)
- Practical experience with CI/CD practices
- Practical experience with production logging/monitoring systems
- Ability to lead architectural discussions
- Ability to mentor engineers
- Experience leveraging AI-assisted coding tools
Soft Requirements
- Agile methodologies
- Collaboration skills
- Fluency in written and spoken English
- Familiarity with commodities, shipping, energy, or marine insurance market data