Senior Data Infrastructure Engineer - Lemonade
As part of the Data Infrastructure group, you’ll help build Lemonade’s data platform for our growing stack of products, customers, and microservices.
We ingest our data from our operational DBs, telematics devices, and more, working with several data types (both structured and unstructured). Our challenge is to provide building tools and infrastructure to empower other teams leveraging data-mesh concepts.
IN THIS ROLE YOU’LL
- Help build Lemonade’s data platform, designing and implementing data solutions for all application requirements in a distributed microservices environment
- Build data-platform ingestion layers using streaming ETLs and Change Data Capture
- Implement pipelines and scheduling infrastructures
- Ensure compliance, data-quality monitoring, and data governance on Lemonade’s data platform
- Implement large-scale batch and streaming pipelines with data processing frameworks
- Collaborate with other Data Engineers, Developers, BI Engineers, ML Engineers, Data Scientists, Analysts and Product managers
- Share knowledge with other team members and promote engineering standards
WHAT YOU’LL NEED
- 5+ years of prior experience as a data engineer or data infra engineer
- B.S. in Computer Science or equivalent field of study
- Knowledge of databases (SQL, NoSQL)
- Proven success in building large-scale data infrastructures such as Change Data Capture, and leveraging open source solutions such as Airflow & DBT, building large-scale streaming pipelines, and building customer data platforms
- Experience with Python, Pulumi\Terraform, Apache Spark, Snowflake, AWS, K8s, Kafka
- Ability to work in an office environment
Last updated: 23 hours ago
© 2021 - 2024