• As a Software Engineer on the Warehouse Pipeline team in the Data Stack group, you’ll build and iterate on our data import system
• Our import workers are built in python and we pull in data from APIs and databases in batches, process the data using Apache Arrow in memory, and move the data into object storage in open table formats
• You’ll build and maintain our source library, as we’re looking for creative ways to make our library manageable at scale
• You’ll revamp our schema management strategy, and build resilient systems (e.g logging, observability, testing)
• You’ll debug stateful data workflows by digging into k8s pod metrics, and schedule jobs using Temporal.io

You will have the chance to push the boundaries of what our Data Stack team can do while ensuring we remain stable and production-ready

• You’re a builder
• You bring strong skills in building resilient systems, with experience in Kubernetes, Docker, and S3 at scale
• We build in python
• Async-python and Temporal.io skills are welcome
• You have hands-on experience with batch processing and modern data formats
• We use Arrow to stream data
• Experience with Iceberg and/or Delta is welcome, we don’t expect you to have experience with all three (although that would be great)
• You're more than a connector of things
• Building pipelines is more than configuring tools to make them work together, it's about actually building the tooling used in data warehousing pipelines
• We need you to have experience with building tools versus using off-the-shelf tools
• You bring experience with creating and maintaining data pipelines
• You are comfortable with debugging stateful, async data workflows by digging into k8s pod metrics
• You bring a mix of skills
• You’ll need strong backend skills as we run a complex system
• You love getting things done
• Engineers at PostHog have an incredible amount of autonomy to decide what to work on, so you’ll need to be proactive and just git it done

You’re ready to do the best work of your career