About the job
Please Note: This is a hybrid position based in Utah, requiring regular in-office attendance a few days each week. Employment with BambooHR is contingent upon successfully passing both a background check and a credit check.
Core Responsibilities
As a Senior Data Platform Engineer, you will leverage your multidisciplinary expertise to design, implement, and maintain robust data systems, pipelines, lakes, and lakehouses. Your proficiency in automating, optimizing performance, and scaling the data platform will be crucial to achieving our goals.
Your responsibilities will include:
- Collaborating with stakeholders to maximize the utilization of core data assets.
- Developing and maintaining data integrations using Python.
- Loading both streaming and batched data into Spark using PySpark and lakehouse libraries.
- Engineering lakehouse models to fulfill defined data patterns and use cases.
- Creating unit, integration, quality, and performance tests.
- Participating in peer code reviews, code approvals, and pull requests.
- Monitoring, operating, and optimizing data integrations, pipelines, and distributed applications.
- Documenting data pipelines, cloud infrastructure, and standard operating procedures.
- Working within an IT-managed AWS account and VPC to establish and maintain development, staging, and production environments for the data platform.
- Expressing cloud infrastructure, services, and configurations as code.
- Automating continuous upgrades and testing of infrastructure and services.
- Ensuring data privacy and security measures are in place.
- Identifying, recommending, and implementing improvements in efficiency, resilience, scalability, security, and performance.