About the job
Join our innovative team as a Senior Data Engineer focused on Solutions Architecture, where you will architect, develop, and sustain our critical data infrastructure that enhances our renewable energy operations. In this dynamic role, you will bridge the realms of renewable energy and data, creating pipelines that handle various data types, from real-time asset performance metrics to intricate trading and risk analytics. This hybrid position allows you to contribute to the advancement of clean energy initiatives while utilizing a modern data stack, including Snowflake, Dagster, dbt, Modal, and GitLab.
Key Responsibilities
Analytics Infrastructure & Data Warehouse Management
- Design, implement, and manage scalable data infrastructures to meet the analytical and reporting demands of the enterprise.
- Oversee Snowflake instances, focusing on performance optimization, security measures, and planning for increasing data volumes.
- Enhance query performance and resource efficiency to minimize costs and accelerate processing times.
Data Pipeline Development & Orchestration
- Create and orchestrate sophisticated ETL/ELT workflows utilizing Dagster to ensure dependable, automated data processing for asset management and energy trading.
- Construct robust data pipelines capable of managing high-throughput, time-sensitive energy market data, along with asset generation and performance metrics.
- Establish workflow automation and dependencies for essential business operations.
Data Transformation & Analytics Support
- Design and maintain dbt models to convert raw data into business-ready analytical datasets and dimensional models.
- Implement efficient SQL transformations for complex calculations related to energy markets and asset performance.
- Facilitate advanced analytics efforts through effective data preparation and feature engineering.
Data Quality & Governance
- Develop comprehensive data validation, testing, and monitoring frameworks to ensure accuracy and consistency across all energy and financial data assets.
- Establish data lineage tracking and privacy controls to comply with regulatory standards in the energy industry.
- Create alerting and monitoring systems for data pipelines, encompassing error management, SLA monitoring, and incident response.
