About the job
Join UBDS Group as a Senior Data Engineer, where you will be at the forefront of designing, developing, and enhancing scalable data platforms within intricate transformation initiatives. This pivotal role demands extensive knowledge in cloud data engineering, architecture, and DevOps methodologies, with proficiency in both AWS and Azure environments.
Your contributions will be crucial in driving high-quality data integration, facilitating advanced analytics applications, and delivering solid, reusable data solutions that align with client objectives.
Key Responsibilities
- Architect and implement scalable, automated data pipelines utilizing cloud-native technologies such as Spark, while integrating with on-premise data sources as necessary.
- Develop and manage event-driven data architectures, maximizing pipeline efficiency, parallel processing, and proactive risk identification (e.g., fraud detection scenarios).
- Construct and oversee data access layers and ETL frameworks, allowing for both self-service and ad-hoc data asset onboarding.
- Innovate reusable data engineering patterns and tools to enhance productivity, scalability, and uniformity across projects.
- Employ DevOps and software engineering best practices, including Infrastructure as Code (IaC) and Continuous Integration/Continuous Deployment (CI/CD) pipelines.
- Collaborate with multidisciplinary teams to ensure high standards of data integration, governance, and performance.
- Operate across hybrid cloud frameworks (AWS and Azure), ensuring secure, resilient, and scalable solutions.
- Assist in the deployment and optimization of data solutions leveraging services such as:
- AWS: EC2, EMR, S3, Lambda
- Azure: Blob Storage and associated services
- Align efforts with client data strategies, governance frameworks, and security requirements.
- Foster knowledge sharing and skill enhancement within both UBDS and client teams.

