About the job
Join the innovative team at UBDS Group as a Data Engineer specializing in Multi-Cloud environments. In this pivotal role, you will play a crucial part in designing, developing, and optimizing data platforms that drive complex transformation programs. We are looking for an engineer with practical experience in data pipelines, cloud platforms, and ETL processes who is eager to enhance their skills in a collaborative and results-oriented environment.
Your contributions will be vital in building dependable, scalable data solutions that facilitate analytics, reporting, and operational use cases.
Key Responsibilities
- Design and maintain data pipelines and ETL processes leveraging cloud-native technologies (e.g., Spark).
- Assist in integrating cloud and on-premise data sources effectively.
- Support the implementation of event-driven data pipelines to enhance performance and scalability.
- Help develop data access layers and reusable ETL components.
- Facilitate the onboarding of new data sources, focusing on the preparation and transformation of datasets.
- Collaborate with senior engineers to uphold data engineering best practices and standards.
- Contribute to CI/CD pipelines and Infrastructure as Code (IaC) initiatives.
- Operate within AWS and Azure environments, assisting with the deployment and maintenance of data solutions.
- Engage with services such as:
- AWS: EC2, EMR, S3, Lambda
- Azure: Blob Storage and associated services
- Work alongside cross-functional teams to ensure data quality, reliability, and performance.
- Participate in knowledge-sharing and continuous improvement activities.
Skills & Experience
Essential
- Proven experience in data engineering or ETL development.
- Familiarity with data pipelines and data processing frameworks (e.g., Spark or similar).
- Proficiency in cloud platforms (AWS and/or Azure; experience with both is highly desirable).
- Solid understanding of ETL processes and data integration concepts.
- Basic experience with Infrastructure as Code (e.g., Terraform) and/or CI/CD tools (e.g., GitLab).
- Knowledge of key services such as:
- AWS: EC2, S3 (with EMR/Lambda experience being beneficial)
- Azure: Blob Storage
- Understanding of version control and collaborative development practices.
- Awareness of data security and governance considerations.
Desirable
- Experience with event-driven architectures or streaming technologies.
- Background in data access layers or data platform design.
- Experience in public sector or regulated environments.
- Knowledge of cloud networking fundamentals.
- Familiarity with fraud analytics or large-scale data use cases.
Security Requirements
- This position requires Security Clearance (SC).
- Candidates must be eligible and willing to undergo the clearance process.

