Data Engineer (PySpark) at gsstech-group | Bengaluru

Join our dynamic team at gsstech-group as a talented Data Engineer within the Data Engineering Chapter, working closely with the Group Operations team at ENBD. In this role, you will be instrumental in developing scalable data pipelines, conducting data analyses, and providing top-tier data solutions that align with our enterprise data models.Key ResponsibilitiesEngage with the Group Operations Team daily to clarify business and data requirements.Execute Impact Assessments for both new and existing data modifications.Carry out Technical Data Mapping and Data Profiling.Design, implement, and sustain ETL pipelines for efficient data extraction, transformation, and loading.Create data solutions that integrate with the AECB application following established data models.Enhance and maintain data pipelines utilizing PySpark on contemporary data platforms.Ensure the quality, consistency, and integrity of data across various systems.Conduct unit testing, debugging, and deployment of data solutions.Utilize modern tools and AI technologies (e.g., Claude) to boost development efficiency and minimize operational errors.Collaborate effectively with cross-functional teams including business analysts, architects, and QA.Required Skills & QualificationsProven expertise in PySpark and distributed data processing.Experience with Informatica BDM Development (Big Data Management).Deep understanding of ETL/ELT concepts and data pipeline architecture.Proficiency in data mapping, data profiling, and impact analysis.Experience with large-scale data systems and cloud/data platforms.Strong SQL skills and a solid grasp of data warehousing principles.Familiarity with the banking/financial domain is a plus.Knowledge of AI-assisted development tools (e.g., Claude) is advantageous.Excellent problem-solving and analytical abilities.Preferred QualificationsExperience with AECB data/reporting systems.Exposure to big data ecosystems (Hadoop/Spark clusters).Understanding of data governance and compliance standards.

Join gsstech-group as a Senior Data Engineer within our dynamic Data Engineering chapter in the Technology Platform domain. We seek a talented individual with a robust background in real-time data streaming, contemporary data platforms, and the operationalization of AI/ML technologies (AIOps, MLOps, LLMOps).In this pivotal role, you will design, build, and optimize scalable data pipelines that empower advanced analytics and AI-driven solutions.

Join our dynamic team at gsstech-group as a Data Engineer specializing in real-time streaming and event-driven architectures. The successful candidate will play a pivotal role in constructing scalable data pipelines, optimizing streaming systems, and guaranteeing exceptional performance in distributed environments.

Join our dynamic team at gsstech-group as a Full Stack Software Engineer! In this role, you will be responsible for developing and maintaining innovative web applications that drive the success of our clients. You will work closely with cross-functional teams to deliver high-quality software solutions that meet both business and user needs. If you are passionate about technology and eager to tackle complex challenges, we want to hear from you!

Join a leading UAE bank as a Business Intelligence Engineer specializing in Power BI.We are seeking a detail-oriented professional with a strong background in data visualization and analytics, particularly within the banking sector. This role requires proficiency in tools like Tableau and Power BI, as well as experience handling large datasets.

Join our dynamic Group Risk team as a Data Engineer, where you will play a pivotal role in constructing and managing comprehensive data pipelines essential for IFRS9 reporting. This position requires close collaboration with business stakeholders to identify data requirements, perform impact assessments, and deliver exceptional data solutions utilizing cutting-edge technologies like PySpark and Informatica BDM.Key ResponsibilitiesWork alongside the Group Risk Team to gather and comprehend business and data needs.Conduct impact assessments and technical data mapping for both new and existing data sources.Perform data profiling to guarantee data quality, consistency, and completeness.Design, develop, and sustain ETL pipelines utilizing PySpark and Informatica BDM.Create scalable data transformation workflows in alignment with IFRS9 data models.Ensure precise data extraction, transformation, and loading (ETL) into reporting systems.Engage in unit testing, validation, and deployment of data pipelines.Enhance data processing performance and resolve production issues.Utilize modern tools (e.g., AI-assisted tools like Claude) to boost productivity, minimize errors, and refine development workflows.Maintain thorough documentation for data flows, mappings, and processes.Required Skills & QualificationsProven experience in PySpark for extensive data processing.Hands-on experience with Informatica BDM (Big Data Management).Strong grasp of ETL concepts, data warehousing, and data modeling.Experience in data profiling, data mapping, and impact analysis.Familiarity with IFRS9 or the Risk/Banking domain is highly advantageous.Knowledge of distributed data processing frameworks and big data ecosystems.Excellent SQL skills and experience with relational databases.Sound understanding of data quality and governance principles.Preferred SkillsExperience with cloud platforms (AWS / Azure / GCP).Familiarity with AI-assisted development tools (e.g., Claude, GitHub Copilot).Understanding of CI/CD pipelines in data engineering workflows.Soft SkillsStrong analytical and problem-solving abilities.Exceptional communication and stakeholder management skills.Capacity to thrive in a fast-paced, collaborative environment.

Join us at gsstech-group as a Data Engineer, where your expertise in PySpark and Informatica BDM will play a crucial role in enhancing our Risk & Compliance platforms within a transformative Trade Transformation initiative. Collaborate with a dedicated Data Engineering team to deliver scalable, high-quality data solutions that meet our strategic objectives.Key Responsibilities:Engage with the Data Engineering team to evaluate the impacts of transformation initiatives on Risk & Compliance platforms.Convert business requirements and impact assessments into actionable data engineering tasks.Architect, develop, and implement robust data solutions that adhere to enterprise architecture standards.Build and optimize data pipelines leveraging PySpark and Informatica BDM.Ensure prompt delivery of development tasks while maintaining exceptional quality and compliance with SLAs.Collaborate with cross-functional teams, including business, risk, and compliance stakeholders.Utilize cutting-edge tools and technologies, including AI-assisted development tools, to drive productivity.Participate in code reviews, testing, and deployment activities.

Job Title: Data Engineer (PySpark)________________________________________About the RoleWe invite you to join our dynamic data engineering team as a proficient Data Engineer specializing in PySpark and the Cloudera Data Platform (CDP). In this pivotal role, you will be tasked with architecting, developing, and sustaining robust data pipelines that guarantee exceptional data quality and accessibility throughout the organization. Your expertise in big data ecosystems, cloud-native technologies, and sophisticated data processing methodologies is essential.The ideal candidate will possess extensive hands-on experience in data ingestion, transformation, and optimization on the Cloudera Data Platform, complemented by a strong history of applying data engineering best practices. You will collaborate closely with fellow data engineers to devise solutions that foster significant business insights.Key ResponsibilitiesDesign and develop scalable ETL pipelines using PySpark on CDP, ensuring data integrity.Manage data ingestion processes from diverse sources (e.g., relational databases, APIs, file systems) to the data lake or warehouse on CDP.Utilize PySpark for processing, cleansing, and transforming vast datasets to meet analytical and business needs.Optimize performance by fine-tuning PySpark code and Cloudera components to enhance resource utilization.Establish data quality checks and validation routines to maintain data accuracy throughout the pipeline.Automate workflows using orchestration tools like Apache Oozie or Airflow within the Cloudera ecosystem.Monitor pipeline performance, troubleshoot issues, and maintain the Cloudera Data Platform and associated processes.Collaborate with data engineers, analysts, product managers, and other stakeholders to understand data requirements.Document data engineering processes, code, and pipeline configurations thoroughly.QualificationsBachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related discipline.3+ years of experience as a Data Engineer, focusing on PySpark and the Cloudera Data Platform.

Join gsstech-group as a Product Engineer, where you will play a pivotal role in designing and developing innovative products that enhance user experience and drive business success. As a part of our dynamic team, you will collaborate with cross-functional teams to bring concepts to life and ensure that our products meet the highest standards of quality.

Role OverviewJoin our dynamic team as an experienced Redis Engineer specializing in RTS Redis (Redis TimeSeries) for real-time data processing and caching. We seek a candidate with robust hands-on expertise in Redis administration, focusing on data dump, persistence, and performance optimization. You will be instrumental in deploying and managing Redis solutions within OpenShift environments.A developer-centric mindset, along with a deep understanding of Redis data structures, pipeline management, and AI integration, is crucial for success in this role.Key ResponsibilitiesDesign, configure, and maintain RTS Redis (Redis TimeSeries) databases to facilitate real-time analytics and time-series data processing.Implement caching, data dump, and persistence techniques to ensure data integrity and enhance performance.Develop and oversee Redis pipelines, prioritizing Redis databases while integrating other databases as necessary.Deploy Redis environments on OpenShift with a focus on scalability, high availability, and fault tolerance.Integrate RTS Redis solutions with Python and DevOps tools to streamline automation and monitoring.Optimize memory usage, query performance, and overall system reliability within Redis.Collaborate with development teams to effectively integrate Redis into microservices and application architectures.Investigate Vector Database integrations and AI-driven caching strategies to elevate performance.Required Skill SetPrimary Skills:Redis Administration (RTS Redis / Redis TimeSeries)Real-time Data ProcessingCaching, Dump, and PersistenceImmediate Deployment and Configuration SkillsAdditional Skills:PythonDevOpsOpenShiftPreferred Combination:RTS Redis + OpenShift Deployment ExperienceGood to Have:Familiarity with Vector Databases (e.g., Pinecone, Milvus, Weaviate)Experience in AI model caching and data managementKnowledge of CI/CD automation for Redis workloads

Join our dynamic team as a MongoDB Database Engineer where you will be responsible for managing, optimizing, and automating production-grade MongoDB clusters in enterprise environments. This role is not for the faint-hearted; it requires a profound understanding of MongoDB internals—we're looking for someone who can own cluster health, performance, and automation from start to finish. Key ResponsibilitiesAdminister and support MongoDB replica sets and sharded clustersDesign and maintain robust high availability and disaster recovery strategiesPerform backups, restores, upgrades, and patching with minimal or zero downtimeMonitor cluster health, replication lag, disk usage, and query performanceDiagnose and resolve issues such as slow queries, locking problems, index inefficiencies, and capacity bottlenecksImplement security best practices including:Authentication & authorization (RBAC)TLS / encryption at restAuditing and access controlsAutomate MongoDB operations using Ansible, scripts, and CI/CD pipelinesSupport MongoDB deployments on AWS / Azure / GCPCollaborate closely with application and DevOps teams for schema design and performance optimizationParticipate in on-call rotations and manage production incidentsMaintain thorough operational documentation and runbooks

Join our innovative team at gsstech-group as a DevOps Automation Engineer. We are looking for a talented professional with extensive experience in automation pipelines, cloud infrastructure, and Oracle database environments. This pivotal role is part of our Technology Engineering group, focusing on developing robust, scalable, and efficient automation solutions across our technology and data platforms.Key ResponsibilitiesDesign, implement, and sustain CI/CD pipelines leveraging tools such as Jenkins and Git.Automate infrastructure provisioning utilizing Terraform (IaaS).Create and manage automation scripts using Groovy, Ansible, and other scripting languages.Work collaboratively with cross-functional teams to adopt and promote DevOps best practices.Guarantee high availability, performance, and scalability of systems and automation pipelines.Integrate and oversee automation workflows in both cloud and on-premises environments.Support and enhance Oracle database environments (preferred).Uphold code quality by adhering to best-practice coding standards and version control.Diagnose pipeline failures and enhance deployment workflows.Engage in Agile ceremonies including sprint planning, stand-ups, and retrospectives.Manage tasks and workflows via tools like JIRA (user stories, boards, tracking).Required Skills & ExperienceProven hands-on experience with:Jenkins (CI/CD pipelines)Ansible (configuration management)Git (version control)Terraform (Infrastructure as Code)Groovy scriptingComprehensive understanding of Cloud DevOps & IaaS architecture.Experience in constructing and maintaining automation frameworks.Familiarity with the software development lifecycle (SDLC) and DevOps methodologies.Knowledge of Agile methodologies (Scrum, Kanban).Preferred SkillsExperience as or with an Oracle DBA.Expertise in database automation and performance tuning.Familiarity with enterprise-level banking or financial systems.Experience with monitoring tools and logging frameworks.QualificationsBachelor’s degree in Computer Science, Engineering, or a related field.3–7 years of relevant experience in DevOps / Automation Engineering.

Join our dynamic team at GSSTech Group as a Software Engineer specializing in Zafin SaaS solutions. We are on the lookout for innovative minds to enhance our offerings and drive our commitment to excellence in software development. You will work with cutting-edge technologies, collaborate with cross-functional teams, and contribute to impactful projects that ensure our clients receive top-tier services.

Join our dynamic team at gsstech-group as a Senior Software Engineer, specializing in Zafin SaaS solutions. In this pivotal role, you will be responsible for designing, developing, and maintaining innovative software applications that enhance our financial service offerings. You will collaborate closely with cross-functional teams to deliver high-quality solutions tailored to meet our clients' needs.

Join our innovative team at gsstech-group as a Senior Product Engineer. In this role, you will lead the design and development of cutting-edge products that push boundaries and redefine standards. You will collaborate closely with cross-functional teams to drive product innovation and ensure quality throughout the lifecycle.

We are seeking a highly skilled Senior Software Engineer to join our dynamic team at gsstech-group. In this role, you will be responsible for developing and implementing innovative software solutions that enhance our Zafin RBP product. You will collaborate with cross-functional teams to deliver high-quality software that meets customer needs.

Join our dynamic team at gsstech-group as a Senior Oracle ERP Engineer specializing in Finance and Procurement ERP solutions. You will be pivotal in enhancing and managing our Oracle ERP implementations, ensuring they align with global compliance and operational excellence.Key Responsibilities:Serve as the primary Subject Matter Expert (SME) for our Oracle Fusion ERP system, overseeing solution design and implementation.Manage enhancements, quarterly updates, and the overall financial architecture post-implementation.Collaborate with cross-functional teams to troubleshoot and resolve issues, ensuring optimal system performance.

Role Overview Tietoevry is looking for a Senior PySpark Developer to join the Tieto Tech Consulting team in Bengaluru. This position focuses on designing and building scalable data solutions for clients, using PySpark as a core technology. Projects often involve complex data analytics and processing challenges. What You Will Do Design and implement data solutions using PySpark Work closely with team members to solve data analytics problems Support clients in making the most of their data assets Contribute to collaborative project work in a consulting setting Location This role is based in Bengaluru.

Smiths Group seeks a Data Analyst in Bengaluru to transform raw data into actionable insights for business decision-making. This position involves frequent collaboration with colleagues across different departments to highlight trends, prepare reports, and contribute to strategic planning based on data analysis. Main responsibilities Analyze data sets to identify trends and patterns Prepare clear, accurate reports for internal teams Work with cross-functional groups to support data-driven decisions Location This role is based in Bengaluru.