Qualifications
Basic Qualifications:1. Bachelor’s degree in Computer Science, Information Systems, or a related technical field, or equivalent work experience.2. Over 3 years of practical experience with cloud-based data technologies, including message queues, event grids, relational databases, NoSQL databases, data warehouses, and big data technologies (e.g., Spark).3. Expertise in Spark (Java, Python, SQL): Proven ability to develop and optimize Spark applications for large-scale data processing.4. Strong SQL Skills: Proficient in creating complex queries, managing database structures, and optimizing performance.5. Familiarity with Docker and Kubernetes: Experience deploying applications using modern containerization and orchestration tools.6. Understanding of DevOps and CI/CD: Solid grasp of contemporary DevOps practices, including Git, continuous integration, and deployment pipelines.7. Experience in Agile Development: Comfortable working in an Agile environment, particularly with the Scrum methodology.
About the job
Key Responsibilities:
1. Develop and Implement Scalable Data Pipelines: Design robust data ingestion frameworks that deliver timely and actionable insights to inform business strategies and operations.
2. Collaborate with Diverse Teams: Partner with both technical and business units to gather requirements and translate them into effective technical solutions.
3. Enhance Data Architecture: Consistently improve the performance and reliability of data pipelines, ensuring seamless data integration across various systems.
4. Maintain Data Integrity: Conduct thorough data quality assessments and adhere to best practices to ensure data accuracy and consistency.
5. Develop ETL Frameworks: Create ETL processes to efficiently collect, transform, and integrate data from various sources, including Kafka, Scylla, PostgreSQL, MongoDB, APIs, and multiple file formats.
6. Implement Engineering Best Practices: Establish top-notch engineering practices for reporting and analysis, ensuring data integrity, testing, validation, and thorough documentation.
About zzazz
zzazz is a forward-thinking company dedicated to leveraging data to drive strategic business decisions. Our Bangalore office fosters a collaborative environment where innovation thrives, and team members are empowered to contribute to impactful projects.