Big Data Hadoop Engineer

Join our dynamic team at Squircle IT Consulting Services Pvt Ltd as a Big Data Hadoop Engineer. In this pivotal role, you will leverage your expertise in big data technologies to design, implement, and maintain robust data processing systems that drive data-driven decision-making. You will work closely with cross-functional teams to develop scalable solution…

Join Sutherland as a Lead AI Engineer and spearhead innovative projects in artificial intelligence. In this pivotal role, you will lead a talented team, driving the design and implementation of cutting-edge AI solutions that enhance operational efficiency and deliver exceptional client outcomes.

About Us:BigID is a pioneering tech startup specializing in cutting-edge solutions for data security, compliance, privacy, and AI data management. We are at the forefront of the data landscape, empowering our customers to mitigate risks, foster business innovation, achieve compliance, build trust, make informed decisions, and maximize the value of their data.We are committed to building a global team united by a passion for innovation and advanced technology. BigID has received numerous accolades, including:Named a Hot Company in Artificial Intelligence and Machine Learning at the Global InfoSec AwardsListed in Citizens JMP Cyber 66 as one of the Hottest Privately Held Cybersecurity CompaniesCRN 100 list recognizes BigID as one of the 20 Coolest Identity Access Management and Data Protection Companies for three consecutive yearsRanked among the DUNS 100 Best Tech Companies to Work forFeatured as a Top 3 Big Data and AI Vendor to Watch in the 2023 BigDATAwire Readers' and Editors' Choice AwardsIncluded in the 2024 Inc. 5000 list for the fourth consecutive year!Shortlisted for the 2024 AI Awards in the Best Use of AI in Cybersecurity categoryAt BigID, our team is the cornerstone of our success. Join our dynamic, people-centric culture where you’ll have the opportunity to collaborate with some of the most talented professionals in the industry who prioritize innovation, diversity, integrity, and teamwork.Who We Are Looking For:We are on the hunt for a Senior Data Platform Engineer to enhance our Data Platform team. The ideal candidate will possess substantial experience in data engineering, particularly with Kafka and Elasticsearch, to design and maintain our robust data platforms. You will collaborate closely with cross-functional teams to ensure the scalability and reliability of our data solutions.Role Overview:As a Senior Data Platform Engineer, you will be instrumental in the design, development, maintenance, troubleshooting, and implementation of our big data architecture. Your proficiency in Elastic, Kafka, and Node.js will play a vital role in ensuring the scalability and performance of our data systems.Key Responsibilities:Develop data processing pipelines utilizing Kafka for real-time data streaming.Enhance and manage search functionalities leveraging Elastic technologies.Work alongside product managers, data analysts, and stakeholders to gather requirements and translate them into technical specifications.Lead code reviews and promote best practices in coding and data handling.

Join Appian as a Lead Software Engineer, where you will spearhead our software development initiatives, leveraging cutting-edge technologies to drive innovative solutions. In this role, you will guide a team of talented engineers, ensuring the design and implementation of high-quality software products that meet our clients' needs.

Join Appian as a Lead Software Engineer and take a pivotal role in shaping innovative software solutions. You will lead a team of talented engineers, driving the development of impactful applications that enhance business processes. Your expertise will be essential in mentoring junior developers, ensuring code quality, and implementing best practices in software engineering.

Join Appian as a Lead Software Engineer and take your career to the next level! We are seeking an innovative, passionate individual to lead our software development team. In this role, you will be responsible for designing, developing, and maintaining high-quality software solutions that meet our clients' needs.The ideal candidate will have a strong background in software engineering, excellent problem-solving skills, and the ability to work collaboratively in a fast-paced environment. If you're ready to make an impact and drive technological advancements, we want to hear from you!

Join our dynamic team as a Technology Engineer specializing in DevOps, containerization, and big data technologies. In this pivotal role, you will drive enterprise-level digital and data platform initiatives, ensuring the design, implementation, and optimization of scalable infrastructure and data solutions.Key ResponsibilitiesDevOps & CI/CDDesign, implement, and maintain robust CI/CD pipelines leveraging tools such as Jenkins and GitOps.Automate build, deployment, and release processes to enhance operational efficiency and reliability.Containerization & OrchestrationDeploy and manage containerized applications utilizing Kubernetes and OpenShift.Ensure high availability, scalability, and resilience of applications.Infrastructure as Code (IaC)Develop and manage infrastructure using Terraform, Ansible, or comparable tools.Maintain version-controlled infrastructure to promote consistency and scalability.Big Data EngineeringArchitect and implement data solutions with Hadoop, Spark, and Kafka.Manage large-scale data processing and streaming pipelines.Distributed SystemsDesign and oversee distributed data architectures.Optimize data storage and processing performance across various systems.CollaborationEngage closely with engineering, DevOps, and data teams to deliver comprehensive solutions.Translate business and technical requirements into scalable implementations.Monitoring & Performance OptimizationImplement monitoring, logging, and alerting solutions.Continuously enhance system performance, reliability, and cost-efficiency.Security & ComplianceEnsure that infrastructure and data platforms adhere to security best practices.Maintain compliance with enterprise and regulatory standards.

Who We AreAt Platform Science, we are on a mission to connect everything that moves.Established in 2015, we are an innovative IoT platform collaborating with forward-thinking fleets, application developers, vehicle manufacturers, and equipment providers within the transportation industry to deliver groundbreaking solutions to supply chain professionals worldwide.Our workforce is a vibrant, diverse group of individuals who believe in the potential of transformative ideas. We seek candidates with varied experiences and perspectives to cultivate a company culture that drives growth through innovation.We cherish thoughtful actions and empathy for others. We tackle challenges with resilience and creativity, fostering transparency because, regardless of our diverse backgrounds or responsibilities, we are one team.

About ValGenesis ValGenesis is at the forefront of digital validation platforms for the life sciences sector. Our innovative suite of products is utilized by 30 of the top 50 global pharmaceutical and biotech companies, enabling them to undergo digital transformation while ensuring total compliance and achieving manufacturing excellence across their product lifecycle. Discover more about the opportunities at ValGenesis, the industry standard for paperless validation in Life Sciences: valgenesis.com/aboutPosition Overview:ValGenesis is seeking a dynamic Lead Test Engineer to enhance our development team. As a pivotal member of our development scrum teams, you will collaborate closely with developers and business analysts/product owners to ensure the thorough verification of all digital products prior to client delivery.

Join our dynamic team at minderacraft as a Senior Data Engineer, where your expertise will be pivotal in shaping our data infrastructure. We are seeking a highly skilled individual with a deep understanding of big data technologies, ETL/ELT processes, and data modeling methodologies. Your primary focus will be to design, optimize, and maintain robust data pipelines, ensuring the integrity of our data and supporting our analytics initiatives.

ValGenesis builds digital validation platforms for life sciences organizations. Its products support pharmaceutical and biotech companies as they move toward digital processes, maintain regulatory compliance, and ensure manufacturing quality throughout the product lifecycle. Thirty of the top fifty global firms in this industry use ValGenesis solutions. More details about the company's work in paperless validation are available at valgenesis.com/about. Role overview The Senior Software Engineer - Data Engineering position is based in Chennai. This role focuses on developing and maintaining data engineering solutions to support ValGenesis platforms. Work will center on building systems that help life sciences clients manage and analyze data for compliance and quality throughout their operations.

Orion Innovation stands as a leading, award-winning global business and technology services provider. We are committed to delivering transformative business solutions and innovative product development, grounded in digital strategy, experience design, and engineering. Our unique blend of agility, scale, and maturity empowers us to assist a diverse range of clients across various industries, including financial services, telecommunications, consumer products, automotive, life sciences, e-commerce, education, and entertainment.Role: Lead Generative AI EngineerExperience: 8+ years with significant hands-on experience in Generative AI and Large Language Models (LLMs).We are in search of a forward-thinking and highly skilled Lead Generative AI Engineer to direct the design, development, and deployment of cutting-edge AI-powered solutions. In this pivotal role, you will lead a talented team of engineers and data scientists, leveraging advanced Generative AI technologies to tackle intricate business challenges, enhance user experiences, and foster innovation. This position demands deep technical acumen, exceptional leadership capabilities, and a robust understanding of current AI trends and tools.

We are seeking a skilled and innovative Lead Software Engineer to join our dynamic team at Appian. In this pivotal role, you will leverage your expertise to lead the development and delivery of high-quality software solutions. You will collaborate with cross-functional teams to design, implement, and maintain applications that enhance our platform's capabilities.The ideal candidate will have a strong background in software engineering, along with a passion for mentoring and guiding junior developers. You'll be responsible for ensuring best practices in coding, architecture, and design.

Join Appian as a Lead Software Engineer specializing in Java to drive groundbreaking projects and lead a team of innovative developers. In this role, you will be pivotal in designing, developing, and maintaining high-performance applications while ensuring systems are scalable, reliable, and secure.This position offers the opportunity to work in a collaborative environment where your technical expertise and leadership skills will contribute to the overall success of our engineering team.

Join Forbes Advisor as a Lead Quality Assurance Engineer, where you will play a pivotal role in ensuring the highest quality of our products. You will lead a team of QA professionals, implementing best practices and technologies to enhance our testing processes. Your expertise will guide the team in designing test plans, executing tests, and ensuring the product meets our high standards before it reaches our customers.

Vultr is expanding its global cloud infrastructure with a new data center in Chennai. The Data Center Operations Engineer will play a central role in preparing this facility for launch and ensuring it meets Vultr’s operational standards from day one. This position acts as the on-site operational lead during the initial ramp-up phase, before permanent staff are in place. The engineer will coordinate readiness activities, make deployment decisions, and serve as Vultr’s technical and operational point of contact at the new site. The role offers significant autonomy and direct influence on how the Chennai data center comes online and supports Vultr’s growth in new markets. What you will do Act as the primary operational owner for the Chennai data center during launch and ramp-up phases Evaluate site conditions to apply Vultr’s infrastructure standards and operational procedures Plan, coordinate, and sequence deployment activities to bring systems online safely and efficiently Track and report on operational performance metrics throughout the launch process Employee benefits Annual medical insurance stipend 9 paid company holidays Generous leave policy, including a 1-month paid sabbatical every 5 years and an anniversary bonus each year Professional development reimbursement Fitness membership reimbursement Company-sponsored Wellable subscription

Role overview Freshworks Inc. seeks a Lead Software Engineer - Site Reliability to join the team in Chennai. This position is responsible for ensuring the availability and reliability of Freshworks’ systems, supporting the company’s focus on dependable customer experiences. What you will do Lead a team of engineers dedicated to site reliability Analyze and tune systems to improve performance Automate operational tasks to minimize manual work Implement and encourage best practices in software reliability engineering Location This position is based in Chennai.

Join Ramboll as a Lead Mechanical Engineer in the dynamic and ever-evolving Energy sector in Chennai. In this pivotal role, you will leverage your expertise in mechanical engineering to drive innovative solutions that enhance efficiency and sustainability in energy systems.Your responsibilities will include leading design projects, collaborating with multidisciplinary teams, and ensuring that all engineering solutions comply with industry standards and best practices. This is a fantastic opportunity for professionals looking to make a significant impact in the energy sector.

Join our dynamic Data Team at Mindera, where as a Senior Data Engineer, you will play a pivotal role in creating the data pipelines and tables that drive our business-critical dashboards, empower self-service analytics, and support advanced machine learning models and real-time data products. Utilizing state-of-the-art tools such as DBT, Spark, and Airflow, you will convert high-volume raw event data into user-friendly, impactful datasets.You will collaborate cross-functionally with Machine Learning Engineers, Data Scientists, and BI Developers to facilitate data-driven decision-making throughout the organization. Our engineers benefit from a culture of autonomy, innovation, and continuous learning, supported by structured career progression paths and access to training resources.As a Senior Data Engineer, your responsibilities will include:Designing and constructing scalable data pipelines, models, and feature stores to support analytics and machine learning workloads.Deploying and managing cloud-native data applications on AWS, leveraging CI/CD pipelines to automate builds, tests, and releases.Ensuring the technical quality, performance, and reliability of production-grade data pipelines through robust observability and engineering best practices.

Join our dynamic team at gsstech-group as a Data Engineer specializing in real-time streaming and event-driven architectures. We seek a talented individual who will take charge of creating scalable data pipelines, enhancing streaming systems, and achieving optimal performance in distributed environments.Key ResponsibilitiesDesign and implement real-time data streaming pipelines utilizing technologies such as Apache Flink, Kafka, and JavaBuild and sustain event-driven architectures for extensive distributed systemsConduct JVM tuning and performance optimization for streaming applicationsDevelop and deploy applications utilizing containerization tools (Docker, Kubernetes)Utilize the Cloudera platform for data engineering and pipeline orchestrationApply robust design patterns while upholding high coding standardsTroubleshoot and resolve challenges within a distributed systems ecosystemCollaborate with DevOps teams to manage CI/CD pipelines (GitHub, Jenkins)Operate on Linux-based systems, including configuration and shell scriptingEnhance data processing through caching mechanisms (e.g., Redis – considered a plus)Required Skills & ExperienceExtensive hands-on experience in Real-Time Streaming (Flink / Kafka / Java)Comprehensive understanding of event-driven architectureExperience with JVM performance tuningProficiency in Docker and KubernetesStrong background in Linux OS and shell scriptingKnowledge of design patterns and scalable system designFamiliarity with CI/CD tools such as GitHub and JenkinsPractical troubleshooting experience in distributed systemsNice to HaveFamiliarity with Redis or other caching systemsExposure to Cloudera Data Platform engineeringPrior experience in the banking or financial domain is advantageous