Senior Databricks Data Engineer

Empower Hardware Innovators to Create Superior Products, SwiftlyAt Fictiv, we thrive on enabling product innovators to bring their visions to life.Fictiv stands at the forefront of global manufacturing and supply chain solutions, empowering organizations to scale seamlessly across our four manufacturing hubs located in India, Mexico, China, and the United States. Businesses turn to Fictiv for unparalleled production quality, optimized supply chain logistics, and effective risk management—facilitating a smooth transition from prototypes to full-scale manufacturing with agility and assurance. With over 35 million commercial and prototype parts delivered across various industries, including aerospace, robotics, automotive, and climate tech, Fictiv is dedicated to accelerating innovation and fostering resource optimization for sustainable growth. Why Join Us?Unleash Your CreativityBreak free from the constraints of conventional processes. At Fictiv, a growth mindset is woven into our culture, granting you the creative freedom and collaborative support to explore bold ideas and meet our sales and customer objectives.Advance Your CareerBe part of a team that nurtures your growth—surrounded by passionate peers who inspire you to reach your fullest potential.Role ImpactJoin our Data Intelligence team, where you will develop insightful reports and dashboards that translate data from our warehouse into actionable insights. Collaborate closely with cross-functional teams and utilize various Business Intelligence (BI) technologies to promote data-driven decision-making throughout the organization.

Join HackerOne as a Senior Data Engineer and be a cornerstone in our mission to help organizations find and fix vulnerabilities in their systems. You will be responsible for designing, developing, and maintaining robust data pipelines that ensure our data is clean, accurate, and accessible for key stakeholders.In this role, you will collaborate with cross-functional teams to understand their data needs and deliver innovative solutions that improve data-driven decision-making processes. Your contributions will play a vital role in our analytics capabilities and overall business strategy.

Lead Data EngineerJoin our dynamic team at Brillio as a Senior Data Engineer, where you will be at the forefront of innovative data solutions. In this pivotal role, you will lead the design and implementation of data architecture, ensuring robust data pipelines and analytics capabilities. Collaborate with cross-functional teams to drive data-driven decision-making and enhance operational efficiency.

Join our dynamic team at Pattern as a Senior Data Infrastructure Engineer. In this pivotal role, you will drive the design and implementation of robust data infrastructure solutions that enhance our data processing capabilities. You will collaborate with cross-functional teams to ensure seamless data flow and integration across various platforms.We are seeking a forward-thinking engineer who thrives in a fast-paced environment and is passionate about leveraging data to solve complex problems. If you possess a strong technical background and a desire to innovate, we want to hear from you!

Join our team as a Senior Data Engineer for an esteemed international client in a fully remote capacity. Collaborate with a diverse global team while working from the comfort of your home in India.Total Experience Required: 7+ YearsYour Responsibilities:Lead the design, architecture, and end-to-end delivery of scalable and low-latency streaming platform solutions to provide real-time data solutions.Develop clean, scalable code using languages such as Go, TypeScript, Node.js, Scala, Python, and SQL, while testing and deploying applications and systems.Address complex data challenges in real-time by employing optimal data architectures, frameworks, and query techniques from structured and unstructured data sources.Contribute to an engineering organization focused on delivering secure, high-quality, and scalable solutions to our clients.Engage in product and platform performance optimization and monitor live site operations.Mentor junior team members by providing and receiving constructive feedback.Our Technology Stack:AWS (including Lambda, SQS, Kinesis, KDA, Redshift, Athena, DMS, Glue, Go/TypeScript, DynamoDB), Airflow, Flink, Spark, Looker, EMRContinuous deployment process managed through GitLabAbout You:A Bachelor's degree in a technical field (e.g., Computer Science or Mathematics).3+ years of experience in real-time, event-driven architecture.3+ years of experience with modern programming languages including Scala, Python, Go, and TypeScript.Proven experience in designing complex data processing pipelines.Familiarity with data modeling (including star schema and dimensional modeling).Experience in query optimization.Knowledge of Kafka is a plus.Experience in shipping and maintaining code in production.A collaborative mindset and a passion for sharing ideas.Why Join Us? A pivotal moment for growth and expanding opportunities.‍ We prioritize our people and promote a healthy work-life balance. A fast-paced learning environment with an entrepreneurial spirit and strong team camaraderie. A diverse and multicultural workforce with over 45 nationalities represented. Competitive salary and comprehensive benefits, including health coverage, meal provisions, transportation, and wellness initiatives.Diversity, Equity, and Inclusion Statement:We believe that diversity, equity, and inclusion are fundamental to our journey, regardless of origins, identity, background, or orientation.

Join Our Team as a Senior Data Engineer!At Brillio, we are seeking a talented Senior Data Engineer to enhance our AI & Data Engineering department. You will play a crucial role in developing data-driven solutions that empower businesses to make informed decisions. You will collaborate with cross-functional teams, leveraging your expertise to drive innovation and efficiency.

Position OverviewJoin Assent as a Senior Data Engineer, where you'll be pivotal in enhancing our data engineering practices while serving as a hands-on technical expert. In this role, you'll be instrumental in the vision and implementation of our data engineering strategies, developing secure, scalable, and high-performing data platforms. Your responsibilities will include leading significant technical initiatives, collaborating on architectural decisions, and executing complex data engineering tasks that align with Assent's business objectives. You will engage in designing, developing, and implementing advanced data solutions, providing mentorship and technical guidance to fellow engineers. Your work will have a substantial impact across the organization as you advocate best practices, innovate our data engineering capabilities, and work on the technical solutions necessary for advancing our data systems.Key ResponsibilitiesShape the strategic vision for data engineering and participate in the design and development of intricate data solutions, emphasizing scalability and performance.Design and establish new data systems and infrastructure to guarantee the reliability and scalability of our data systems through active involvement in daily engineering tasks.Impact key decisions regarding our data technology stack, infrastructure, and tools while engaging in hands-on engineering tasks related to new data architectures and workflows.Set coding standards and best practices for the Data Engineering & Operations team, conducting code reviews to uphold high-quality, consistent code.Collaborate closely with database developers, software developers, product managers, and AI/ML teams to ensure alignment of data initiatives with Assent's organizational goals.Work alongside team members to track progress, reassess priorities, and meet project deadlines and objectives.Identify opportunities for internal process enhancements, including automation of manual tasks and optimization of data delivery.Actively support colleagues in continuous learning by offering technical guidance and training in data engineering development, analysis, and execution.

About TripleLiftAt TripleLift, we are dedicated to revolutionizing the digital advertising landscape by integrating stunning creative, quality publishers, insightful data, and intelligent targeting. With over 1 trillion monthly ad transactions, our platform empowers publishers and platforms to effectively monetize their offerings. Our cutting-edge technology enables top brands to connect with audiences through online video, connected television, display, and native ads. Our innovative solutions, premium formats, and dedicated support team are why brands and enterprises trust us to enhance their advertising performance.As a proud member of the Vista Equity Partners portfolio and NMSDC certified, we are committed to economic inclusion and diversity in our spending initiatives. Discover how TripleLift is elevating the programmatic advertising ecosystem at triplelift.com.The Role:We are looking for a Senior Data Engineer to join our dynamic and impactful Data Engineering team. In this role, you will be instrumental in expanding and optimizing our high-volume, low-latency data platform architecture, enhancing data flow, and streamlining data collection processes for cross-functional teams. The ideal candidate is a seasoned data pipeline engineer and an adept data wrangler who thrives on optimizing and building data systems from the ground up. This position will collaborate with software engineers, product managers, business intelligence analysts, and data scientists to drive data initiatives and ensure the consistent application of optimal data delivery architecture across new and ongoing projects. Candidates should be self-directed and capable of supporting the diverse data needs of multiple teams, systems, and products. You will be excited about the prospect of optimizing or redesigning our data architecture to support the next generation of products and initiatives.

About Us Capco, a Wipro company, is a leading global technology and management consulting firm. Recognized as the Consultancy of the Year at the British Bank Awards and ranked among the Top 100 Best Companies for Women in India 2022 by Avtar & Seramount, we operate in 32 cities worldwide and support over 100 clients in the banking, financial, and energy sectors. Our expertise lies in delivering transformative solutions that drive deep change. WHY JOIN CAPCO? Engage in exciting projects with major international and local banks, insurance firms, payment service providers, and other key industry players. Be part of initiatives that are reshaping the financial services landscape. MAKE AN IMPACT Utilize your innovative thinking and delivery excellence to help our clients transform their operations. Collaborate with industry partners to deliver groundbreaking work that is revolutionizing energy and financial services. #BEYOURSELFATWORK Capco fosters an inclusive and open culture that celebrates diversity and creativity. CAREER ADVANCEMENT At Capco, we embrace a flat hierarchy where everyone has the chance to grow alongside the company, taking control of their career progression. DIVERSITY & INCLUSION We believe that diverse perspectives and backgrounds provide us with a competitive edge. MAKE AN IMPACT Location: Pune/BangaloreExperience Range: 5–9 years Role Overview:The Senior Data Engineer will be responsible for designing and developing intricate data pipelines, ensuring comprehensive solution delivery across enterprise-scale Big Data environments. This role focuses on data reliability, performance, and adherence to engineering best practices. Must-Have Skills:• 5–9 years of experience in Data Engineering within Data Warehouse/Data Lake/Lakehouse environments• Proficient in Spark development (Scala/Python/Java) on Hadoop or object storage• Strong SQL skills (Oracle/Netezza/Hive or similar)• Proven experience in delivering large-scale data pipelines• Familiarity with Agile/Scrum methodologies Optional Skills:• Experience building NiFi pipelines and using cloud platforms is a plus.

About Gen Digital Gen Digital is a global company known for empowering digital freedom through well-known consumer brands such as Norton, Avast, LifeLock, and MoneyLion. With a long history in cybersecurity and financial empowerment, Gen Digital provides solutions in cybersecurity, online privacy, identity protection, and financial wellness to nearly 500 million users in more than 150 countries. The company’s mission centers on protecting consumers and supporting them as they manage and secure their digital and financial lives. Gen Digital values talent that sees AI as a collaborative tool for driving progress and delivering real results. Gen Digital offers flexible work options, generous time off, competitive pay, and comprehensive well-being programs. The culture emphasizes customer focus, open debate, experimentation, and continuous learning. Team members come from diverse backgrounds and experiences, and mutual respect is central to how the organization works. Role Overview: Senior Principal Data Engineer Location: Pune, India The Senior Principal Data Engineer serves as a technical leader, responsible for architecting systems within the team’s area and leading complex projects that support Gen Digital’s cybersecurity platform strategy. This position calls for deep expertise in designing sophisticated systems and identifying projects that address challenging business needs. Mentoring other engineers is also a key part of the role. This engineer will take broad ownership of several areas of the codebase or multiple services. Collaboration with a Manager or Technical Director will be essential to validate technical decisions and drive improvements in data engineering practices and standards.

Are you passionate about data and eager to drive partner success? If you possess a blend of tenacity and analytical skills, we invite you to join Pattern! We are on a mission to elevate one of the fastest-growing companies in the United States, and we need your expertise to help us achieve our goals.At Pattern, we empower brands to thrive on global ecommerce marketplaces through our cutting-edge technology and artificial intelligence. By harnessing over 46 trillion data points and advanced machine learning models, we optimize and automate all facets of ecommerce growth—ranging from advertising and content management to logistics, pricing strategies, forecasting, and customer support. Every day, numerous global brands leverage Pattern's ecommerce acceleration platform to enhance their revenue across more than 60 international marketplaces, including giants like Amazon, Walmart.com, Target.com, eBay, Tmall, TikTok Shop, JD, and Mercado Libre. To explore more about us, please visit pattern.com or reach out via email at press@pattern.com.Pattern has garnered recognition as one of the fastest-growing tech firms in North America by Deloitte and has been celebrated as one of the best-led companies by Inc. We prioritize employee experience at the core of our business model and have been acknowledged as one of Newsweek’s Global Most Loved Workplaces®.As a Senior Data Engineer at Pattern, you will tackle vital business challenges that significantly influence our competitive advantage, utilizing your expertise to drive impactful solutions.

About UsAt Abacus Insights, we are revolutionizing the utilization of data for health plans. Our mission is straightforward: to make healthcare data accessible and actionable, empowering decision-makers to act swiftly and confidently. We dismantle data silos to establish a unified, reliable data foundation that enhances decision-making capabilities, ultimately leading to improved outcomes, minimized waste, and enriched experiences for both members and providers.With a robust backing of $100 million from premier investors, we are addressing significant challenges in an industry poised for transformation. Our platform supports Generative AI use cases by providing clean, interconnected, and dependable healthcare data, facilitating automation, prioritization, and decision-making workflows—positioning us as industry leaders.Our innovative spirit thrives on collaboration and curiosity; we believe that the most impactful ideas emerge from teamwork. Are you ready to make a difference? Join us in shaping the future.About the RoleWe are on the lookout for a Senior Data Quality Assurance Engineer to enhance and oversee data quality across our data platforms and client solutions. In this pivotal role, you will spearhead complex data validation initiatives, develop testing strategies, and serve as a trusted collaborator to Engineering, Product, and Operations teams. You will establish data quality standards, promote automation, and ensure the delivery of reliable, production-grade data solutions at scale.Your Day to DayLead the data quality strategy and execution across various projects and datasets.Collaborate with Engineering, Product, Operations, and Project Management to influence data design and quality outcomes early in the development lifecycle.Conduct advanced data analysis and validation on large-scale, client-specific, and healthcare datasets.Design, execute, and review intricate test plans and test cases, incorporating both automated and manual testing methodologies.Identify systemic data quality risks, conduct root-cause analyses, and collaborate with teams to implement resolutions.Define, refine, and document QA standards, best practices, and verification protocols.Mentor junior QA engineers, providing expertise in testing methodologies and data validation techniques.

About UsAt Abacus Insights, we are revolutionizing the management of data for health plans. Our mission is straightforward: to make healthcare data accessible and actionable, enabling decision-makers in care and cost management to respond swiftly and confidently. We facilitate the dismantling of data silos to establish a unified, trustworthy data infrastructure. This foundation enhances decision-making, leading to improved outcomes, minimized waste, and superior experiences for both members and providers. Supported by $100M in funding from leading investors, we are addressing significant challenges within a transformative industry. Our platform empowers GenAI initiatives by providing clean, interconnected, and reliable healthcare data that underpins automation, prioritization, and decision workflows, positioning us at the forefront of innovation. Our innovative spirit is fueled by our people. We embrace boldness, curiosity, and collaboration, believing that the best ideas emerge from teamwork. Are you ready to make a difference? Join us and let's shape the future together.About the RoleWe are on the lookout for a skilled Data Engineer to join our vibrant and rapidly growing Tech Ops team. With significant growth on the horizon, this role presents a unique opportunity to make a substantial technical impact. You will collaborate with clients, data vendors, and internal engineering teams to design, implement, and optimize intricate data integration solutions within a modern, large-scale cloud setting.Utilizing your advanced expertise in distributed computing, data architecture, and cloud-native engineering, you will create scalable, resilient, and high-performance data ingestion and transformation pipelines. As a trusted technical advisor, you will assist clients in adopting Abacus’s core data management platform and ensure high-quality, compliant data operations throughout the lifecycle.Your Day-to-Day ResponsibilitiesArchitect, design, and implement high-volume batch and real-time data pipelines using PySpark, SparkSQL, Databricks Workflows, and distributed processing frameworks.Develop comprehensive ingestion frameworks that integrate with Databricks, Snowflake, AWS services (S3, SQS, Lambda), and vendor data APIs, ensuring data quality, lineage, and schema evolution.Establish data modeling frameworks, including star/snowflake schemas and more.

Senior Software Engineer - Data Architect Join Convera, a leader in Foreign Exchange payments processing, as a Senior Software Engineer. This role allows for Work From Home options in Pune. We are looking for a seasoned Senior Software Engineer to spearhead the development and optimization of our data systems. Reporting to the Senior Manager, you will be part of a vibrant team dedicated to enhancing data architecture strategies and implementing robust data governance across our organization. This position demands an in-depth comprehension of business processes, technology, data management, and compliance with regulatory standards. You will collaborate closely with business and IT leaders to align the enterprise data architecture with our business objectives while ensuring adherence to data governance policies. Your tasks will involve working alongside data modelers, data engineers, analysts, and cross-functional teams to build a new data platform, integrate diverse data sources, and guarantee data availability for various applications and reporting needs. Familiarity with AI/ML technologies and collaboration with data scientists to fulfill their data requirements is also expected. Key Responsibilities: Design and Develop Data Architecture Solutions: Create scalable and efficient data architecture solutions on the enterprise data platform using tools like Snowflake, Tableau, and AWS. Collaborate on Data Models: Engage with stakeholders to understand data requirements. Lead the architecture and design of data models, schemas, data mappings, and transformations that meet business and analytical needs. Data Integration and Governance: Work with teams to design and maintain data integration solutions, ensuring high data integrity and compliance with security regulations. Business Intelligence Development: Implement semantic models to enhance business intelligence capabilities and reporting solutions.

About the Role  Join PubMatic as a Senior Software Engineer focused on Data Analytics, where you will leverage your expertise to craft and refine AI agents. Your proficiency in technologies such as Hadoop, Spark, Scala, Kafka, and cloud solutions, alongside programming skills in Scala and Python, will be essential. In this role, you will develop sophisticated AI agents that elevate our data analytics capabilities, facilitating complex information retrieval, contextual comprehension, and adaptive interactions, thereby enhancing data-driven insights and analytical workflows.What You'll Do:Design, build, and implement a highly scalable, fault-tolerant big data platform to process vast amounts of data and deliver comprehensive analytics to clients.Develop backend services utilizing Java, REST APIs, JDBC, and AWS.Construct and maintain Big Data pipelines using Spark, Hadoop, Kafka, and Snowflake.Architect real-time data processing workflows and automation frameworks.Create GenAI-powered agents for analytics, operational tasks, and data enrichment, employing frameworks such as LangChain and LlamaIndex.Integrate large language models (e.g., OpenAI, Claude, Mistral) into existing services for enhanced query understanding, summarization, and decision-making support.Oversee end-to-end GenAI workflows, including prompt engineering, fine-tuning, vector embeddings, and retrieval-augmented generation (RAG).Collaborate with cross-functional teams to improve the availability and scalability of large data platforms and enhance PubMatic software functionality.Engage in Agile/Scrum practices such as sprint planning, retrospective sessions, backlog grooming, and user story management.Regularly consult with product managers regarding the integration of new features into the PubMatic Data Analytics platform.Provide support for customer issues through email or JIRA, offering updates and patches to resolve problems.

Veeam is recognized as the Data and AI Trust Company, dedicated to empowering organizations to understand, secure, and fortify their data and AI systems. We are at the forefront of data resilience and security posture management, seamlessly integrating identity, data, security, and AI risk. With our headquarters in Seattle and offices spanning over 30 countries, Veeam safeguards more than 550,000 customers globally, who rely on us for uninterrupted business operations. Join us on our journey to innovate, grow, and make a positive impact for some of the world’s leading brands.About the RoleOur Technical Customer Support team serves as the critical communication link for our customers, transforming the traditional support model. They tackle the complexities of individual support interactions and aim to leave a lasting positive impression while offering vital insights to our development and testing teams.Currently, we are seeking a Public Cloud Data Protection Engineer.What You’ll DoDeliver technical support and comprehensive troubleshooting for Veeam Software’s clients (B2B) through various communication channels including telephone, email, and web conferencing.Act as a technical liaison, building strong relationships with fellow IT professionals.Investigate and resolve customer issues and inquiries.Ensure timely updates and management of assigned cases.Contribute to the creation and enhancement of Veeam’s knowledge base documentation.Maintain accurate records of all customer interactions in our CRM tool, adhering to service level agreements.Stay informed about the latest technologies related to Veeam’s products and underlying technologies.

Join QAD Inc. as a Senior Manager in Engineering to lead our Foundational Platform & Data initiatives. In this pivotal role, you will drive the development and enhancement of our core engineering solutions, ensuring scalability and efficiency. You will collaborate with cross-functional teams to implement innovative strategies that align with our business goals.Your leadership will be crucial in mentoring and guiding a talented engineering team, fostering a culture of continuous improvement and excellence. Bring your expertise in software engineering and your passion for data to make a significant impact in our organization.

Join Assent as an Intermediate Data Engineer and contribute to our mission of making data more accessible and actionable. In this role, you will work with cutting-edge technologies to develop data pipelines, optimize data flows, and ensure data integrity across our platforms.

Join telefonicatech as a Senior Data Engineer in our Managed Services team, where you will play a pivotal role in designing, implementing, and maintaining data solutions that drive business decisions. You will work collaboratively within a dynamic team to create robust data pipelines and ensure data integrity across various platforms.