Azure Big Data Engineer

Chief Big Data ArchitectBengaluru, IndiaPosition OverviewHuawei is a recognized leader in both fixed and mobile network technologies. As the industry shifts towards a unified CT & IT networking paradigm, we are enhancing our R&D initiatives to develop a scalable, multi-tenant computing and communication infrastructure platform, specifically designed to meet the diverse requirements of our CT & IT clientele.We are seeking talented architects to join our Big Data team at the Huawei India R&D center, where you will play a pivotal role in advancing our big data platform solutions.If you have a passion for big data storage technologies, such as distributed file systems and noSQL data stores, alongside experience with open-source projects like HDFS and HBase, this is an opportunity to lead architectural design, tackle complex technical challenges, and contribute to innovative solutions at Huawei.Key Responsibilities:Collaborate closely with the Product/Platform team in China and the R&D team in the USA to:· Define short-term and long-term business roadmaps for Big Data, addressing customer pain points and delivering competitive products.· Architect and design the next generation of storage engines that are secure, reliable, and scalable.· Analyze challenges in big data storage and innovate solutions for distributed storage engines through POCs and partnerships.· Rapidly iterate on new designs and technologies, delivering prototypes and releases.Qualifications:15+ years of relevant experience in big data and distributed systems.Strong analytical and problem-solving skills.Bachelor's degree or higher in Computer Science or a related field.

We are seeking a talented and experienced Big Data Architect to join our dynamic team at Squircle IT Consulting Services. In this role, you will be pivotal in designing and implementing robust data architectures that support our clients' needs in the ERP and Business Intelligence domains. Your expertise in big data technologies will enable us to deliver innovative solutions that drive efficiency and scalability.

Position: Big Data Lead & DeveloperExperience: 8-10 yearsLocation: BengaluruIndustry: TelecommunicationsEmployment Type: Full-time Visa Sponsorship: Available for on-site client workCore Competency: In-depth knowledge of the data management landscape with a strong grasp of core Big Data design patterns and challenges in data analytics, modeling, quality improvement, and data management implementation. Proficient in technologies such as Hadoop, Spark, Amazon Web Services, Google Cloud Platform, and Microsoft Azure.Position Overview: The Big Data Lead will spearhead the design and development of scalable and distributed applications utilizing the Hadoop Technology Stack, including Apache Pig, Apache Hive, and HDFS.Key Responsibilities:Develop cutting-edge ICT big data solutions that integrate existing systems with new data analytics strategies.Design, test, deploy, and document Big Data platforms and analytical procedures.Deliver scalable and distributed applications utilizing Hadoop technologies.Provide efficient solutions based on project requirements.Implement Map/Reduce jobs, UDFs, and tune the performance of Hadoop jobs.Collaborate with data scientists, analysts, and product management to summarize data analysis results for business decision-making.Document functional processes within data quality applications.Research and assess the suitability of various technologies to advise on optimal project solutions.

Join Huawei Technologies as a Big Data Automation Tester!Location: BengaluruEmployment Type: 2-Year Contract (Under Third Party Payroll)This contract may be renewable after two years based on performance.Experience Required: 3+ YearsTechnical Skills Required: C, Python, Linux Kernel, Scripting, Big DataJob Summary:We are seeking a dedicated Automation Tester passionate about fixing and debugging software issues. This full-time contractor position will involve testing our advanced suite of solutions for the ARM64 platform, a cutting-edge technology in the industry.Your Responsibilities:Conduct comprehensive testing of the ARM64-based solution, ensuring the identification and verification of various use cases for data center applications.Develop automated test cases and scripts, assist in building test environments, and consolidate reporting for test results.Explore and apply various testing methodologies, and depending on performance, there may be opportunities to engage with open-source projects.What We’re Looking For:Experience in testing or benchmarking server applications, including databases, distributed file systems, Big Data, and virtualization.A strong understanding of use case testing for server and data center applications.Proficient automation skills in scripting languages such as C, Python, or other testing programming languages.Experience with ARM or hardware-based application testing is an added advantage.

Role overview Weekday's Client seeks a Big Data Developer in Bengaluru to improve and maintain data pipelines and processing systems that drive business intelligence and analytics. The position works with large volumes of both structured and unstructured data, spanning cloud and on-premise environments. Collaboration with data engineers, analysts, and product teams is central to delivering reliable, high-performance solutions that support business decisions. What you will do Design, develop, and maintain scalable data pipelines and big data processing systems. Build and optimize data architectures using AWS services to increase availability and performance. Use PostgreSQL for data storage, querying, and performance tuning. Process and analyze large datasets to enable analytics and reporting. Work with cross-functional teams to gather requirements and deliver data solutions. Maintain data quality, integrity, and security across all systems. Optimize data workflows for better performance, scalability, and cost efficiency. Implement ETL and ELT processes for smooth data ingestion and transformation. Monitor and troubleshoot data pipelines to ensure reliability and uptime. Integrate cloud and on-premise data systems to support hybrid environments. Document data architecture, workflows, and best practices for future growth. Location This role is based in Bengaluru, Karnataka, India.

CSQ127R179MissionThe Manager of Technical Solutions in Data & AI will spearhead the development and expansion of a specialized team in India, dedicated to ensuring the resilience and seamless operation of customer production workloads. This leadership position involves overseeing support operations during APJ and EMEA business hours while closely collaborating with global teams to guarantee 24/7 support coverage. The team will tackle intricate and protracted data engineering challenges presented by Databricks clients, facilitating the success of real-time use cases. Responsibilities include performance optimization, ensuring production job reliability, and assisting customers in stabilizing workloads on innovative products and features. You will deeply understand the genuine business challenges our clients face with data and be committed to enhancing the reliability and performance of their systems to achieve their objectives.The Impact You Will Have:Lead as the Technical Solutions Manager for an elite team of Data & AI professionals, providing support across EMEA and APJ business hours.Enhance the technical proficiency of the team to ensure successful adoption of new Databricks platform products and features for customer production workloads.Engage with top-tier clients to comprehend their business needs pertaining to Data & AI strategy, collaborating with field engineering and sales as necessary.Partner with internal product engineering teams to improve Databricks products’ supportability and performance.Maintain high reliability of the Databricks platform to help customers achieve their business goals.

We are seeking a talented Spark Architect to join our dynamic team at Squircle IT Consulting Services. As a Spark Architect, you will play a critical role in designing and implementing innovative big data solutions that leverage Apache Spark technology. Your expertise will help us enhance our data processing capabilities and deliver exceptional services to our clients.

Teamwork makes the stream work. Join Roku and Transform the Future of TV Streaming!As the leading TV streaming platform in the U.S., Canada, and Mexico, Roku is at the forefront of revolutionizing how audiences engage with television. Our goal is to power every TV worldwide, connecting viewers to their favorite content while empowering publishers and advertisers with innovative solutions.From day one, your contributions at Roku will be recognized and valued. We are a dynamic, growing public company where every team member plays a crucial role in delighting millions of viewers around the globe while acquiring invaluable experience across diverse fields. About Our Big Data TeamRoku operates one of the largest data lakes globally, managing over 70 PB of data and executing more than 10 million queries each month. Our Big Data team is responsible for developing and maintaining the platform that makes this possible. We offer tools to acquire, generate, process, monitor, validate, and access data for both streaming and batch processing. Our technologies include Scribe, Kafka, Hive, Presto, Spark, Flink, Pinot, and more. The team actively contributes to the Open Source community and aims to expand its involvement.Your RoleWe are modernizing our Big Data Platform and need your expertise to redefine our architecture to enhance user experience, reduce costs, and boost efficiency. If you are passionate about Big Data technologies and eager to explore Open Source, this position is tailored for you!Key ResponsibilitiesOptimize and fine-tune existing Big Data systems and pipelines, while also developing new ones to ensure they operate efficiently and cost-effectively.

Join Databricks as a Senior Solutions Architect, where you will play a pivotal role in transforming the way organizations harness the power of data. In this position, you will collaborate with clients to design and implement innovative solutions that drive business success through data analytics and machine learning. Your expertise will guide teams in adopting Databricks' unified analytics platform, ensuring seamless integration and maximum value delivery.

Role overview SanDisk seeks a Data Platform Architect based in Bengaluru to define and develop the architecture for its data platform. This position works in close partnership with teams throughout the company, ensuring data solutions are designed to meet evolving business needs and can scale effectively. What you will do Shape the overall architecture and strategy of SanDisk’s data platform Work with cross-functional teams to design data solutions that can grow with the company Use expertise in data architecture to support business objectives and drive greater efficiency

We are seeking a skilled HBase Architect to join our dynamic team at Squircle IT Consulting Services. In this role, you will leverage your expertise in HBase and related technologies to design and implement scalable data solutions. You will collaborate with cross-functional teams to optimize our data architecture, ensuring robust performance and reliability.

Role overview Bosch Group is seeking a Cloud Data Architect in Bengaluru to design and implement cloud-based data architectures for both operational and analytical needs. This role shapes the company’s data strategy and supports projects that rely on secure, reliable, and scalable data solutions. What you will do Design and build cloud data architectures that meet business and technical requirements Implement solutions that support both day-to-day operations and analytics Work closely with cross-functional teams to develop and optimize data processes Help ensure data integrity, availability, and security across all cloud data systems Contribute to data-driven decision-making throughout the organization Location Bengaluru

Role overview Bosch Group is hiring a Cloud Data Architect in Bengaluru. This role leads the design and development of cloud-based data architectures that support integration, storage, and analysis. The position plays a key part in building data solutions that help advance Bosch's technology and services.

Eram Talent, a premier talent acquisition firm, is seeking a talented Data & AI Architect to enhance our team in Saudi Arabia. In this pivotal role, the Data & AI Architect will design and implement innovative data-driven solutions that utilize advanced analytics and artificial intelligence to facilitate business decisions across various projects in the region.The ideal candidate will possess extensive knowledge in data architecture, data modeling, and AI/ML technologies. You will work closely with cross-functional teams to ensure a robust, scalable data architecture that aligns with business strategies. This position presents a thrilling opportunity to innovate and influence the future of data utilization within organizations.Key ResponsibilitiesLead the development of enterprise data architecture and expand it to incorporate AI and MLOps capabilities to support trustworthy analytics and scalable AI delivery.Formulate and execute a comprehensive data architecture strategy that aligns with business objectives and AI initiatives.Create data models, database structures, and data flow processes to guarantee data integrity, accessibility, and security.Design and supervise the deployment of advanced analytics solutions, including machine learning models and algorithms.Collaborate with data engineering and data science teams to ensure the efficiency of data pipelines in line with AI/ML requirements.Establish best practices for data governance, quality, and lifecycle management.Assist in the selection and implementation of data management tools and technologies.Engage with stakeholders to comprehend their data needs and ensure that data solutions deliver maximum business impact.Stay updated on trends in the data and AI landscape, adjusting strategies as necessary to foster continuous improvement and innovation.

FEQ227R52 As a Solutions Architect specializing in Analytics, AI, Big Data, and Public Cloud, you will play a pivotal role in guiding the technical evaluation phase within a dynamic sales environment. Serving as a technical advisor to the sales team, you will collaborate closely with the product team as a strong advocate for customers in the field. Your mission will be to empower our customers to achieve significant, data-driven outcomes through the innovative use of our Databricks Lakehouse Platform, assisting data teams in completing projects and seamlessly integrating our platform into their enterprise ecosystems. This role presents an opportunity for you to grow as a leader in the industry, addressing our customers' most pressing challenges in big data, analytics, data engineering, and data science.

Harness is revolutionizing the software delivery landscape with its AI-driven platform, spearheaded by visionary technologist and entrepreneur Jyoti Bansal, the founder of AppDynamics, which was acquired by Cisco for $3.7 billion. With approximately $570 million raised in funding and a valuation of $5.5 billion, Harness is backed by prominent investors, including Goldman Sachs, Menlo Ventures, IVP, Unusual Ventures, and Citi Ventures. As AI accelerates code generation, the challenges have evolved beyond coding to encompass testing, deployments, application security, reliability, compliance, and cost optimization. Harness integrates AI and automation into this "outer loop," empowering teams to deliver software more rapidly while ensuring security and governance throughout the software delivery lifecycle.Utilizing Harness AI and the Software Delivery Knowledge Graph, the Harness Platform embeds intelligent automation and contextual insights across the software delivery lifecycle, ensuring governance and policy-driven controls are integral to the platform.In the past year alone, Harness has facilitated over 185 million deployments, 82 million builds, 18 trillion flag evaluations, 8 million security scans, 9.1 billion optimized tests, 3 trillion protected API calls, and managed $2.8 billion in cloud expenditure. Our solutions have enabled key clients such as United Airlines, Morningstar, and Choice Hotels to accelerate their release cycles by up to 75%, decrease cloud costs by up to 60%, and achieve a tenfold increase in DevOps efficiency.With a global presence spanning 14 offices and 25 countries, Harness is at the forefront of shaping the future of AI software delivery. We are seeking exceptional talent to join us in our mission to innovate and accelerate.

We are seeking an experienced Senior Data Engineer with a strong background in DevOps and Data Engineering technologies. The ideal candidate will have between 7 to 12 years of relevant experience and will be responsible for designing and implementing scalable data solutions.Key Responsibilities:Develop, maintain, and optimize data pipelines and architecture.Leverage DevOps principles to automate processes and enhance data workflows.Collaborate with cross-functional teams to deliver high-quality solutions.

Teamwork makes the stream work. Roku is revolutionizing the way the world experiences televisionAs the leading TV streaming platform in the U.S., Canada, and Mexico, Roku aims to empower every television globally. With a pioneering spirit, we connect users to their favorite content, support content creators in growing their audiences, and provide advertisers with innovative ways to engage viewers.From your first day at Roku, you'll be an integral part of our journey. As a fast-growing public company, everyone here plays a crucial role. Join us in delighting millions of TV streamers worldwide while gaining invaluable experience across various disciplines. About the TeamThe Roku Data Engineering team is dedicated to building a state-of-the-art big data platform that empowers both internal and external stakeholders to leverage data for business growth. Our team collaborates closely with business partners and engineering teams to gather metrics on essential initiatives for success. As a Senior Data Engineer focused on device metrics, you will design data models and develop scalable data pipelines to capture critical business metrics across our diverse range of Roku devices. About the RoleAt Roku, we connect users to the streaming content they love and enable content publishers to monetize large audiences while providing advertisers with unique capabilities to engage consumers. Our Roku streaming players and Roku TV™ models are available worldwide through direct retail sales and partnerships with TV brands and pay-TV operators. With millions of devices sold in numerous countries, thousands of streaming channels, and billions of hours of content consumed, the development of a scalable, highly available, fault-tolerant big data platform is crucial to our success. This role is based in Bengaluru, India and requires hybrid work, with three days in the office. What You'll Be DoingDevelop and maintain highly scalable, fault-tolerant distributed data processing systems (both batch and streaming) handling terabytes of data ingested daily and managing a petabyte-sized data warehouse.Design and implement efficient data models and pipelines that support business growth and decision-making.

We are seeking a passionate Data Scientist with a strong affinity for solving complex problems involving large datasets. The ideal candidate will have a solid understanding of machine learning algorithms and principles, complemented by exceptional organizational and interpersonal skills.Key Responsibilities:Analyze and extract meaningful insights from unstructured data while adhering to organizational guidelines.Collaborate in the development of components for frameworks or products.Utilize database management systems such as Oracle or MS SQL Server.Employ programming languages and tools including JQuery, JavaScript, HTML, CSS, SVN, and GIT.