Lead Data Engineer - Azure, Databricks, Python

At Databricks, we are dedicated to empowering data teams to tackle some of the most challenging issues in the world. From revolutionizing transportation to accelerating medical advancements, our mission is to provide exceptional data and AI infrastructure that enables clients to leverage deep insights for business enhancement. Founded by engineers with a customer-centric mindset, we embrace every opportunity to overcome technical hurdles, from crafting next-generation UI/UX for data interactions to scaling our services across millions of virtual machines. Our journey has just begun. As part of the AI/BI team, we strive to make Databricks the premier platform for business users to create, locate, and utilize data insights. Our focus revolves around four core pillars: Dashboards, Genie, Databricks One, and Unity Catalog Business Semantics. The Unity Catalog empowers users to establish business metrics and metadata within a centrally governed system, ensuring trustworthy access. Databricks One simplifies the user experience for non-technical users to uncover and leverage data insights, while Genie enables conversational queries through advanced text-to-SQL functionality, and Dashboards facilitate everyday business operations. We are on the lookout for a passionate Engineering Leader to expand our Data Visualization and Unity Catalog Business Semantics teams. These teams will engage in complex full-stack challenges, such as enhancing visualization accessibility, creating highly interactive dashboards, developing compelling augmented analytics experiences, offering industry-leading low/no-code authoring capabilities, and boosting the analytical expressiveness of our business semantics products. You will report directly to the Senior Manager of Engineering.

Join Databricks, where our mission is to simplify and democratize data and AI. We are pioneering the next wave of technological advancements, from transforming transportation to accelerating medical breakthroughs. Our world-class data and AI infrastructure platform empower customers to harness deep data insights and enhance their business operations. With a foundation built by engineers who are dedicated to customer satisfaction, we embrace every challenge, from crafting next-gen UI/UX to scaling our services and infrastructure across millions of virtual machines. The journey has just begun!As a Fullstack Software Engineer, you will collaborate with your team and product management to distill complex data insights into simple, user-friendly experiences. We seek engineers driven by a passion for customer-centric solutions, capable of taking ownership of the entire product lifecycle and user experience beyond mere technical implementation. You will play a critical role in establishing the groundwork for building robust, scalable, and delightful products.Our Vancouver location marks the newest R&D hub for Databricks, allowing us to expand our footprint in the Pacific Northwest. We are actively seeking exceptional engineers to join us in our quest to democratize data and AI. We envision this site becoming a pivotal center for product innovation at Databricks, with several strategic areas being developed here, including:Log Analytics - Our clients increasingly rely on Databricks for real-time analysis of petabyte-scale logs, presenting new challenges across the data processing pipeline, including ingestion, indexing, processing, and enhancing user experience.AI/BI - AI/BI is reshaping Business Intelligence for the AI era. Since its launch last summer, adoption has soared (with 98.7% of our data warehousing customers utilizing AI/BI). Our innovative products feature rich dashboarding, advanced visualizations, and powerful talk-to-your-data solutions, encompassing exciting technical challenges across the entire stack.Unity Catalog Business Semantics - In the world of AI, context is paramount. Unity Catalog Business Semantics ensures that enterprise data context is effectively governed and managed. After launching our first Semantics modeling capability, Unity Catalog Metrics, at the recent Data + AI Summit, we have ambitious plans for the future. Engineers in this team navigate the intersection of large-scale distributed systems, data modeling, governance, and AI enablement.Databricks Apps - Databricks Apps is one of the fastest-growing areas in our portfolio, focusing on...

Join Databricks, a pioneering force in data and AI, as we strive to redefine the way businesses leverage data insights! Our mission spans from revolutionizing transportation to enhancing medical advancements through our unparalleled data and AI infrastructure platform. With a foundation built by engineers and a relentless focus on customer needs, we tackle complex technical challenges, from crafting next-generation UI/UX to scaling our services across vast virtual environments. Our journey is just beginning. With the establishment of our Vancouver R&D center, we are expanding our footprint in the Pacific Northwest and are on the lookout for exceptional engineers to help us democratize data and AI. The Vancouver site is poised to become a vital hub for product innovation at Databricks. We are excited to bring strategic initiatives to this location and have multiple roles available across various teams, including: Log Analytics - As more customers utilize Databricks for real-time analysis of petabyte-scale logs, our team faces new challenges across the data processing pipeline, including ingestion, indexing, and processing. AI/BI - Our AI/BI solutions are transforming Business Intelligence for the AI era, with remarkable adoption rates (98.7% among our data warehousing clients). Join us to work on advanced dashboarding, visualizations, and innovative talk-to-your-data functionalities. Unity Catalog Business Semantics - Context is essential for AI, and our Unity Catalog ensures that enterprise data context is meticulously governed and managed. Our recent launch of the Unity Catalog Metrics marks a significant milestone, with more innovations ahead for this team focused on distributed systems, data modeling, governance, and AI integration. Databricks Apps - As one of our fastest-growing products, Databricks Apps has over 2,500 users creating more than 20,000 apps. This team works on low-level platform components, including Kubernetes and networking, while heavily investing in AI-driven app builders.

At Databricks, we are dedicated to revolutionizing the world of data and AI. Our goal is to make data-driven insights accessible to everyone, from pioneering the next mode of transportation to facilitating groundbreaking medical advancements. We achieve this by developing and maintaining the premier data and AI infrastructure platform, empowering our clients to leverage deep data insights to enhance their operations. Founded by engineers with a strong customer focus, we eagerly embrace every chance to tackle technical challenges, whether it involves crafting next-generation UI/UX for data interactions or optimizing our services and infrastructure across millions of virtual machines. And we are just getting started. As a Senior Fullstack Software Engineer, you will collaborate closely with your team and product management to streamline data insights for users. We seek engineers who are passionate about customer satisfaction and can oversee the entire product scope, extending their vision beyond mere technical execution. You will play a crucial role in establishing a solid foundation for the development of robust, scalable, and enjoyable products. Our Vancouver location is set to become the latest research and development hub for Databricks, enhancing our footprint in the Pacific Northwest. We are actively recruiting top-tier engineers to join us on our mission to democratize data and AI. We envision the Vancouver site as a critical catalyst for product innovation at Databricks, initially focusing on several strategic areas and multiple open roles across the following teams: Log Analytics - Our customers increasingly utilize Databricks for real-time analysis of petabyte-scale logs, presenting new challenges throughout the data processing pipeline, including ingestion, indexing, processing, and user experience. AI/BI - AI/BI is transforming Business Intelligence for the AI era. Launched last summer, this product has rapidly gained traction, with 98.7% of our data warehousing customers already utilizing AI/BI. The solutions we are developing, from intricate dashboards to advanced visualizations and interactive data exploration, present exciting technical challenges across the full stack. Unity Catalog Business Semantics - Understanding context is vital for AI. For enterprise data, this context must be governed effectively, which is the purpose of Unity Catalog Business Semantics. Recently launched at our Data + AI Summit, our first semantics modeling capability, Unity Catalog Metrics, is just the beginning. Engineers on this team work at the intersection of large-scale distributed systems, data modeling, governance, and AI enablement. Databricks Apps - Databricks Apps is one of the fastest-growing areas in our portfolio, focusing on creating seamless applications that enhance user engagement and data interaction.

About Dialpad Dialpad offers an AI-native business communications platform that brings together calling, messaging, meetings, and contact center features in one solution. The platform’s AI understands conversations as they happen, helping teams communicate more efficiently. More than 70,000 companies worldwide use Dialpad, including WeWork, Asana, NASDAQ, AAA Insurance, COMPASS Realty, Uber, Randstad, and Tractor Supply. These organizations rely on Dialpad to build stronger customer relationships through actionable insights powered by AI. Dialpad has taken a lead in Agentic AI, developing intelligent agents that not only analyze conversations but also take actions to automate workflows, answer customer questions, and speed up revenue processes in real time. The DAART initiative (Dialpad Agentic AI in Real Time) continues to advance communication technology. Learn more at dialpad.com. Applied Scientist Role in Vancouver, Canada The Applied Scientist will join Dialpad’s AI team in Vancouver, contributing to research and development efforts that influence the direction of the platform.

About Boomi and What Sets Us ApartAre you eager to join a rapidly expanding company where your contributions can create meaningful change? At Boomi, we strive to enhance the world by seamlessly connecting everyone to everything, anywhere. Our award-winning intelligent integration and automation platform empowers organizations to shape the future of business. By joining Boomi, you'll collaborate with top-tier professionals and cutting-edge technology. We seek innovators with an entrepreneurial mindset who excel at tackling complex challenges and desire to help build something extraordinary. If you resonate with this vision, explore boomi.com or visit our Boomi Careers page for more information.Your ImpactAs a Principal Software Engineer, you will lead the design and implementation of intricate backend systems on a large scale. You will define technical strategies, mentor team members, and address complex technical challenges while ensuring our systems uphold the highest standards of reliability, performance, and maintainability. Your expertise will play a pivotal role in enhancing our Agentic AI capabilities.

Join System Canada Technologies as an SAP IS-U Consultant in beautiful Vancouver! In this role, you will leverage your expertise in SAP IS-U solutions to support our clients in optimizing their utility management processes. Your insights will help drive efficiency and improve customer satisfaction.This is an exciting opportunity for professionals looking to make an impact in a dynamic and growing field.

Join our culinary team as a 3rd Cook at Sodexo Canada Ltd in Vancouver! We are looking for a passionate and dedicated individual to assist in the preparation and presentation of high-quality meals in a fast-paced kitchen environment. As a 3rd Cook, you will contribute to menu planning, food safety practices, and kitchen organization, ensuring a positive dining experience for our clients.

Join our dynamic team at System Canada Technologies as a Python Developer. In this role, you will have the opportunity to work on exciting projects that leverage your coding skills and creativity. We are looking for passionate individuals who thrive in a collaborative environment and are eager to contribute to innovative solutions.

Join Huawei Canada as a Principal AI Research Engineer in our Vancouver office, where innovation meets expertise in media technology.About Our Team:Since our inception in 2012, the Central Media Technology Institute (CMTI) has been at the forefront of media technology innovation at Huawei. Our Graphics Technology Lab is dedicated to groundbreaking research in photography, audio, video, computer graphics, extended reality (XR), and codec standards. With a talented team of algorithm experts, researchers, and architects, we are committed to advancing the capabilities of graphics technology and maintaining our leadership in the industry.Role Overview:Lead innovative projects, cultivate team collaboration, and mentor junior engineers.Engage in cutting-edge research and development of AI-driven rendering techniques, including Neural Rendering acceleration and Neural Texture Compression.Translate advanced AI and computer graphics solutions into practical applications for various Huawei products.Contribute to the field by publishing high-quality research papers and filing patents.The competitive salary for this role ranges from $121,000 to $230,000, commensurate with education, experience, and expertise.

Join Huawei Canada as a Distinguished Engineer in AI Computing Systems.About the Team:The Advanced Computing and Storage Lab, part of the Vancouver Research Centre, is dedicated to pioneering adaptive computing system architectures. We tackle the complexities introduced by flexible and variable application loads to enhance stability and quality in training clusters. Our focus includes developing dynamic cluster configuration strategies and precision control systems to ensure efficient computing power clusters. Our lab is actively engaged in key industry AI applications, particularly in large model training and inference, utilizing technologies such as low-precision training, multi-modal training, and reinforcement learning. We are committed to conducting bottleneck analysis and creating optimization solutions that enhance training, inference performance, and overall usability.About the Job:As an industry leader in training cluster software frameworks, you will gain insights into the evolution of AI large model training frameworks. You will plan and design AI frameworks and software features for various scenarios like large model pre-training, post-training, and integrated training and inference, establishing critical capabilities for our training cluster software framework.Lead the team in optimizing large model training by developing key technologies such as low-precision training, parallel strategy tuning, and training resource optimization, driving the commercial implementation of these optimization technologies.Focus on our training servers, super nodes, and other products, leading the development of large model AI training frameworks, operator libraries, and acceleration libraries. Leverage system engineering and software-hardware collaboration to maximize AI cluster computing efficiency.Identify and collaborate with high-quality academic resources in large model training, working alongside domain experts to advance our technological capabilities.

About the Role Speechify is hiring a Software Engineer focused on iOS Core Product development in Vancouver, Canada. This role works closely with the engineering team to build and refine features that improve the user experience. Projects center on advancing audio accessibility and shaping the direction of our iOS product.

Join AECOM as a Canada Growth Leader in Program Management, where you will play a pivotal role in driving strategic initiatives and fostering growth within our organization. In this dynamic leadership position, you will collaborate with cross-functional teams to design and implement innovative solutions that address client needs and enhance project delivery.

Join Huawei Canada as a Human Resources Business Partner (HRBP) and be part of a dynamic team dedicated to shaping the future of our workforce.About the Team:Our Human Resources Department serves as a strategic partner across Huawei Canada, playing an essential role in attracting, developing, and retaining exceptional talent. We ensure compliance with corporate and legal standards while prioritizing employee well-being and professional growth. Our mission is to foster a collaborative culture that drives sustainable growth and enhances organizational effectiveness.Key Responsibilities:Lead the design and implementation of HR initiatives, focusing on talent management, employee engagement, and organizational development.Support managers on various HR topics such as employee relations, compliance with HR regulations, and performance management.Manage local recruitment initiatives and oversee the recruitment team.Assist in developing and administering HR programs and guidelines that align with corporate priorities.Administer HR policies and procedures to support team objectives.Conduct data analysis to support the implementation of HR processes and programs related to talent, performance, compensation, and organizational design.Provide counsel to managers and employees on performance-related issues, talent recognition, and employee relations.The salary range for this position is between $48,000 and $94,000, commensurate with education, experience, and expertise.

At Databricks, we are dedicated to empowering data teams in tackling some of the world's most challenging issues — from speeding up medical innovations to crafting the next wave of intelligent products. We achieve this by developing the premier Data Intelligence Platform, enabling our clients to transform vast amounts of data into profound, actionable insights. Founded by engineers and fueled by innovation, we are passionate about creating intuitive, high-performance user experiences that simplify complex data exploration. As a Senior Frontend Engineer specializing in Data Visualization, you will create interactive and scalable visual experiences that allow users to explore, analyze, and share insights from vast datasets. You will collaborate closely with designers, product managers, and backend engineers to develop the next generation of visualization frameworks, dashboards, and analytical interfaces within Databricks.

Join Marqeta as a Product Support Engineer I, where you will be essential in enhancing customer satisfaction and ensuring the smooth operation of our innovative products and services. In this role, you will act as the primary point of contact for our clients, skillfully addressing and resolving technical challenges. You will utilize established procedural documents while performing technical analyses, all the while simplifying complex technical concepts into understandable language for our users.Your responsibilities will encompass troubleshooting issues across all facets of Marqeta's offerings, ensuring our customers receive exceptional support. For intricate problems, you will adhere to escalation protocols, collaborating with senior staff and engineering teams. At Marqeta, we recognize and appreciate the vital contribution of our Product Support Engineers in our service delivery pipeline, and we eagerly await your addition to our team.This position is fully remote within British Columbia, Canada. We invite you to apply and become part of our journey!

About FuturpreneurFuturpreneur is a leading national non-profit organization dedicated to empowering diverse entrepreneurs aged 18-39 to start, buy, or grow their businesses across Canada. We provide essential loans, mentorship, and resources tailored to the unique needs of young entrepreneurs.Since our inception in 1996, we have proudly supported over 20,000 young entrepreneurs in launching more than 15,600 businesses. Our commitment to promoting entrepreneurship among Canadian youth serves as a vital pillar for strengthening the economy, creating job opportunities, and fostering a sustainable future.As a founding member of the G20 Young Entrepreneurs’ Alliance, the Canadian founding member of Youth Business International, and the host of Global Entrepreneurship Week (GEW), we are deeply invested in cultivating the entrepreneurial spirit among youth.Our Purpose: We strive to drive inclusive Canadian prosperity through the success of young entrepreneurs.Our Mission: To empower diverse entrepreneurs aged 18-39 by providing loans, mentorship, and resources that contribute to sustainable and inclusive economic prosperity within their communities and across Canada.Our Values: We are mission-driven, collegial, collaborative, diverse, inclusive, accountable, and transparent.Opportunity Overview: Business Development ManagerAs the Business Development Manager, you will represent Futurpreneur, advocating for our financing and mentoring programs designed for young entrepreneurs and our partners. Your role will involve collaborating and establishing strong relationships with key partners to drive new client engagement and expand our loan portfolio within various communities across the Vancouver region.This is a full-time, permanent position based in Vancouver, operating on a hybrid work model that requires at least one in-office day per week. Frequent travel within the local region, and occasional trips to remote areas, will be necessary.

Join our dynamic team at System Canada Technologies as a Senior Data Integration Analyst, where you will play a pivotal role in driving data integration strategies that empower our clients' success. You will analyze complex data sets, design integration solutions, and collaborate with cross-functional teams to ensure seamless data flow across various systems.This is an exciting opportunity for professionals looking to make a significant impact in the field of data analytics. You will leverage your expertise to enhance data quality, optimize processes, and contribute to innovative solutions that align with our business objectives.

At Hiive, we are revolutionizing the way private companies and their shareholders access liquidity. Our institutional-grade platform seamlessly connects buyers, sellers, and issuers, enabling secondary transactions in venture-backed, pre-IPO companies. We aim to bring efficiency, transparency, and standardization to an otherwise opaque asset class.Recognized as one of Canada's fastest-growing companies and supported by leading U.S. investors, Hiive is a profitable and well-capitalized firm committed to building a high-performance team that meets increasing demand and explores new market opportunities.Curious about life at Hiive? Visit our careers page to discover how you can grow with us!We are establishing an innovative internal team at Hiive dedicated to redefining operations within a rapidly growing, regulated financial services company — leveraging AI as a fundamental tool rather than a mere buzzword. We are on the lookout for an AI Builder to become part of this small but impactful team.This role transcends traditional engineering, product, or operations positions. You will identify real operational challenges across various business functions, including sales, compliance, legal, and trading, and create AI-enabled tools and systems that address these issues comprehensively. Your work will encompass everything from collaborating with teams experiencing these challenges to delivering actionable solutions they utilize daily.You will collaborate with a senior engineer as part of an agile, high-impact team situated at the crossroads of technology and business. Your contributions will directly influence the workflows of approximately 180 staff members, with your tools impacting every significant function within the company.We value your ability to construct solutions, your approach to problem-solving, and your eagerness to learn quickly in a domain (regulated private securities) that may be unfamiliar to you.Key Responsibilities:Identify and analyze operational challenges across various business functions by integrating with internal teams — including Sales & Trading, Legal & Compliance, Account Services, and Transaction Services — to gain a deep understanding of their workflows.Design and develop AI-driven internal tools, automations, and systems that effectively address real-world problems.Manage the complete lifecycle from concept to implementation, ensuring user-centric solutions.