Hadoop Engineer with Unix/Linux Expertise

Join the City of New York as a Lead Unix/Linux Systems Engineer, where you will play a pivotal role in managing and optimizing our Unix/Linux environments. You will collaborate with cross-functional teams to implement robust solutions that enhance system performance and security. Be part of a dynamic organization that values innovation and excellence.

About the PositionAs a Linux Engineer at Jane Street, you will play a pivotal role in managing the essential infrastructure that supports our entire technology landscape. This dynamic group comprises dedicated Systems Engineers, Administrators, and Programmers focused on enhancing and maintaining the platform that drives Jane Street's production trading systems. Our blend of proprietary and open-source software empowers you to explore and innovate at every level. Whether you're debugging kernel performance, crafting management tools, or swiftly addressing production issues, tackling complex systems challenges is our forte.We prioritize deployment automation, scalable configuration management, and meticulous monitoring as part of our ongoing projects. While we automate extensively, it's not merely for convenience; we believe automation minimizes errors and reduces workload—plus, we find it enjoyable!Being part of our team opens avenues to collaborate with nearly every department within the company. You will engage directly with colleagues in Trading, Technology, and Operations to develop and sustain systems with a firm-wide impact. By leveraging feedback from various teams and our custom monitoring tools, we aim to quickly resolve production challenges, conduct thorough root-cause analyses, and implement long-term solutions in a clean and effective manner.About YouWe seek talented Systems Programmers and Administrators with robust expertise in Unix internals and the Linux ecosystem. Ideal candidates will have a willingness to learn OCaml, our preferred programming language, and should meet the following qualifications:Bachelor's degree in Computer Science, Software Engineering, or a related technical field (or equivalent experience)Excellent communication skills coupled with the ability to analyze and dissect technical problems efficientlyComprehensive understanding of operating system fundamentals, particularly LinuxProficiency with the Unix command line and shell scriptingHands-on experience with modern Linux systems and systems programming concepts, including C, sockets, virtual memory, and process lifecycleBasic knowledge of network protocolsStrong troubleshooting abilities and familiarity with profiling/debugging tools such as gdb, perf, DTrace, eBPF, or SystemTapProgramming experience in any language (functional languages are a plus)

Join Collabera Inc. as a Unix Administrator where you will be responsible for managing and maintaining Unix-based systems, ensuring high levels of performance, availability, and security. You will work collaboratively within a dynamic team to troubleshoot issues, implement system enhancements, and support application deployments. This role requires a proactive approach to system monitoring and problem resolution, ensuring optimal operational efficiency.

We are seeking a skilled Unix Administrator to join our dynamic team at Collabera. In this role, you will be responsible for managing and maintaining Unix-based systems, ensuring optimal performance and security. Your expertise will contribute to the overall efficiency of our IT operations and support our business objectives.

About the PositionWe are in search of a dynamic leader to guide our expanding team of Linux Engineers at Jane Street.This team, comprising both managers and individual contributors, consists of dedicated Systems Engineers, Administrators, and Programmers who are responsible for maintaining and enhancing the platform that drives Jane Street's production trading systems. (Learn more about the Linux Engineer role here.)We expect our managers to lead by example. While supporting their teams, the ideal candidate will be eager to begin as an individual contributor, develop a solid grasp of Jane Street's technical landscape, and evolve into a managerial role.We value individuals who resonate with our core principles: honesty, collaboration, intellectual curiosity, humility, and a quantitative approach to decision-making and problem-solving. To excel in this role, candidates should be Linux Engineers at heart, with experience in various areas including people management, project and program management, large-scale coordination, partnership facilitation, strategic planning, and service delivery.About YouWe are looking for a Linux Engineering Manager who possesses a robust technical background and substantial leadership experience. Candidates should lead by example, balancing their individual technical contributions with their leadership responsibilities. A willingness to learn OCaml, our programming language of choice, is essential. Candidates should meet the following qualifications:Bachelor's degree in Computer Science, Software Engineering, or a related technical field (or equivalent experience)Exceptional communication skills, capable of engaging in one-on-one meetings as well as larger group discussions, with the ability to analyze and deconstruct complex problems efficientlyA proven track record of supporting individuals and fostering team growthExperience in building and nurturing cross-company partnershipsStrong analytical and troubleshooting abilities across various dimensions (technical, process, interpersonal, etc.)In-depth understanding of operating system fundamentals, particularly LinuxProficiency with the Unix command line and shell scriptingHands-on experience with modern Linux systems and systems programming conceptsBasic understanding of network protocolsProgramming experience in any language

Job DescriptionJoin our dynamic Enterprise Data and Analytics (EDA) Division, where we empower businesses through innovative Big Data solutions. Our EDA Big Data platform leverages Hadoop and Aster technologies in a multi-tenant environment, facilitating support for various Lines of Business (LOBs).We are seeking a skilled Application System Engineer to enhance our agile Hadoop development team. This role requires a proactive individual capable of designing and implementing applications within the Big Data ecosystem. The successful candidate will aid in data management by tracking sources in the big data environment, maintaining system documentation, and capturing metadata. You will analyze, develop, and test viable use cases for the business, guiding them from concept to production. Responsibilities include writing optimized code for extracting, transforming, loading, and querying extensive datasets, including unstructured data. You will also develop standards and design patterns for Big Data applications, build and populate a data lake, and enhance your understanding of MapReduce architecture and Hadoop/Aster toolsets. A key part of this role will involve translating potentially ambiguous business requirements into actionable use cases, providing timely updates to business partners, mentoring users in data access, and contributing to the development framework for Big Data.

Join our dynamic product development team as a Hadoop Developer, where you will report directly to the Head of Engineering. In this pivotal role, you will be instrumental in developing scalable ELT/ETL workflows designed to transform and integrate data into structures that facilitate reporting and analytics on Teradata warehouses for one of the world’s leading financial services companies. You will have the opportunity to design and implement robust dimensional data models that can scale across multiple data warehouses, effectively feeding data into Hadoop to replicate information from Teradata databases. Utilizing tools such as Sqoop, Impala, and Teradata ETL, you will manage vast volumes of data transfers from Teradata to the Hadoop cluster. Subsequently, you will employ Map/Reduce, Hive, and Pig to process and analyze this data, exporting aggregates back into Teradata for comprehensive reporting.

Role overview Trexquant is looking for a Linux Systems Engineer to support and enhance its on-premise infrastructure in New York. The position involves direct, hands-on work with bare-metal Linux servers. Daily tasks include provisioning new hardware, managing storage resources, and working to keep systems reliable and efficient in a production environment. What you will do Set up and maintain physical Linux servers Oversee storage systems and uphold data integrity Monitor system health and implement improvements to reliability in production environments Who thrives in this role Approaches system administration with care and discipline Feels comfortable in production-critical situations Brings a strong grasp of Linux internals, automation tools, and high-performance system setups Location This role is based in New York, New York, United States, with a focus on managing on-premise, physical infrastructure.

About the Position Join our dedicated team of Linux Engineers at Jane Street, where you will be instrumental in maintaining the vital infrastructure that supports our cutting-edge technology. Our team comprises skilled Systems Engineers, Administrators, and Programmers focusing on enhancing the platform that drives Jane Street's production trading systems. With a blend of proprietary and open-source software, you will have the opportunity to explore and innovate at every level. Your day-to-day activities might include debugging kernel performance, developing management tools, or addressing production issues on the fly. Solving complex systems challenges is our forte. We emphasize deployment automation, scalable configuration management, and meticulous monitoring in our ongoing projects. While we automate as much as possible, it's not out of laziness; rather, we believe that automation minimizes errors and lightens our workload—plus, we find it enjoyable. Working within our team provides a unique opportunity to collaborate with various departments across the company. You will work closely with teams in trading, technology, and operations to develop and sustain systems that have a firm-wide impact. By leveraging feedback from other groups and utilizing our custom monitoring tools, we aim to resolve production issues swiftly, conduct thorough root-cause analyses, and implement long-term solutions in a clean and efficient manner. We don't require you to have extensive experience; we are eager to hire intelligent problem solvers and guide them through their learning journey. You will train alongside seasoned team members in a hands-on environment, acquiring the skills necessary to make significant improvements to our infrastructure daily.

Are you a passionate Cloud Engineer with expertise in Linux looking to advance your career? Join Collabera, a leading technology solutions provider, where you will be part of a dynamic team dedicated to innovation and excellence. In this role, you will design, deploy, and manage cloud infrastructure while ensuring optimal performance and security.

Join eproinc as a Level 3 Linux Administrator, where you will play a vital role in maintaining and optimizing our Linux systems. We are seeking an experienced professional who is passionate about technology and thrives in a dynamic environment. Your expertise will help us ensure system reliability and performance, enabling our operations to run smoothly.

We are seeking a talented and motivated Hadoop Developer to join our dynamic team in New York. As a Hadoop Developer, you will play a critical role in designing, developing, and maintaining data pipelines and solutions that drive our data analytics initiatives. If you are passionate about big data technologies and have a strong background in Hadoop, this is the opportunity for you!

Join our innovative team as a Hadoop Developer where you will play a crucial role in developing and optimizing data solutions. Utilize your skills in Hadoop, Spark, and related technologies to manage large datasets efficiently. Collaborate with cross-functional teams to deliver high-quality data solutions that meet the needs of our clients.

About Five RingsFive Rings is an innovative proprietary trading firm that merges strategy, technology, and creativity to excel in the global markets. With a presence in major cities such as New York, Boca Raton, London, and Amsterdam, Five Rings engages in diverse domestic and international trading activities. Our team is dedicated to discovering new opportunities, assessing their risks and rewards, and developing strategies and tools to leverage them.We foster an open culture that promotes the exchange of knowledge and ideas across all levels of the organization.About the RoleWe are looking for a skilled Linux Systems Administrator to join our expanding systems administration team. In this hands-on role, you will be responsible for managing the workstations and servers that support our trading operations. This includes performing systems work on both desktops and in our data centers, while collaborating with users throughout the organization.As a Linux-focused environment, our operations primarily utilize Linux servers and desktops, with minimal use of Windows servers and desktops as required.

Join Point72 as a Linux Security Lead, where you will spearhead our efforts to enhance the security posture of our Linux systems. In this pivotal role, you will collaborate with cross-functional teams to implement robust security measures, conduct risk assessments, and ensure compliance with industry standards. Your expertise will help safeguard our infrastructure and data integrity.

Role overview Smith Engineering is seeking a Director of Design Engineering to lead its design team in New York City. This leader will oversee the development of engineering solutions that meet client requirements and comply with industry standards. The role involves shaping project direction and supporting the growth of a skilled group of engineers. What you will do Guide and manage the design engineering team Drive the creation of efficient, high-quality engineering designs Ensure all work aligns with client needs and industry standards Mentor and develop engineering talent within the team Influence the direction of engineering projects at Smith Engineering

About the Role Smith Engineering is hiring a Director of Energy Engineering to guide the energy solutions team in New York City. This senior leader will shape project direction and help set the strategy for energy initiatives across our portfolio. What You Will Do Lead a team focused on delivering energy engineering projects Develop and implement strategies that strengthen our energy solutions Oversee project execution and ensure alignment with company goals What We’re Looking For Extensive experience in energy engineering Proven leadership and team management skills Ability to drive strategic initiatives in a technical environment This position is based in New York City.

Hudson River Trading seeks a Trading Systems Engineer to join the Trading Systems Infrastructure team. This group builds and maintains the technology behind global trading operations. Their work supports high performance and reliability for the ultra-low latency operating systems, automation tools, and development platforms that keep trading strategies running worldwide, around the clock. Role overview The Trading Systems Engineer will help support and improve real-time production trading environments. The work centers on solving challenges that require high availability, high throughput, and ultra-low latency. This role contributes to the development and automation of essential infrastructure components, working alongside a team committed to keeping trading systems operating smoothly at all times. What you will do Support and improve real-time production trading environments Address challenges involving high availability, high throughput, and ultra-low latency Contribute to developing and automating critical infrastructure Collaborate with a team focused on system reliability and uptime Requirements Experience with coding and automation Strong interest in enhancing technology stacks Ability to solve complex technical problems in demanding environments Comfort working where uptime and performance are essential Locations Austin, TX, United States Boulder, Colorado, United States Chicago, Illinois, United States London, United Kingdom New York, NY, United States Seattle, Washington, United States

Join Neota Logic, a pioneering no-code automation platform that empowers insurance, compliance, and legal professionals to effortlessly build and deploy workflow automation solutions without any coding experience. Our platform is trusted by leading corporations, law firms, and educational institutions across the globe.As a DevOps Engineer, you will play a critical role in maintaining and enhancing our secure, high-performance cloud infrastructure on AWS and Microsoft Azure. Your expertise will ensure system reliability and performance, while you support development teams in troubleshooting production issues and manage our internal deployment tools built with Django. Additionally, you will oversee backups, databases, and source control systems such as Git, all while upholding strong security practices and maintaining clear documentation of architecture and networks.