Senior Python Data Scraping Engineer

About YipitData:YipitData stands as a premier market research and analytics firm focused on the disruptive economy, recently securing up to $475M from The Carlyle Group, achieving a valuation exceeding $1B.We diligently analyze billions of alternative data points daily, delivering accurate and detailed insights across ridesharing, e-commerce marketplaces, payments, and more. Our on-demand insights team leverages proprietary technology to identify, license, clean, and analyze data that the world's largest investment funds and corporations rely upon.For over three consecutive years, we have been honored as one of Inc’s Best Workplaces. As a rapidly growing technology organization backed by The Carlyle Group and Norwest Venture Partners, we have offices in New York City, Austin, Miami, Denver, Mountain View, Seattle, Hong Kong, Shanghai, Beijing, Guangzhou, and Singapore. We promote a people-centric culture that emphasizes mastery, ownership, and transparency.Why You Should Apply NOW:High Impact: Your contributions will significantly influence vital reports and strategic decisions across multiple business units.Exciting Challenges: Engage in the design of resilient web scrapers, navigate complex website structures, and optimize extensive data extraction processes.Growth Opportunities: As an early member of our expanding Web Scraping Engineering team, you will have a substantial voice in shaping our strategies, processes, and team culture.About The Role:We are on the lookout for a Web Scraping Engineer to join our dynamic engineering team. In this hands-on position, you will take charge of designing, building, and maintaining robust web scrapers that fuel critical reports and enhance customer experiences across our organization. You will tackle complex, high-impact scraping challenges and collaborate closely with cross-functional teams to ensure our data ingestion processes are resilient, efficient, and scalable, delivering high-quality data to our products and stakeholders.

Role Overview YipitData is hiring a Web Scraping Engineer to help build and refine the systems that power our data extraction work. This remote role is based in India. What You Will Do Develop new web scraping solutions to gather data from a range of online sources Maintain and improve existing scraping pipelines for reliability and efficiency Optimize extraction processes to deliver accurate and timely insights About You Strong interest in technology and data Experience building or maintaining web scraping systems

Mindrift connects professionals with AI projects for leading technology companies. The platform focuses on advancing Generative AI by involving specialists from around the world. Role overview This Freelance Python Data Scraping Engineer position supports the Tendem project. The role is remote and part-time, open to candidates based in Hyderabad, Telangana, India, or those working remotely from there. Work centers on improving hybrid AI and human-driven data scraping workflows. As an AI Pilot, collaboration with Tendem Agents is a key part of the job. The position blends hands-on technical work with critical thinking and quality control, aiming for precise and actionable web data extraction. What you will do Manage end-to-end data extraction on complex websites to deliver accurate, structured datasets. Work with internal tools such as Apify and OpenRouter, plus custom methods, to collect, validate, and process data to meet project needs. Adjust scraping strategies for dynamic, interactive, and JavaScript-heavy web content, responding to changes in site behavior as they arise. Maintain high data quality through validation, consistency checks, compliance with formatting standards, and thorough verification before delivery. Optimize large-scale scraping by batching or parallel processing, monitoring for failures, and adapting to changes in site structure. Requirements Minimum 3 years of experience in data engineering, web scraping, automation, or similar fields. Strong Python skills and experience with web scraping frameworks. Demonstrated ability to extract data from complex and dynamic web applications. Keen analytical skills and attention to detail for data quality. Clear written and verbal communication abilities. Compensation Contributors may earn up to $12 per hour, depending on experience and pace. Compensation varies by project scope, complexity, and expertise required. How to get started Apply to this posting and complete the qualification process to join. Projects are matched to technical strengths, and schedules are flexible. Tasks include coding, automation, and refining AI outputs, all aimed at improving AI capabilities and practical applications.

We are seeking a talented Python Scraping Engineer to join our dynamic team at Smart Working Solutions. In this fully remote role, you will leverage your expertise in Python and web scraping technologies to develop reliable data extraction solutions that will help drive our business forward.

Join our dynamic team as an IIS Administrator, where you will be responsible for managing and optimizing our Internet Information Services (IIS) environments. Your expertise will play a crucial role in ensuring the availability, performance, and security of our web applications. We are looking for a proactive individual with a passion for technology and a commitment to excellence.

Role Overview Smiths Group plc is hiring an Engineer II for the DGSS Engineering team in Pune. This position focuses on strengthening engineering processes and supporting technical improvements across the group. What You Will Do Work with cross-functional teams to improve and implement engineering processes Contribute to solutions that raise quality and efficiency standards Support ongoing technical initiatives within DGSS Engineering

Join our dynamic team at Weekday-1 as a Software Development Engineer II (SDE II). In this role, you will be instrumental in designing, developing, and deploying innovative software solutions. Collaborate with cross-functional teams to enhance product functionality and optimize performance. Your expertise in software engineering principles will drive our projects forward.

Join our dynamic team at Weblee Technologies as a Web Design Engineer! We are looking for a creative and skilled individual who is passionate about designing user-friendly and aesthetically pleasing web interfaces. In this role, you will collaborate with cross-functional teams to create innovative web solutions that enhance user experience.

Join our innovative team at Smiths Group as an Engineer II Wet Seals. In this role, you will play a crucial part in the development and design of advanced wet seal solutions that meet the needs of our clients. You will collaborate with cross-functional teams to enhance product performance and reliability.

Smiths Group seeks an Engineer II specializing in Regulatory Engineering for its Pune location. This role centers on supporting regulatory compliance and contributing to various engineering projects, ensuring products meet required standards and regulations. Key responsibilities Participate in engineering projects with attention to regulatory requirements Work alongside teams to verify that products comply with applicable standards Assist in preparing documentation and managing processes tied to product compliance Team impact This team plays a part in delivering solutions that enhance product safety and performance. The work supports both compliance and the overall quality of products released to the market.

ABOUT THE ROLEWe are looking for a dynamic Web Engineering Manager to spearhead and nurture our web development team based in Pune, as an integral part of our global Web organization. This position emphasizes effective people management, project delivery, and overall team well-being, empowering engineers to excel while ensuring alignment with international standards and technical directives.In this role, you will collaborate closely with Lead Developers, QA teams, and regional stakeholders to guarantee seamless delivery across an extensive portfolio of corporate and marketing websites, which includes both legacy systems and a contemporary web stack.As part of the onboarding process, the successful candidate will engage in a two-week orientation at our London office to align on operational methodologies, standards, tools, and key stakeholders.KEY RESPONSIBILITIESTeam Leadership & People ManagementLead and support a talented team of web developers based in Pune.Facilitate regular one-on-ones, performance evaluations, and career development initiatives.Cultivate a positive, inclusive, and high-performance team culture.Assist in onboarding and mentoring new team members.Serve as the primary people manager for the Pune web development team.Delivery & ExecutionOversee daily project delivery, capacity planning, and prioritization of workloads.Ensure timely delivery of work adhering to established quality standards.Collaborate with Project Management, QA, and DevOps teams to facilitate smooth releases.Identify potential delivery risks and escalate issues as needed.Help establish and maintain consistent development processes.Collaboration & AlignmentWork closely with Lead Developers to align with architectural and technical standards.Engage with global stakeholders from London, the US, and Europe.Support recruitment efforts for the Pune team alongside global leadership.Act as a local point of escalation for delivery or personnel-related matters.Continuous ImprovementAssist in enhancing development practices and team workflows over time.Promote the adoption of innovative tools, platforms, and processes.Encourage knowledge sharing and continuous learning within the team.

COMPANY OVERVIEWKKR is a premier global investment firm specializing in alternative asset management and comprehensive capital markets and insurance solutions. We are committed to delivering attractive investment returns through a patient and disciplined approach, by leveraging our world-class talent and fostering growth in our portfolio companies and the communities we serve. Our investment funds span private equity, credit, and real assets, and we collaborate with strategic partners to manage hedge funds. Our insurance subsidiaries, under the Global Atlantic Financial Group, provide a suite of retirement, life, and reinsurance products. TECHNOLOGY ORGANIZATION OVERVIEW The Technology team at KKR is instrumental in establishing and maintaining the firm’s technological infrastructure, which includes a globally distributed system, robust information security, and advanced application and data platforms. We cultivate a culture of technological excellence by automating workflows, democratizing data through modern platforms, and pioneering research into Generative AI tools and services. Technology is a critical business enabler at KKR, propelling us towards expansive growth and transformative business processes. Our dedicated Program Management function, along with Product Managers, ensures disciplined execution across various tech teams, consistently delivering outstanding outcomes that meet business needs. TEAM OVERVIEW The Enterprise Systems Engineering team, a vital part of KKR’s Technology organization, specializes in the design, implementation, and continuous enhancement of technology platforms that support essential corporate functions, including Compliance, Legal, Audit, Risk, Finance, Human Capital, Enterprise Services, KKR Public Websites, and Digital Experience. We form close partnerships with functional leaders and stakeholders to gain insights into evolving needs and deliver technology solutions that yield measurable outcomes.Our focus includes:Customizing and implementing enterprise SaaS platforms and tailored applications.Integrating systems across corporate domains to facilitate seamless data flow and automation.Ensuring platform stability, data integrity, and stringent controls in support of corporate objectives.

Join our innovative team at Oleria Security as an App Engineer - Web & Design. In this role, you will be responsible for designing and developing web applications that contribute to our security solutions. We are looking for a passionate engineer who thrives in a collaborative environment and is eager to create secure, user-friendly applications.

Job Overview: As a Software Development Engineer II, you will be instrumental in crafting an exceptional content viewing experience for our users. You will tackle intricate technical challenges and develop systems that operate at an unprecedented scale. This role demands the design and delivery of high-quality distributed applications while maintaining superior operational excellence, ensuring a seamless interaction for users on the JioHotstar website and TV applications.About Our Team: At JioHotstar, our Viewer Experience (VX) organization is central to how millions find, engage with, and adore our platform. We oversee the complete user journey—from the initial app launch to daily engagement loops—encompassing Search, Personalization, Watch Experience, Interactivity, and beyond. By integrating top-tier engineering, machine learning, design, and data analytics, we deliver a seamless, personalized, and captivating OTT experience at a massive scale. If you are enthusiastic about creating immersive, intelligent, and efficient user experiences that can delight a billion users, we invite you to join us in redefining the future of streaming.

We are seeking a skilled Microsoft IIS Administrator to join our dynamic team. In this role, you will be responsible for managing and ensuring the stability and performance of our web applications hosted on Microsoft Internet Information Services (IIS). Your expertise will help us maintain high availability and security of our web services.

InMobi Advertising is a pioneering technology company empowering marketers to seize critical moments. Our state-of-the-art advertising platform connects with over 2 billion users across more than 150 countries, transforming real-time context into impactful business results while adhering to privacy-first principles. With the trust of over 30,000 brands and leading publishers, InMobi is where intelligence, creativity, and accountability meet. By integrating lock screens, apps, TVs, and the open web with AI and machine learning, we offer tailored attention, precise personalization, and measurable results.Through Glance AI, we are redefining AI Commerce and reimagining the future of e-commerce through inspiration-led discovery and shopping experiences. Designed for seamless integration into everyday technology, Glance AI turns every screen into a portal for instant, personalized, and delightful discovery. Covering a wide array of categories including fashion, beauty, travel, accessories, home décor, pets, and more, Glance AI curates deeply personalized shopping experiences. Leveraging robust first-party data and unmatched consumer access, it utilizes InMobi’s global insights and targeting capabilities to create impactful, performance-driven shopping journeys for brands worldwide.Recognized as a Great Place to Work and featured by MIT Technology Review, Fast Company’s Top 10 Innovators, and others, InMobi is a workplace where innovative ideas make a global impact. Supported by esteemed investors such as SoftBank, Kleiner Perkins, and Sherpalo Ventures, InMobi operates offices in San Mateo, New York, London, Singapore, Tokyo, Seoul, Jakarta, Bengaluru, and beyond.At InMobi Advertising, you will have the opportunity to influence how billions of users connect with content, commerce, and brands globally. To learn more, visit www.inmobi.com

Role overview ixigo is looking for a Web Software Engineer based in Gurugram. The position centers on designing and developing web applications that enhance the way users experience ixigo’s products. What you will do Collaborate with colleagues from different teams to deliver dependable and thoughtfully built web solutions Take part in the full development process, from initial concept through to product launch Contribute ideas and code to features that directly impact user engagement

Join our dynamic team at Squircle IT Consulting Services as a Web Application Server Engineer. In this role, you will be responsible for designing, implementing, and maintaining web applications that empower our clients. You will work closely with cross-functional teams to deliver high-quality software solutions that meet business needs.

Join Endeavor IT Solution as a Web Development Intern and kickstart your career in the tech industry! This internship is tailored for engineering students who are eager to gain hands-on experience in web development. You will work alongside our talented team, contributing to innovative projects while enhancing your skills in various web technologies.