Web scraping 92

Unified live web infrastructure for AI agents and automated workflows TinyFish is a unified web operations platform for AI agents and applications. It provides live web search, clean content extraction, browser sessions, and multi-step automation through one API key. Developers can search dynamic websites, fetch rendered pages as structured Markdown, JSON, or HTML, authenticate into portals, bypass common anti-bot systems, and automate complex web workflows at scale. Search and Fetch are free, while Agent and Browser usage is charged through prepaid Wallet funds.

Open-source anti-detect Firefox browser for stealthy AI automation Camoufox is an open-source anti-detect browser layer built for AI agents and automated web browsing. It is based on Firefox and works with existing Playwright code, providing stealth-oriented automation through browser-level fingerprint modification rather than JavaScript injection. Camoufox can spoof navigator properties, screen characteristics, geolocation, timezone, locale, WebRTC IP data, WebGL parameters, fonts, voices, and other browser signals. It is designed to be lightweight, headless-first, memory-efficient, and consistent across fingerprint attributes. The project also includes human-like cursor movement, ad blocking, proxy and GeoIP support, BrowserForge integration, remote server support, and tools for fingerprint injection and leak debugging.

No-code web scraping and AI-powered workflow automation for sales, marketing, and research tasks. Hexomatic is a no-code growth hacking sidekick that enables universal access to the internet as your own data source, leveraging AI services to automate and delegate time-consuming tasks. It offers web scraping and workflow automation to automate ChatGPT tasks at scale, allowing users to tap into the internet as their data source and automate 100+ sales, marketing, or research tasks on autopilot.

Dumpling AI powers AI automations with web scraping, search, and document conversion APIs. Dumpling AI gives your AI agents and automations the ability to intelligently scrape the web, search Google, and much more. Available in your favourite no-code platforms and via API. Dumpling AI provides data, web scraping, and document conversion APIs to help you build powerful AI automations without wasting time on messy pipelines.

No-code platform to build AI agents using screen recording and intuitive tools. Nutix AI is a no-code platform that allows users to build AI agents using screen recording and other intuitive tools. By recording actions like copying data from LinkedIn into a CRM, users can generate custom agents that replicate those tasks automatically. It offers features like a unified AI agent hub, built-in analytics, role-based access control, instant database support, and a unified storage layer.

AI platform to build custom datasets from the internet automatically. Golden Dataset is an AI-powered platform that automates data analysis by allowing users to submit instructions for dataset creation. The platform's bots search the internet, compile findings, and generate custom datasets from publicly available information. It aims to provide real data at scale, addressing the limitations of generative AI models that may produce hallucinations.

No-code browser automation tool with ChatGPT integration for simplified info gathering and task automation. Goless is a browser extension that provides no-code automation tools to simplify information gathering from various services. It allows users to automate web browser actions, create automated workflows, scrape data, fill out forms, resolve CAPTCHAs, generate automatic responses using ChatGPT, and automate tasks in spreadsheets, all without coding. It also offers a marketplace for users to share and explore pre-built workflows.

AI-powered platform for web scraping, crawling, and website change monitoring Agenty is an AI-powered web scraping, crawling, and change detection platform that helps users automatically extract structured data from websites, monitor page updates, and create LLM-ready content. It supports no-code scraping agents, website crawling, HTML extraction, JSON data extraction, Markdown conversion, screenshots, scheduled jobs, proxy rotation, API access, and integrations. Users can scrape product data, prices, listings, articles, and other web content at scale.

Real-time API to access and scrape Google and other search engine results. SerpApi is a real-time API to access Google search results. We handle proxies, solve captchas, and parse all rich structured data for you. SerpApi provides a fast, easy, and complete API to scrape Google and other search engines. It offers various APIs including Google Search API, Google Images API, Google Maps API, and many more. SerpApi also provides legal US Shield, assuming scraping and parsing liabilities for both domestic and foreign companies unless the usage is otherwise illegal.

Open source AI assistant for tasks, research, data analysis, and daily challenges. BitterBot is a fully open source AI assistant designed to help users accomplish real-world tasks with ease. It acts as a digital companion for research, data analysis, and everyday challenges, facilitating these tasks through natural conversation. Its capabilities include browser automation, web scraping, and file management.

All-in-one web scraping solution with AI-powered data extraction and analysis. FlowQY is an all-in-one web scraping solution for extracting and analyzing data from websites. It offers AI-Powered Data Extraction, allowing users to extract data effortlessly by simply entering a URL and describing the desired data. FlowQY handles the rest automatically, eliminating the need for coding, proxies, or dealing with blocks. It provides advanced proxy infrastructure, anti-bot circumvention, and automated CAPTCHA handling to ensure reliable and seamless data extraction.

Keeps AI agents updated with latest documentation via browsing or adding scraped docs. web2llm helps keep AI agents up to date with the latest documentation. It allows users to browse hundreds of scraped documents or add their own. Users can grab a direct link to merged markdown content or copy-paste it into their prompt.

Clevis: Build and sell AI-powered apps without code. Clevis enables users to create AI-powered applications without the need for writing code. With a wide range of pre-built processing steps, users can build, run and sell apps with features such as text generation, image generation and web scraping. Users can trigger their app from a user-friendly interface, on a set schedule or through an API call.

Create custom AI agents to automate browser tasks with no API costs. Browseragent is a platform that allows users to create custom AI agents that run directly in their browser. These agents can automate repetitive browser tasks without requiring API costs or maintenance, ensuring full privacy. It enables building powerful automations in minutes using an AI-powered workflow builder.

Automation tool to record and automate manual web tasks, with or without Zapier. TaskMagic is an automation tool that allows users to record themselves performing manual tasks on the web and then automate those tasks. It bridges the gap left by traditional automation tools like Zapier and Make by enabling automation of actions that don't have direct API support, such as clicking, typing, copying, and pasting. TaskMagic can be used with or without Zapier to enhance workflows and eliminate repetitive tasks.

SpaceSerp is a Serp API for real-time Google data extraction. SpaceSerp is a powerful Serp API that extracts clean, structured data from Google in real-time. It allows users to collect real-time search results and monitor brand or product mentions from any location and device. The system is powered by cutting-edge AI models and supports various formats like JSON, CSV, and HTML.

Remote desktop instances for AI agents with unified API and low-level controls. Scrapybara hosts remote desktop instances for computer use agents like CUA and Claude Computer Use. With its unified API, developers can write one line of code to execute agents with any model and access low-level controls like the browser, filesystem, and code sandboxes. Scrapybara handles autoscaling, authentication, and system environments, enabling users to deploy fleets of agents to production and automate any free-form computing task at scale.

AI-powered competitive pricing solutions for e-commerce with real-time competitor insights. CrawlrLabs is an AI-optimized competitive pricing solution for e-commerce businesses. It offers automated price monitoring, real-time competitor insights, and customizable pricing intelligence to help businesses stay competitive, maximize visibility, and improve their market position. CrawlrLabs provides tools like a free web app, full website crawling, and advanced computer vision to monitor competitor pricing and product information.

Toolkit for scaling AI agents and workflows across organizations. Scout is a toolkit for scaling AI-enabled agents and workflows across organizations. It allows users to build, launch, and scale AI solutions, expanding the scope of what AI can do and bringing solutions to production faster. Scout provides tools for creating AI workflows, building AI-ready data sets, deploying solutions, and comprehensive testing and tuning.

Web scraping API for structured data extraction from websites. Rapture Parser is a web scraping API and HTML extractor designed to simplify web page parsing for data analysis and content management. It allows users to obtain JSON structured data from any website using a link and raw HTML (soon). The platform is designed to process complex web pages, extracting information like titles, text, summaries, authors, publication dates, tags, language, and images.

Free open-source AI tool transforming websites into React/Next.js apps. Open Lovable is a free open-source AI tool that transforms any website into React/Next.js apps in seconds. It allows users to clone websites, generate clean code, and maintain full ownership. Built by Mendable AI, it serves as a free alternative to Lovable.ai. This revolutionary tool uses advanced web scraping (Firecrawl) and large language models (Claude, GPT, Groq) to analyze target websites and regenerate their UI as modern React/TypeScript code with Tailwind CSS styling.

AI browser extension for intelligent automation, free, open source, no migration. AIPex is a powerful AI browser extension designed to transform your existing browser into an AI browser, offering a free and open-source alternative to tools like ChatGPT Atlas. It eliminates the need for browser migration, allowing users to add AI capabilities in seconds using natural language commands. AIPex provides intelligent browser assistance with advanced AI features, complete privacy protection, and empowers users with AI-powered browser automation for various tasks.

Nocode web scraper and RPA tool for data extraction and browser automation. Roborabbit is a nocode web scraper and robotic process automation (RPA) tool designed for data extraction and browser automation. It allows users to create automated tasks that can be triggered via API and nocode tools. Roborabbit uses AI to find the data needed for businesses and offers features like web scraping, automated testing, integrations, and custom feeds. It enables users to perform actions such as capturing data, saving to sheets, and triggering tasks through integrations with Zapier and REST API.

AI-powered data collection and web scraping tool. Scrap.so is an AI-powered data collection tool that allows users to browse websites and collect data automatically. Users provide a list of websites or let Scrap find them, specify the data they want, and Scrap collects and sends the data wherever needed.