Subscribe
Sign in
Start new thread
ScraperAI
p/scraperai
Extract Structured data from any website
Visit Product
Xavier Geerinck
Scraper AI — Automate website data extraction in a few clicks
Featured
14
•
Scraper.AI is a data extraction tool that allows you to scrape and extract data from any website. Automate your data gathering process now through features such as data exporting, scheduled monitoring, API endpoints, webhooks and change detection.
Replies
Stephen Campbell
Interested. Any PH discount? 🤔
Xavier Geerinck
Maker
@stephenalan Hi Stephen! Please contact us once you subscribed and we can offer 10% off for the first 5 PH subscribers :)
Pietz Prove
This seems to focus on pages that change on a regular basis. What if I want to scrape all 573 result pages of a custom site a single time?
Xavier Geerinck
Maker
@gopietz Hi Pietz! Great question! We do support pagination allowing you to select the "Next Page" button which will then scrape all the 573 result pages
Xavier Geerinck
Maker
Hi ProductHunt Community! After being stuck ourselves to gather insights from websites in a structured way, we decided that it was time to take control of data yourself. By releasing our first tool called Scraper.AI, you can now open any website, click the relevant data points you would like to extract and get the extracted and structured data delivered to you in just a couple of minutes between sign-up to receiving your first data points. Our core feature set includes: ⏳ Scheduling: Schedule your data points to be updated in an interval that you choose (hourly, daily, weekly, monthly) 🔄 Change monitoring: Detect changes to data, allowing you to monitor pricing updates, articles, ... and create your own subscribe functionality 📩 Export: export your gathered data in a format you like (.json, .csv, .xlsx) 💻 App integration through an API Endpoint and Webhooks Let us know what you think! We're here to answer any questions you might have. Kind Regards, Xavier
Xavier Geerinck
Maker
Hi All, Thanks a lot for upvoting our product! To thank you all we are also giving away a 25% off coupon for everyone that registers through ProductHunt: https://scraper.ai/dashboard/pro... go check it out and let us know through comments or Twitter (@scraper_ai) on what you think!
Anna Filou
Does it work on websites that require login/authentication? (provided the user has the password, of course)
Pepa P
Congrats on the launch. Can this be used to scrap Google maps and extract all the businesses information in a specific area?
Edmund Cinco
@waikiki maybe but why not use places api? want to see a ready made gmaps scraper? 😎
Maxim
Maker
@waikiki It could be used to extract business information. But it doesn't crawl right now. I would also suggest to use places API for this
David kart
Kudos for the launch!!
Maxim
Maker
@david_kart1 Thanks!
Pawel Blazejewski
Hey @xavier_geerinck i get this error all the time: failed: timeout 10000ms exceeded ??
Xavier Geerinck
Maker
@pawel_blazejewski Hi Pawel, to prevent abuse we have limits in place of the resources customers can utilize. Currently we have a 10s timeout for initial DOM load + 10s timeout for subsequent SPA requests (for dynamic pages). After this we have a 500ms timeout for each selector that you have. We could help you with these limits, for that please feel free to reach out to me at xavier@scraper.ai!