Kat Manalac

Apify - Your one-stop shop for web scraping and web RPA solutions

Apify is an open web scraping and automation platform, where you can find dozens of ready-made data extraction and automation tools, build new tools using our popular open-source SDK, or order an affordable turn-key solution from certified developers.

Add a comment

Replies

Best
Jeroen Corthout ☕
Happy Apify user here! I'm using it to automate LinkedIn connection requests to people who sign up for @salesflare by searching their LinkedIn profile in Google through Apify. Works like a charm! ❤️
Jakub Balada
@jeroen_corthout It's great to see such a web automation flow on Apify. Btw, haven't you considered to publish your actor at Apify store?
Jeroen Corthout ☕
@jakubbalada I'm using the Google Search Results Scraper actor if I'm not mistaken. Super handy! Here it is: https://apify.com/apify/google-s...
Jan Čurn
Hey Product Hunt and thanks to @katmanalac for hunting us! Jan, Jakub and the Apify team here, it’s great to be back! We’ve come a long way since we first launched here as Apifier in 2015. We’ve grown from two guys in a small house in Mountain View into a company of 30 amazing people on a mission to make the web more programmable. And as our product has changed completely since the first launch, it’s about time we brought Apify to you again. Apify is a web scraping and robotic process automation (RPA) platform that lets you extract structured data from any website and automate any workflow on the web. Apify can help eliminate time-consuming and repetitive tasks that you or your employees perform manually in a web browser. Further, it can help you get the data you need to improve your products, marketing, sales, and business decisions. Here’s what you can do with Apify: 🔍 Browse ready-made web scraping and web RPA tools published by our community and use them in your projects in just a few clicks. ➡️ https://apify.com/store 🧑🏿‍💻 Haven’t found the right tool? If you’re a developer, you can build your own scrapers, crawlers, or robots using our popular open-source SDK and extensive documentation. ➡️ https://sdk.apify.com/ 🛒 Alternatively, you can order an affordable turn-key web scraping or RPA solution from certified external developers. Simply submit your project and wait for the offers to roll in. ➡️ https://apify.com/marketplace 🏢 You can also request a complete end-to-end solution for any scale from Apify experts and partners. ➡️ https://apify.com/enterprise We’d love to get your feedback and we’ll be around to answer any questions! As a thank you, we’ve prepared a special offer - a 20% discount for the first 6 months. To take advantage of this offer, enter the following promo code when subscribing: PRODUCT_HUNT_SPECIAL
I-crawle Web Scraping Service
This app is too costly for scraping, I used it but not satisfied.
Jakub Balada
@i_crawle_web_scraping_service Sorry to hear you weren't satisfied. Apify may not be the cheapest option for web scraping, but if you're looking for a flexible and scalable platform which can scrape billions of pages from complex websites, it's a way to go.
Chris Dietrich
@i_crawle_web_scraping_service I suppose you may be a bit biased ;)
Khalid B
I am a happy Apify customer (Not affiliated with Apify). Apify is a robust and easy to use platform for data scraping. We have migrated all of our scraping tasks from AWS Lambda to Apify. Apify is a time saver. Give it a try! Improvement: simplify the pricing model. The "Actor compute units" can be complicated to understand and to measure at first.
Jan Čurn
@therasmus79 Thank you for your kind words! We're working on a new billing system that should make the pricing much simpler. It will be ready soon.
Tuğkan Cengiz
As far as I see you can scrape almost everything with the support of the SDK and platform. Really liked the idea. Great job guys!
Jan Čurn
@tugkancengiz Thank you!
abdelhalim laidi
I used Apify library as well as apify platform and it is really great for automation and scraping. I strongly recommend dealing with Apify, they have a great, helpful and patient team.
Jan Čurn
@abdelhalim_laidi Thank you so much for your kind words!
Sebastian Potcher
Nice automation catalog.
Artur Loda
i've used their instagram scraper and it worked great for me!
Jan Čurn
@artur_loda I'm glad to hear that!
Lukáš Křivka
@artur_loda Furthermore, there will be a big release of new version for Instagram Scraper with many new features and bug fixes, stay tuned!
Francesco Emiro
so far i just used Apify library and it is really great for automation and scraping, well done!
Jakub Balada
@francesco_monder Thanks for your great feedback! Hope you try our cloud platform soon as well :-)
Nikita Drozd
Awesome product & team! Best of luck!
Jan Čurn
@ndrozd Thank you very much!
TheSax
Happy Apify customer for more than a year now. Absolutely love the product, and although you *can* use the sdk on, say an ec2 instance, I love that I dont have to think about proxys etc - it just works! The team delivers great support and I have noticed several great improvements over time.
Jan Čurn
@thesmons Thank you, we're glad to have you onboard!
Kelly Belton
Quick question? Do you impose automated limits to make sure that we scrape reasonably or is it up to us to place such controls? What I usually struggle is to find the right balance for scraping a high volume of data in a reasonable amount of time.
Lukáš Křivka
@kellybelton Hi Kelly, this is a very important question. Most of our public scrapers in our Store (https://apify.com/store) have internal limits that depend on the capacity of the target website. If you build a new scraper, it is naturally slowed down by the available memory so you have time to evaluate the ideal speed/costs ratio. It is definitely a lot about common sense, if you scrape a website of Amazon's site, you can go faster, but with smaller sites, you want to go slower to not overload their servers. Our SDK allows you to limit the max concurrency and add more delays.
Niels Ole Dam
Have been using Apify for production tasks for over a year – very pleased with their service. And they have a great customer support team, too. Can definitly recommend!
Lukáš Křivka
@niels_ole_dam Thanks a lot for a nice feedback!
Jakub Balada
@niels_ole_dam Thanks for your recommendation!
Niels Ole Dam
@lukas_krivka1 You're welcome. BTW we're also using your handy google-sheets Actor for simplifing fetching dynamic pre-run data into some of our Apify tasks – very nice with these kinds of prebuild addons to the platform. :-)
Memories 2 Digital
Used Apify for a couple of years, their tools are great (even if you don't use their cloud services!)
Jan Čurn
@memories_2_digital Many thanks for your kind words!
Richard Nwankwo
Very useful scraping platform. Was up and running doing scraping tasks shortly after going through the tutorial (https://docs.apify.com/scraping/...) Great tool to have in your dev toolbox
Jan Čurn
@richnwan Thank you, Richard!
Vivian
From my perspective, Apify is the best web scraping solution.
Alexandru Porcescu
Apify made NodeJS a web scraping first citizen. Before it's tools Python was the king. Now it is giving scrapy a run for its money. Good job guys!
Ben
I've been using the service for around 3 years. It is fantastic and my go-to for scraping anything. If you have any issues the team are on it and always happy to help. I can't recommend Apify enough!
Jan Čurn
@beesum ❤️
Owen Richards
Been using Apify to scrape lots of specific news sources and report back to a customer with new content for about 3 years and love it! The service and documentation is great and the platform as a whole really reliable. Good job guys! 🎉
Jakub Balada
@owenthetwit Great use case! We're glad to have you onboard for such a long time.
Ryo Chiba
Excited to see this on Product Hunt, congrats Apify team! Highly recommend this product to anyone looking for a powerful but easy to use RPA. You can read about our experience here: https://apify.com/success-storie...
Jakub Balada
@ryochiba Thanks a lot for sharing your use case how Topic is using Apify!