Subscribe
Sign in
Dropbase
p/dropbaseBuild internal tools and backend operations software with AI
Start new thread
Michael Seibel

Dropbase 2.0 - Import messy CSV/Excel to databases with auto map & validate

by•

Dropbase helps you import data from complex and messy CSV and Excel files to a fully-featured SQL database, with automatic column mapping, error highlighting, and data validation/cleaning. Database setup and hosting included; no technical help required.

Add a comment

Replies

Best
Jimmy E. Chan
Maker
Hey Product Hunt! We’re excited to be back here and launch Dropbase 2.0 to the PH community first! This is our biggest update since our previous PH launch! Data is trapped offline inside CSV/Excel files and it’s hard to analyze it or operationalize it without further processing and technical help. We make it easy for spreadsheet users to bring messy data into a fully-featured SQL database that only takes a minute to spin up without engineering, database admins, or custom scripts. Database is included! With this launch, we are announcing 3 major features: 1. Dropmail, the easiest way to email or forward attachments containing messy Excel/CSV files directly to a cloud database, with automatic column mapping and data cleaning 2. Data validation and checks, to ensure imported data conforms to your requirements, and help you flag and fix data with issues 3. Snowflake Integration for use-cases where companies want to host their own data in their existing database This release also comes with a ton of improvements that make the data import experience ever better, from handling complicated Excel files which data in multiple sheets or messy header data, remembering cleaning steps, smart column mapping, merging data to database so you can build golden datasets without duplicates rows, and a robust ingestion engine that can open and handle really complicated CSVs/Excel files. Try it out and share some of your feedback in the comments below! Thanks for hunting us @mwseibel!
Jimmy E. Chan
Maker
We've also release our new documentations page that has a quickstart: https://docs.dropbase.io/quickstart
Lily A
Very impressed with Dropbase 2.0 and congrats! I manage a huge amount of utility data on daily basis and Dropbase has been a big time saver. Just a few clicks then it cleans up all my data, which would take half day to do otherwise. Highly recommend!
Jimmy E. Chan
Maker
Thanks! Glad it’s making your daily work less painful! Have you checked out our Dropmail feature yet?
Lily A
@jimmyechan Yes the Dropmail feature makes it even better!
Jimmy E. Chan
Maker
@lisaval Works like magic. It's gonna save you time and make it less painful to repeatedly import data to the database coming from your external email reports!
Thahir Gangireddypalli
Features are quite impressive and helpful. Congratulations on the launch! 🚀
Jimmy E. Chan
Maker
@thahir_gangireddypalli THANK YOU! Please let us know if you have questions or any feedback!
Somashekhar Mulimani
Team, Congrats on the launch!
Alpesh Modi
Signed Up. But stuck at Database Manager. Will give it a try later. Btw.. Congrats.
Jimmy E. Chan
Maker
@alpesh_modi Sorry to hear that! Try our quickstart guide to help you create your first table and import some data to it! https://docs.dropbase.io/quickstart
Alpesh Modi
@jimmyechan Oh.. Got it. So I have to create table and then import. Do I have to worry about schema as well? Or that will be managed?
Jimmy E. Chan
Maker
Yes! You can create a table with the schema you need as well as any validation checks required. You can then import data to it and we’ll help you manage it
Jimmy E. Chan
Maker
After you import, we automatically keep track of all your data cleaning steps so the next time you import, we apply them for you.
Daniel Schwartz
This looks great! Congrats on the launch!
Ayazhan Zhakhan
Maker
Thanks Daniel! :)
Jimmy E. Chan
Maker
@daniel_schwartz3 Good to hear from you. Thanks for your support and help with the product. Let us know which features you like most!
Daniel Schwartz
@jimmyechan I love the data validation! Really excited about being able to upload bad data and have errors flagged!
Jimmy E. Chan
Maker
@daniel_schwartz3 That's one of the main features in this release. We spent a lot of time figuring this out. We added a lot of flexibility for users to create custom validation checks, from number or date ranges, to categories, to custom regular expressions that will let you check any pattern you can think of.
Jimmy E. Chan
Maker
@ayazhan_zhakhan @daniel_schwartz3 We still have a lot coming!
Stacey P.
Congrats on the launch! Dropbase 2.0 looks very impressive!
Ayazhan Zhakhan
Maker
thank you @stacey_p_ !
Jimmy E. Chan
Maker
@stacey_p_ Thank you for your support!
Stacey P.
@ayazhan_zhakhan What is the maximum file size?
Ayazhan Zhakhan
Maker
the current version supports files up to 50MB, but we're working on increasing this limit for the next release @stacey_p_
ExtraSket
OMG product looks amazing! Great web design by the way: clean, smooth, very easy to navigate 👍🏻 Congrats on the launch!! 🚀
Jimmy E. Chan
Maker
Thank you! Did you check out our light mode?
Jimmy E. Chan
Maker
@icescallion Yes, we got feedback from some of our users saying that they had a hard time reading in dark mode so we added it in this release!
Joyce Cohen
Dropbase looks fantastic. What kind of use cases do you see most frequently with your customers?
Jimmy E. Chan
Maker
@joycecohen Have've seen use cases across multiple industries. Anything from small agencies, to fast growing startups and e-commerce businesses, and some larger enterprises. Customers typically want to automate their repetitive data sharing and data cleaning work. Often then get daily reports or data dumps that they need to organize, clean, validate and then store and centralize into a database that can handle large volumes of data. Most of the data comes in CSV or Excel formats. More often than note, those files are really messy and are complicated to parse out without technical help. What problem are you looking to solve with Dropbase?
Joyce Cohen
@jimmyechan that resonates with me. I have multiple suppliers that send me product and inventory data multiple times during the day. Some are Excel files, some CSV and occasionally Google Sheets. My team downloads all of these files and manually centralize them into 1 master sheet. However it’s getting unmanageable. It also takes a long time to filter data. We are looking to connect to other tools and enrich the data. We have a development team that helps inserting data to a database but there’s a lot of issues and it delays our reporting and analysis. Is Dropbase helpful with this?
Jimmy E. Chan
Maker
@joycecohen I think this use case is quite common actually. We don't have a Google Sheets integration yet, but you can export your Google Sheets as CSVs. We can handle both CSVs and Excel. Dropbase will cut your team's time in half at least, and you won't need to get help from your dev team. we're easy to set up. DM me for a demo and I'll show you how to import your first CSV, build some cleaning steps, and load it to a database all on your own.
Phil
Congratulations! Just signed up. Excited to try the new features!
Jimmy E. Chan
Maker
Thank you! Let us know your feedback in the comments
David Gu
Congrats on the launch! Looks amazing!
Ayazhan Zhakhan
Maker
thank you @davidgu!
Jimmy E. Chan
Maker
@davidgu @ayazhan_zhakhan thanks David! Appreciate the support!
Mehrdad Shirinbakhsh
Impressive! I love the design and the new features! Congrats on the launch!
Jimmy E. Chan
Maker
Thanks! Glad you like it!
Gina Chan
Incredible product!
Ayazhan Zhakhan
Maker
thanks! @gina_chan1
Jonathan Wong
Maker
Hey, I'm Jon and I'm one of the developers at Dropbase. One of the aspects of Dropbase I'm most excited about is how easy it makes cleaning up messy CSV/Excels. Dropbase provides a really intuitive UI that helps users from all backgrounds to find problems with their data and offers them an easy way to fix it. It was challenging to work on because even programmatically it is not that straightforward to clean all types of messy CSV/Excels. I hope you enjoy the new and updated data cleaning experience! Would love any feedback on it and/or to improve it!
Aisulu Saliyeva
What a great product! What other formats besides CSV/Excel does Dropbase support?
Ayazhan Zhakhan
Maker
@aisulu_saliyeva currently we only support csv and excel, but actively working on extending the support for other formats as well
Jimmy E. Chan
Maker
@aisulu_saliyeva Are there specific formats you're looking for? We can add it to our list!
Ayazhan Zhakhan
Maker
hey guys, AZ here, one of the makers of Dropbase. Dropbase 2.0 is the result of 2 years of iteration and experimentation. the product evolved over the years driven by user feedback and our vision for the future of data movement. it was built by a team of talented engineers from the four corners of the world. the features we've implemented are unique to Dropbase and designed to simplify laborious tasks while maintaining flexibility. i'm really excited to see you try Dropbase and hear your feedback. if you have any question, comments or need support, please feel free to email us or DM me directly. i'm happy to schedule support/demo call. thank you for checking us out and i'll see you at https://app.dropbase.io ;)
Henry Nguyen
Maker
Hello -- I'm Henry and and I'm a software intern at Dropbase. I'm excited that now you can bring your own database and connect it to Dropbase. I worked on enabling custom user-provided databases and fast datetime parsing using native code. I hope you check out our product and see the new features. I'm happy to see any feedback or things that we can do better :).
yizhou chen
Dropbase is great! It will save me so much time. The Dropmail feature and handling of Excel files looks incredible. Can I attach multiple files to the same email?
Jimmy E. Chan
Maker
@yizhou_chen YES! You can attach as many CSVs or Excel files as you can fit in an email attachment. It will usually be between 20-30MB per email, depending on your email provider. If you attach multiple CSVs in the same email, we will process each one of them. If you have cleaning recipes set-up, we will also automatically clean each of those files and directly load them to the database for you.
Luis
Can I connect to Dropbase from with my analytics tool?
Jimmy E. Chan
Maker
@sa_valen Yes! One of the main value propositions of Dropbase is that you are always in control of your own data. We give you access to the underlying database that securely stores all your data. And if you need to connect it to other tools, you can simply copy the credentials and do so. Today we support a number of vendors including Tableau, Mode Analytics, Looker, Retool, Castodia, and many more. And if you need additional integrations, contact us at support@dropbase.io!
Freeman Jiang
Maker
Hey everyone! My name is Freeman, and I'm a software engineering intern here at Dropbase. I worked on redesigning and recreating the pipelines page. Besides being able to import and clean data, I think it's important to have a clear way to view a history of the files you've imported to your tables. I hope it's intuitive and easy to work with. Would love any feedback!