Data CI/CD by Metaplane runs checks in GitHub whenever you make data model changes to ensure data hasn't changed in ways you don't expect, and let you know what the impact on downstream BI dashboards may be.
We're so excited to share Metaplane with PH today! Thanks @mwseibel for Hunting us.
Metaplane is a data observability platform that helps data teams know when things break, what went wrong, and how to fix it. We like to call it “The Datadog for Data” :)
Since we started Metaplane, we’ve had hundreds of conversations with data teams about the many challenges they face. One of the most common sources of data quality issues are code changes—made by the data team or other engineering teams–that incorrectly transform or model data used in downstream BI tools and operational tools (e.g. HubSpot, Salesforce, Zendesk). Given that this data is relied upon by several downstream teams, our customers asked for more ways to automatically verify changes before merging them into production.
With data test previews in Metaplane, data teams can now test their data in the pull request.
Whenever your data team opens a pull request, in addition to running data impact previews, Metaplane will compare the results of running a suite of data tests against your PR changes and production warehouse. Data test previews are also configurable so you can choose which tests are run and you can adjust the testing thresholds.
Lastly, Metaplane allows data teams to share data test reports with teammates, raising awareness of the changes being made and the impact of those changes. Because as well all know, it sucks to be the last to know :)
We'd love to hear your ideas, experiences, and feedback, and will be answering any questions in the comments!
I love Metaplane because it helps ensure that we discover problems in our data before anyone else notices, and this feature goes even further to avoid problems before they get introduced. Love this from the amazing Metaplane team.
Metaplane has given our team insight into our data by providing thorough lifecycle lineage from our source system data to our reporting tools. We no longer wait for a co-worker to announce our numbers look 'off' and can maintain confidence when pushing changes. The future for Metaplane is looking bright
Congrats Metaplane team!
It's been fun working with our engineers whilst iterating on this product ahead of launch. Their passion for great software engineering practices translated into unique data tooling here. 🤓
Metaplane