Data build tool explained

dbt
Developer:dbt-Labs
Latest Release Version:1.8.4
Latest Release Date: [1]
Operating System:Microsoft Windows, macOS, Linux
Programming Language:Python
Genre:Data analytics, data management
License:Apache License 2.0
Language:Python

data build tool (dbt) is an open-source command line tool that helps analysts and engineers transform data in their warehouse more effectively.[2]

History

It started at RJMetrics in 2016 as a solution to add basic transformation capabilities to Stitch (acquired by Talend in 2018).[3] The earliest versions of dbt allowed analysts to contribute to the data transformation process following the best practices of software engineering.[4]

From the beginning, dbt was open source.[5] In 2018, the dbt Labs team (then called Fishtown Analytics) released a commercial product on top of dbt Core.[6]

Funding

In April 2020, dbt Labs announced its Series A led by Andreessen Horowitz.[7] In November, dbt Labs announced its Series B led by Andreessen Horowitz and Sequoia.[8] And in June 2021, dbt Labs raised its Series C led by Altimeter, Sequoia, and Andreessen Horowitz.[9] In February 2022, the company raised $222 million for its Series D, at a $4.2 billion valuation [10]

Overview

dbt enables analytics engineers to transform data in their warehouses by writing select statements, and turns these select statements into tables and views. dbt does the transformation (T) in extract, load, transform (ELT) processes – it does not extract or load data, but is designed to be performant at transforming data already inside of a warehouse. dbt has the goal of allowing analysts to work more like software engineers, in line with the dbt viewpoint.[11]

dbt uses YAML files to declare properties. seed is a type of reference table used in dbt for static or infrequently changed data, like for example country codes or lookup tables), which are CSV based and typically stored in a seeds folder.

Notes and References

  1. Web site: Release dbt-core v1.8.4 · dbt-labs/dbt-core . GitHub . 1 Aug 2024.
  2. Book: Atwal . Harvinder . Practical DataOps: Delivering Agile Data Science at Scale . 9 December 2019 . Apress . 978-1-4842-5104-1 . 223 . en.
  3. Web site: Stitch is joining Talend . Stitch Data. . 2018-11-07 . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107174227/https://www.stitchdata.com/blog/stitch-is-joining-talend/ . live .
  4. Web site: Goodbye RJMetrics, Hello Fishtown Analytics . dbt Blog . 2016-08-01 . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107174141/https://blog.getdbt.com/goodbye-rjmetrics-hello-fishtown-analytics/ . live .
  5. Web site: Cai . Kenrick . Dbt Labs In Talks To Raise At $6 Billion Valuation, Six Months After Becoming A Unicorn . 2023-04-01 . Forbes . en.
  6. Web site: Sinter Release Notes, August 2018: pull request builder, fine-grained GitHub permissions, and more . 2018-07-31 . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107174141/https://blog.getdbt.com/sinter-release-notes-august-2018-pull-request-builder-fine-grained-github-permissions-and-more/ . live .
  7. Web site: 2020-04-22 . Fishtown Analytics raises $12.9M Series A for its open-source analytics engineering tool . TechCrunch . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107174139/https://techcrunch.com/2020/04/22/fishtown-analytics-raises-12-9m-series-a-for-its-open-source-analytics-engineering-tool/ . live .
  8. Web site: 2020-11-11 . Fishtown Analytics raises $29.5M Series B for its data engineering platform . TechCrunch . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107174140/https://techcrunch.com/2020/11/11/fishtown-analytics-raises-29-5m-series-b-for-its-data-engineering-platform/ . live .
  9. Web site: 2021-06-30 . Of the Community, By the Community, For the Community . dbt Blog . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107215943/https://blog.getdbt.com/of-the-community-by-the-community-for-the-community/ . live .
  10. Web site: Cai . Kenrick . 24 Feb 2022 . VENTURE CAPITAL Dbt Labs Raises At $4.2 Billion Valuation, $2 Billion Less Than First Planned . https://archive.today/20220511115331/https://www.forbes.com/sites/kenrickcai/2022/02/24/dbt-labs-series-d-4-billion-less-than-planned/?sh=26c7c1cc67c3 . 11 May 2022 . 11 May 2022 . Forbes . Forbes . English . The Philadelphia-based data analytics startup revealed Thursday that it had settled on a $4.2 billion valuation as part of a $222 million Series D funding round.
  11. Web site: dbt viewpoint . 2021-11-07 . 2021-11-07 . https://web.archive.org/web/20211107174742/https://docs.getdbt.com/docs/about/viewpoint . live .

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "Data build tool".

Except where otherwise indicated, Everything.Explained.Today is © Copyright 2009-2024, A B Cryer, All Rights Reserved. Cookie policy.