Buildkite Explained

Buildkite
Trading Name:Buildkite Pty. Ltd.
Former Name:Buildbox
Industry:CI/CD
Founded: in Melbourne, Australia
Founder:Keith Pitt

Buildkite is a continuous integration (CI) and continuous delivery (CD) platform used in DevOps and company was founded in September 2013. Companies using Buildkite include Wayfair, Shopify, Slack, Twilo, Canva, Pinterest, Envato, MYOB and Lyft.[1] [2] [3]

Company history

Buildkite Pty Ltd was founded in September 2013 as Buildbox, with the product out of beta in November.[4] [5] Tim Lucas came on board as a co-founder.[6] The original name of the company, Buildbox, had to be changed due to another company registering the trademark first, reportedly by only two weeks.[7]

In 2021, Buildkite ran its own CI/CD conference, Unblock, for the first time.[8] [9]

In 2022, Tim Lucas stepped down as co-CEO.[10] They also announced a new tool, Test Analytics.[11] [12] [13]

In 2023, the company makes their first acquisition, PackageCloud, from a private equity firm.[14] PackageCloud allows companies to store and distribute software to clients.[15]

Financing

In 2020, Buildkite raised $28M AUD, led by OpenView, with General Catalyst. The company was valued at 200M (AUD) in that deal. In November 2022, the company raised a Series B round of $21M ($32M AUD), with investors including One Ventures, Dominic Pym (angel) and AirTree.[16] [17] [18] [19] Total funding investment at the time of writing is $39MUSD.

Products

Pipelines

Buildkite Pipelines, Buildkite's primary product, was built with a hybrid model where build agents are self-hosted, yet supported by a managed, cloud-powered interface. In the hybrid model, the customer provides their own infrastructure for running agents, including their secrets, while Pipelines has a web application to handle user authentication, build orchestration, store logs and metrics.[20] [21] [22] [23] [24] [25]

Features of Buildkite Pipelines include parallelized builds,[26] self-hosted agent infrastructure, build visualization, and integrations with services like GitHub,[27] Bitbucket, GitLab, and Slack.[28] [29] Pipelines permits up to 10,000 agents per account for customers.

The platform allows the creation of pipelines, which are the definitions (in YAML format) for entire automated build processes. A pipeline consists of individual steps, where each step defines an executable job that runs on one or more agents. Agents are the computers, virtual machines, or containerised infrastructure that provide the capabilities to execute these jobs.

An example of a pipeline YAML file, consisting of three steps[30] :steps: - label: ":hammer: Tests" key: "tests" command: scripts/tests.sh env: BUILDKITE_DOCKER_COMPOSE_CONTAINER: app

- label: ":package: Package" depends_on: "tests" command: scripts/build-binaries.sh artifact_paths: "pkg/*" env: BUILDKITE_DOCKER_COMPOSE_CONTAINER: app

- label: ":debian: Publish" depends_on: "tests" command: scripts/build-debian-packages.sh artifact_paths: "deb/**/*" branches: "main" agents: queue: "deploy"

Test Analytics

Buildkite Test Analytics provides development teams with data about their test suites through metrics and trend analysis, and integrates with Buildkite Pipelines. Using the input data, Test Analytics identifies flaky tests, visualizes historical test performance, and correlates test runs with builds and deployments.

Test Analytics requires a test collector with a test suite that runs as a part of the pipelines definition. There is a Test Collector Buildkite plugin for JSON and Junit files, and some frameworks have specific test collectors, e.g. specific Javascript frameworks.

The test collector gathers data about the test suite’s execution to report back to Test Analytics for visualization and interpretation through the web application. Data includes the performance and duration of tests, as well as the reliability (or flakiness) of tests.[31]

Packages

At the time of writing, Packages is in beta/early access. It's marketed as an artifact and package management solution that "supports all major package formats", splits storage from orchestration for security, includes support of the Buildkite command line interface (CLI), among other features.[32] [33] [34]

No public release date has been shared.

Components

Buildkite’s products consist of the following software components.

The Buildkite Web Application

The Buildkite web application is the software component and platform that provides the user interface to integrate Pipelines, Test Analytics and Packages. The web application provides the following features:

Buildkite Agent

The agent is a small software component that runs natively on different operating system environments and provides the agent capabilities to run a pipeline’s jobs from Buildkite Pipelines. An agent also refers to the computer, virtual machine or containerised infrastructure running the Buildkite agent software component that provides the capabilities to run jobs from a pipeline.

Buildkite Test Collectors

The test collectors are other small software components that integrate with a pipeline’s jobs running test suites. A test collector analyzes the performance and reliability of tests run by a test suite and reports the data analytics back to Test Analytics, assuming the customer has that product enabled.

References

  1. Web site: 2022-11-17 . Buildkite Announces Successful $32 Million Series B Funding Round Startup News . 2024-01-22 . en-AU.
  2. Web site: Shu . Catherine . 2020-08-18 . Melbourne-based CI/CD platform Buildkite gets $28 million AUD Series A led by OpenView . 2024-01-22 . TechCrunch . en-US.
  3. Web site: Waters . Cara . 2020-08-18 . Software startup Buildkite scores $28 million investment . 2024-01-22 . The Sydney Morning Herald . en.
  4. Web site: Good news everyone! Buildbox is now officially out of Beta . 2024-01-22 . Buildkite . en-US.
  5. Web site: Chan . Rosalie . Profitable Australian DevOps startup Buildkite explains how its new $28 million in funding will let it spread the word about being 'the best-kept secret in the developer tool space' . 2024-01-22 . Business Insider . en-US.
  6. Web site: 2022-11-16 . 'Quiet achiever' Buildkite raises $31m to expand operations . 2024-01-22 . The West Australian . en.
  7. Web site: 2015-01-21 . Startup Story: Buildkite . 2024-01-22 . en-AU.
  8. Web site: Announcing UnblockConf – Buildkite's first CI/CD conference . 2024-01-22 . Buildkite . en-US.
  9. Web site: Engineering . Wix . 2021-10-24 . 6 Challenges We Faced While Building a Super CI Pipeline: Part I . 2024-01-22 . Wix Engineering . en.
  10. Web site: Bidding farewell to co-founder and co-CEO Tim Lucas . 2024-01-22 . Buildkite . en-US.
  11. Web site: Test Analytics: Identify, track & fix problematic tests . 2024-01-22 . Buildkite . en-US.
  12. Web site: 2022-06-26 . Integrate tests with Buildkite Test Analytics . 2024-01-22 . DEV Community . en.
  13. Web site: Vizard . Mike . 2022-06-30 . Buildkite Adds Analytics Tools to Identify Flaky App Tests . 2024-02-09 . DevOps.com . en-US.
  14. Web site: Bhartiya . Swapnil . 2023-12-07 . Buildkite's CI/CD Platform Aims To Improve Developer Productivity And Happiness Keith Pitt . 2024-01-22 . TFiR A video is worth a million words . en-US.
  15. Web site: Instacart IPO: The winners and losers . 2024-01-22 . Fortune . en.
  16. Web site: We raised a $21m Series B! Now what do we do next? . 2024-01-22 . Buildkite . en-US.
  17. Web site: Keary . Tim . 2022-11-15 . How automation helps secure the CI/CD pipeline, Buildkite raises $21M . 2024-01-22 . VentureBeat . en-US.
  18. Web site: Q&A with Keith Pitt — the Aussie CEO shaking up software development . 2024-01-22 . SME Business Daily Media . en-gb.
  19. Web site: Palmer-Derrien . Stephanie . 2020-08-19 . Software startup Buildkite rises from stealth mode with $28 million funding round . 2024-02-09 . SmartCompany . en-AU.
  20. Web site: Gerwitz . Ashley . 2020-04-15 . Buildkite . 2024-03-27 . Stark & Wayne . en-US.
  21. Web site: Louden . Austin . Sep 1, 2017 . Continuous integration for iOS with Nix and Buildkite . 2024-03-27 . Pinterest Engineering Blog . en.
  22. Web site: Buildkite Euphemia . 2024-02-09 . Buildkite Euphemia . en.
  23. Web site: K . Likith . Mar 22, 2022 . Know How to Get Started with Buildkite . 2024-03-27 . DEVOPS DONE RIGHT . en-US.
  24. Web site: Vestergaard . Rasmus . Lykke . Andreas . Oct 6, 2022 . uBuild: Fast and Safe Building of Thousands of Container Images . Mar 28, 2024 . Uber.
  25. Web site: Ltd . Sentia Australia Pty . Buildkite Brilliance: CI/CD on Android with Sentia's Expertise . 2024-03-27 . Sentia . en.
  26. Web site: DeWolf . Remy . August 16, 2023 . How Rippling used Spot instances to save and scale CI/CD . 2024-03-27 . Rippling . en-US.
  27. Web site: Hart . Eli . 2021-07-12 . Better Android Testing at Airbnb, Part 7 . 2024-03-27 . The Airbnb Tech Blog . en.
  28. Web site: Bharathi . Vishnu . Nov 23, 2021 . What we learnt by migrating from CircleCI to Buildkite . 2024-03-27 . hasura.io.
  29. Web site: Team . The Zenhub . 2020-08-20 . ZenHub's move to Kubernetes . 2024-03-27 . Zenhub Agile Project Management Blog . en-US.
  30. Web site: Defining your pipeline steps . 2024-03-27 . Buildkite . en.
  31. Web site: Elisha . Anyalebechi . Jan 22, 2024 . 20 Best Exploratory Testing Tools Reviewed For 2024 . Mar 28, 2024 . The QA Lead.
  32. Web site: Buildkite September 2023 Release A new Buildkite product . 2024-03-27 . Buildkite . en-US.
  33. Web site: Buildkite Packages Simple package management for all your artifacts . 2024-03-27 . Buildkite . en-US.
  34. Web site: Buildkite Packages . 2024-03-27 . Buildkite . en.