Couchbase Server Explained

Couchbase Server
Developer:Couchbase, Inc.
Latest Release Version:7.6.2
Programming Language:C++, Erlang, C,[1] Go, Java
Genre:Multi-model database, distributed key-value database, document-oriented database, JSON database
License:BSL 1.1,[2] freemium

Couchbase Server, originally known as Membase, is a source-available, distributed (shared-nothing architecture) multi-model NoSQL document-oriented database software package optimized for interactive applications. These applications may serve many concurrent users by creating, storing, retrieving, aggregating, manipulating and presenting data. In support of these kinds of application needs, Couchbase Server is designed to provide easy-to-scale key-value, or JSON document access, with low latency and high sustainability throughput. It is designed to be clustered from a single machine to very large-scale deployments spanning many machines.

Couchbase Server provided client protocol compatibility with memcached,[3] but added disk persistence, data replication, live cluster reconfiguration, rebalancing and multitenancy with data partitioning.

Product history

Membase was developed by several leaders of the memcached project, who had founded a company, NorthScale, to develop a key-value store with the simplicity, speed, and scalability of memcached, but also the storage, persistence and querying capabilities of a database. The original membase source code was contributed by NorthScale, and project co-sponsors Zynga and Naver Corporation (then known as NHN) to a new project on membase.org in June 2010.[4]

On February 8, 2011, the Membase project founders and Membase, Inc. announced a merger with CouchOne (a company with many of the principal players behind CouchDB) with an associated project merger. The merged company was called Couchbase, Inc. In January 2012, Couchbase released Couchbase Server 1.8. In September of 2012, Orbitz said it had changed some of its systems to use Couchbase.[5] In December of 2012, Couchbase Server 2.0 (announced in July 2011) was released and included a new JSON document store, indexing and querying, incremental MapReduce and replication across data centers.[6] [7]

Architecture

Every Couchbase node consists of a data service, index service, query service, and cluster manager component. Starting with the 4.0 release, the three services can be distributed to run on separate nodes of the cluster if needed.In the parlance of Eric Brewer's CAP theorem, Couchbase is normally a CP type system meaning it provides consistency and partition tolerance, or it can be set up as an AP system with multiple clusters.

Cluster manager

The cluster manager supervises the configuration and behavior of all the servers in a Couchbase cluster. It configures and supervises inter-node behavior like managing replication streams and re-balancing operations. It also provides metric aggregation and consensus functions for the cluster, and a RESTful cluster management interface. The cluster manager uses the Erlang programming language and the Open Telecom Platform.

Replication and fail-over

Data replication within the nodes of a cluster can be controlled with several parameters.In December of 2012, support was added for replication between different data centers.

Data manager

The data manager stores and retrieves documents in response to data operations from applications.It asynchronously writes data to disk after acknowledging to the client. In version 1.7 and later, applications can optionally ensure data is written to more than one server or to disk before acknowledging a write to the client.Parameters define item ages that affect when data is persisted, and how max memory and migration from main-memory to disk is handled.It supports working sets greater than a memory quota per "node" or "bucket".External systems can subscribe to filtered data streams, supporting, for example, full text search indexing, data analytics or archiving.[8]

Data format

A document is the most basic unit of data manipulation in Couchbase Server. Documents are stored in JSON document format with no predefined schemas. Non-JSON documents can also be stored in Couchbase Server (binary, serialized values, XML, etc.)

Object-managed cache

Couchbase Server includes a built-in multi-threaded object-managed cache that implements memcached compatible APIs such as get, set, delete, append, prepend etc.

Storage engine

Couchbase Server has a tail-append storage design that is immune to data corruption, OOM killers or sudden loss of power. Data is written to the data file in an append-only manner, which enables Couchbase to do mostly sequential writes for update, and provide an optimized access patterns for disk I/O.

Performance

A performance benchmark done by Altoros in 2012, compared Couchbase Server with other technologies.[9] Cisco Systems published a benchmark that measured the latency and throughput of Couchbase Server with a mixed workload in 2012.[10]

Licensing and support

Couchbase Server is a packaged version of Couchbase's open source software technology and is available in a community edition without recent bug fixes with an Apache 2.0 license[11] and an edition for commercial use.[12] Couchbase Server builds are available for Ubuntu, Debian, Red Hat, SUSE, Oracle Linux, Microsoft Windows and macOS operating systems.

Couchbase has supported software developers' kits for the programming languages .NET, PHP, Ruby, Python, C, Node.js, Java, Go, and Scala.

SQL++

A query language called SQL++ (formerly called N1QL), is used for manipulating the JSON data in Couchbase, just like SQL manipulates data in RDBMS. It has SELECT, INSERT, UPDATE, DELETE, MERGE statements to operate on JSON data.It was initially announced in March 2015 as "SQL for documents".[13]

The SQL++ data model is non-first normal form (N1NF) with support for nested attributes and domain-oriented normalization. The SQL++ data model is also a proper superset and generalization of the relational model.

Example

Like query:
Array query:

Couchbase Mobile

Couchbase Mobile / Couchbase Lite is a mobile database providing data replication.[14]

Couchbase Lite (originally TouchDB) provides native libraries for offline-first NoSQL databases with built-in peer-to-peer or client-server replication mechanisms.[15] Sync Gateway manages secure access and synchronization of data between Couchbase Lite and Couchbase Server.[16]

Uses

Couchbase began as an evolution of Memcached, a high-speed data cache, and can be used as a drop-in replacement for Memcached, providing high availability for memcached application without code changes.[17]

Couchbase is used to support applications where a flexible data model, easy scalability, and consistent high performance are required, such as tracking real-time user activity or providing a store of user preferences or online applications.[18]

Couchbase Mobile, which stores data locally on devices (usually mobile devices) is used to create “offline-first” applications that can operate when a device is not connected to a network and synchronize with Couchbase Server once a network connection is re-established.[19]

The Catalyst Lab at Northwestern University uses Couchbase Mobile to support the Evo application, a healthy lifestyle research program where data is used to help participants improve dietary quality, physical activity, stress, or sleep.[20]

Amadeus uses Couchbase with Apache Kafka to support their “open, simple, and agile” strategy to consume and integrate data on loyalty programs for airline and other travel partners. High scalability is needed when disruptive travel events create a need to recognize and compensate high value customers.[21]

Starting in 2012, it played a role in LinkedIn's caching systems, including backend caching for recruiter and jobs products, counters for security defense mechanisms, for internal applications.[22]

Alternatives

For caching, Couchbase competes with Memcached and Redis.For document databases, Couchbase competes with other document-oriented database systems. It is commonly compared with MongoDB, Amazon DynamoDB, Oracle RDBMS, DataStax, Google Bigtable, MariaDB, IBM Cloudant, Redis Enterprise, SingleStore, and MarkLogic.[23] [24]

Bibliography

(Oct 19, 2018) SQL++ For SQL Users: A Tutorial, Couchbase

Notes and References

  1. Web site: Damien Katz. The Unreasonable Effectiveness of C . January 8, 2013 . September 30, 2016 .
  2. Web site: Couchbase Adopts BSL License . The Couchbase Blog . 26 March 2021.
  3. Web site: NewProtocols - memcached - Klingon - Memcached - Google Project Hosting . 2011-08-22 . 2013-06-04.
  4. Book: Professional NoSQL . Shashank Tiwari . 31 August 2011 . John Wiley & Sons . 15–16 . 9781118167809 .
  5. Web site: Balancing Oracle and open source at Orbitz . . September 21, 2012 . September 19, 2016 .
  6. Web site: Couchbase 2.0 released; implements JSON document store . . Andrew Brust . December 12, 2012.
  7. Web site: Couchbase goes 2.0, pushes SQL for NoSQL . Derrick Harris . July 29, 2011 . GigaOm . September 19, 2016 . October 2, 2016 . https://web.archive.org/web/20161002115129/https://gigaom.com/2011/07/29/couchbase-2-0-unql-sql-nosql/ . dead .
  8. Web site: Want to know what your memcached servers are doing? Tap them . Trond Norbye . Couchbase blog . March 15, 2010.
  9. Web site: Benchmarking Couchbase . Frank Weigel . Couchbase . October 30, 2012 . September 30, 2016 .
  10. Web site: Cisco and Solarflare Achieve Dramatic Latency Reduction for Interactive Web Applications with Couchbase, a NoSQL Database . . June 18, 2012 . August 13, 2012 . https://web.archive.org/web/20120813162214/http://www.cisco.com/en/US/prod/collateral/switches/ps9441/ps9670/white_paper_c11-708169.pdf . October 7, 2016 .
  11. Web site: Couchbase Open Source Projects . Couchbase web site . October 7, 2016 .
  12. Web site: Couchbase Server Editions. Couchbase. 2012-12-07. 2012-12-27. https://web.archive.org/web/20121227113419/http://www.couchbase.com/couchbase-server/editions. dead.
  13. Web site: Ssssh! don't tell anyone but Couchbase is a serious contender: Couchbase Live Europe 2015 . Andy Slater . March 24, 2015 . February 13, 2018 .
  14. Web site: DB-Engines: Couchbase including Mobile. live. 29 June 2021. DB-Engines. https://web.archive.org/web/20130729210414/http://db-engines.com:80/en/system/Couchbase . 2013-07-29 .
  15. Web site: Lite Couchbase . www.couchbase.com . 11 May 2020.
  16. Web site: Sync Gateway Couchbase. live. 29 June 2021. DB-Engines. https://web.archive.org/web/20130729210414/http://db-engines.com:80/en/system/Couchbase . 2013-07-29 .
  17. Web site: Jaquier. Yannick. 2016-09-27. Couchbase server as a Memcached cluster (part 2). 2022-02-09. IT World. en-US.
  18. Web site: Introduction to Couchbase - NoSQL Document Database. 2022-02-09. Today Software Magazine. en.
  19. Web site: Couchbase Mobile. 2022-02-09. DEV Community. 6 February 2022 . en.
  20. Web site: 2021-12-31. How Northwestern's Catalyst Lab scales healthy behavior program with Couchbase. 2022-02-09. VentureBeat. en-US.
  21. Web site: January 20, 2022. Amadeus Loyalty wins the Couchbase Community Award under the Cloud Computing Category. Amadeus IT Group.
  22. Web site: Couchbase Ecosystem at LinkedIn. December 6, 2017 . Michael Kehoe . 2022-02-09 . engineering.linkedin.com. en.
  23. Web site: Inc. Gartner. Top Couchbase Competitors and Alternatives - Gartner 2022 - Cloud Database Management Systems. 2022-02-09. Gartner.
  24. Web site: MongoDB to Couchbase: An Introduction to Developers and Experts - DZone Database. 2022-02-09. dzone.com. en.