FlatBuffers explained

FlatBuffers
Author:Wouter van Oortmerssen
Developer:Derek Bailey
Programming Language:C++
Operating System:Android, Microsoft Windows, Mac OS X, Linux
Genre:serialization format and library, IDL compiler
License:Apache License 2.0

FlatBuffers is a free software library implementing a serialization format similar to Protocol Buffers, Thrift, Apache Avro, SBE, and Cap'n Proto, primarily written by Wouter van Oortmerssen and open-sourced by Google. It supports “zero-copy” deserialization, so that accessing the serialized data does not require first copying it into a separate part of memory. This makes accessing data in these formats much faster than data in formats requiring more extensive processing, such as JSON, CSV, and in many cases Protocol Buffers. Compared to other serialization formats however, the handling of FlatBuffers requires usually more code, and some operations are not possible (like some mutation operations).

The serialized format allows random access to specific data elements (e.g. individual string or integer properties) without parsing all data. Unlike Protocol Buffers, which uses variable length integers, FlatBuffers encodes integers in their native size, which favors performance but leads to longer encoded representations.

FlatBuffers can be used in software written in C++, C#, C, Go, Java, JavaScript, Kotlin, Lobster, Lua, PHP, Python, Rust, Swift, and TypeScript. The schema compiler runs on Android, Microsoft Windows, macOS, and Linux,[1] but games and other programs use FlatBuffers for serialization work on many other operating systems as well, including iOS, Amazon's Fire OS, and Windows Phone.[2]

Van Oortmerssen originally developed FlatBuffers for game development and similar applications.[3] [4]

Although FlatBuffers has its own interface definition language to define the data to be serialized with it, it also supports schemas defined in the Protocol Buffers .proto format.[5]

Users

Some notable users of FlatBuffers:

See also

Notes and References

  1. Web site: GitHub — google/flatbuffers: Memory Efficient Serialization Library. 2020-12-10. GitHub.
  2. Web site: 2017-06-15. FlatBuffers for Unity. eXiin. 2015-09-21. We tested flatbuffers [sic] on all major mobile platforms (iOS, Android, Amazon Os [sic], Windows Phone) we’re building on[,] and it works pretty well..
  3. Web site: FlatBuffers Documentation. 2017-06-21. FlatBuffers is an efficient cross platform serialization library for C++, C#, C, Go, Java, JavaScript, PHP, and Python. It was originally created at Google for game development and other performance-critical applications..
  4. Web site: 2014-06-17. FlatBuffers: A Memory-Efficient Serialization Library. Wouter van Oortmerssen. 2017-06-15.
  5. Web site: Cap'n Proto, FlatBuffers, and SBE. 2017-06-15. Kenton Varda. 2014-06-17.
  6. Web site: Cocos2d-x: Flatbuffers Namespace Reference .
  7. Web site: 2017-06-15. Improving Facebook's performance on Android with FlatBuffers. George Xie. 2015-07-31. Story load time from disk cache is reduced from 35 ms to 4 ms per story. Transient memory allocations are reduced by 75 percent. Cold start time is improved by 10-15 percent. We have reduced storage size by 15 percent..