Apache ORC explained

Apache ORC
Latest Release Version:2.0.2
Latest Release Date:[1]
Operating System:Cross-platform
Genre:Database management system
License:Apache License 2.0

Apache ORC (Optimized Row Columnar) is a free and open-source column-oriented data storage format.[2] It is similar to the other columnar-storage file formats available in the Hadoop ecosystem such as RCFile and Parquet. It is used by most of the data processing frameworks Apache Spark, Apache Hive, Apache Flink, and Apache Hadoop.

In February 2013, the Optimized Row Columnar (ORC) file format was announced by Hortonworks in collaboration with Facebook.[3] A month later, the Apache Parquet format was announced, developed by Cloudera and Twitter.[4]

Apache ORC format is supported by Amazon's AWS Glue.[5]

History

VersionOriginal release dateLatest versionRelease date
2016-01-251.0.02016-01-25
2016-06-101.1.22016-07-08
2016-08-251.2.32016-12-12
2017-01-231.3.42017-10-16
2017-05-081.4.52019-12-09
2018-05-141.5.132021-09-15
2019-09-031.6.142022-04-14
2021-09-151.7.82023-01-21
2022-09-031.8.22023-01-13

See also

Notes and References

  1. Web site: Apache ORC - Releases. 21 August 2024.
  2. Yin Huai, Siyuan Ma, Rubao Lee, Owen O'Malley, and Xiaodong Zhang. "Understanding Insights into the Basic Structure and Essential Issues of Table Placement Methods in Clusters " . VLDB' 39. 1750–1761 . 2013 . 10.14778/2556549.2556559 . 10.1.1.406.4342 .
  3. News: The Stinger Initiative: Making Apache Hive 100 Times Faster . Hortonworks blog . February 20, 2013 . Alan Gates . https://web.archive.org/web/20130328050712/http://hortonworks.com/blog/100x-faster-hive . March 28, 2013 . dead .
  4. Web site: Introducing Parquet: Efficient Columnar Storage for Apache Hadoop . March 13, 2013 . Justin Kestelyn . Cloudera blog . May 4, 2017 . https://web.archive.org/web/20160919221247/http://blog.cloudera.com/blog/2013/03/introducing-parquet-columnar-storage-for-apache-hadoop/ . September 19, 2016 . dead .
  5. Web site: Using the ORC format in AWS Glue. docs.aws.amazon.com. August 21, 2024.