Temporal database explained

A temporal database stores data relating to time instances. It offers temporal data types and stores information relating to past, present and future time.Temporal databases can be uni-temporal, bi-temporal or tri-temporal.

More specifically the temporal aspects usually include valid time, transaction time and/or decision time.

Types

Uni-temporal

A uni-temporal database has one axis of time, either the validity range or the system time range.

Bi-temporal

See main article: Bitemporal modeling. A bi-temporal database has two axes of time:

Tri-temporal

See also: Decision time.

A tri-temporal database has three axes of time:

This approach introduces additional complexities.

Temporal databases are in contrast to current databases (not to be confused with currently available databases), which store only facts which are believed to be true at the current time.

Features

Temporal databases support managing and accessing temporal data by providing one or more of the following features:

History

With the development of SQL and its attendant use in real-life applications, database users realized that when they added date columns to key fields, some issues arose. For example, if a table has a primary key and some attributes, adding a date to the primary key to track historical changes can lead to creation of more rows than intended. Deletes must also be handled differently when rows are tracked in this way. In 1992, this issue was recognized but standard database theory was not yet up to resolving this issue, and neither was the then-newly formalized SQL-92 standard.

Richard Snodgrass proposed in 1992 that temporal extensions to SQL be developed by the temporal database community. In response to this proposal, a committee was formed to design extensions to the 1992 edition of the SQL standard (ANSI X3.135.-1992 and ISO/IEC 9075:1992); those extensions, known as TSQL2, were developed during 1993 by this committee.[1] In late 1993, Snodgrass presented this work to the group responsible for the American National Standard for Database Language SQL, ANSI Technical Committee X3H2 (now known as NCITS H2). The preliminary language specification appeared in the March 1994 ACM SIGMOD Record. Based on responses to that specification, changes were made to the language, and the definitive version of the TSQL2 Language Specification was published in September, 1994[2]

An attempt was made to incorporate parts of TSQL2 into the new SQL standard, called SQL3. Parts of TSQL2 were included in a new substandard of SQL3, ISO/IEC 9075-7, called SQL/Temporal.[1] The TSQL2 approach was heavily criticized by Chris Date and Hugh Darwen.[3] The ISO project responsible for temporal support was canceled near the end of 2001.

As of December 2011, ISO/IEC 9075, Database Language Part 2: SQL/Foundation included clauses in table definitions to define "application-time period tables" (valid time tables), "system-versioned tables" (transaction time tables) and "system-versioned application-time period tables" (bitemporal tables). A substantive difference between the TSQL2 proposal and what was adopted in SQL:2011 is that there are no hidden columns in the SQL:2011 treatment, nor does it have a new data type for intervals; instead two columns with datestamps (DS) or date-timestamps (DTS) can be bound together using a PERIOD FOR declaration. Another difference is replacement of the controversial (prefix) statement modifiers from TSQL2 with a set of temporal predicates.

Other features of standard related to temporal databases are automatic time period splitting, temporal primary keys, temporal referential integrity, temporal predicates with Allen's interval algebra and time-sliced and sequenced queries.

Example

For illustration, consider the following short biography of a fictional man, John Doe:

John Doe was born on 1975-04-03 in the Kids Hospital of Medicine County, as son of Jack Doe and Jane Doe who lived in Smallville. Jack Doe proudly registered the birth of his first-born on April 4, 1975 at the Smallville City Hall. John grew up as a joyful boy, turned out to be a brilliant student and graduated with honors in 1993. After graduation, he went to live on his own in Bigtown. Although he moved out on 1994-08-26, he forgot to register the change of address officially. It was only at the turn of the seasons that his mother reminded him that he had to register, which he did a few days later on 1994-12-27. Although John had a promising future, his story ends tragically. John Doe was accidentally hit by a truck on 2001-04-01. The coroner reported his date of death on the very same day.

Using a non-temporal database

To store the life of John Doe in a current (non-temporal) database we use a table . (In order to simplify, name is defined as the primary key of person.)

John's father officially reported his birth on 1975-04-04. On this date a Smallville official inserted the following entry in the database: Person(John Doe, Smallville).Note that the date itself is not stored in the database.

After graduation, John moves out, but forgets to register his new address. John's entry in the database is not changed until 1994-12-27, when he finally reports it. A Bigtown official updates his address in the database. The person table now contains Person(John Doe, Bigtown). Note that the information of John living in Smallville has been overwritten, so it is no longer possible to retrieve that information from the database. An official accessing the database on 1994-12-28, would be told that John lives in Bigtown. More technically: if a database administrator ran the query on 1994-12-26, the result would be Smallville. Running the same query 2 days later would result in Bigtown.

Until his death, the database would state that he lived in Bigtown. On 2001-04-01, the coroner deletes the John Doe entry from the database. After this, running the above query would return no result at all.

DateReal world eventDatabase actionWhat the database shows
John is bornThere is no person called John Doe
John's father officially reports John's birthInserted:Person(John Doe, Smallville)John Doe lives in Smallville
After graduation, John moves to Bigtown, but forgets to register his new addressJohn Doe lives in Smallville
NothingJohn Doe lives in Smallville
John registers his new addressUpdated:Person(John Doe, Bigtown)John Doe lives in Bigtown
John diesDeleted:Person(John Doe)There is no person called John Doe

Using a single axis: valid time or transaction time

See main article: article and Valid time. Valid time is the time for which a fact is true in the real world. A valid time period may be in the past, span the current time, or occur in the future.

For the example above, to record valid time, the person table has two fields added, valid_from and valid_to. These specify the period when a person's address is valid in the real world. On 1975-04-04, John's father registered his son's birth. An official then inserts a new entry into the database stating that John lives in Smallville from April 3. Note that although the data was inserted on the fourth, the database states that the information is valid since the third. The official does not yet know if or when John will move to another place, so the valid_to field is set to infinity (∞). The entry in the database is:

On 1994-12-27, John reports his new address in Bigtown where he has been living since 1994-08-26. A new database entry is made to record this fact:The original entry Person (John Doe, Smallville, 1975-04-03, ∞) is not deleted, but has the valid_to attribute updated to reflect that it is now known that John stopped living in Smallville on 1994-08-26. The database now contains two entries for John Doe:
NameCityValid fromValid to
John DoeSmallville1975-04-031994-08-26
John DoeBigtown1994-08-26
When John dies his current entry in the database is updated stating that John does not live in Bigtown any longer. The database now looks like this:
NameCityValid fromValid to
John DoeSmallville1975-04-031994-08-26
John DoeBigtown1994-08-262001-04-01

Using two axes: valid time and transaction time

See main article: article and Transaction time.

Transaction time records the time period during which a database entry is accepted as correct. This enables queries that show the state of the database at a given time. Transaction time periods can only occur in the past or up to the current time. In a transaction time table, records are never deleted. Only new records can be inserted, and existing ones updated by setting their transaction end time to show that they are no longer current.

To enable transaction time in the example above, two more fields are added to the Person table: transaction_from and transaction_to. Here, transaction_from is the time a transaction was made, and transaction_to is the time that the transaction was superseded (which may be infinity if it has not yet been superseded). This makes the table into a bitemporal table.

What happens if the person's address as stored in the database is incorrect? Suppose an official accidentally entered the wrong address or date? Or, suppose the person lied about their address for some reason. Upon discovery of the error, the officials update the database to correct the information recorded.

For example, from 1995-06-01 to 2000-09-03, John Doe moved to Beachy. But to avoid paying Beachy's exorbitant residence tax, he never reported it to the authorities. Later during a tax investigation, it is discovered on 2-Feb-2001 that he was in fact in Beachy during those dates. To record this fact, the existing entry about John living in Bigtown must be split into two separate records, and a new record inserted recording his residence in Beachy. The database would then appear as follows:

NameCityValid fromValid to
John DoeSmallville1975-04-031994-08-26
John DoeBigtown1994-08-261995-06-01
John DoeBeachy1995-06-012000-09-03
John DoeBigtown2000-09-032001-04-01
However, this leaves no record that the database ever claimed that he lived in Bigtown during 1995-06-01 to 2000-09-03.This might be important to know for auditing reasons, or to use as evidence in the official's tax investigation. Transaction time allows capturing this changing knowledge in the database, since entries are never directly modified or deleted. Instead, each entry records when it was entered and when it was superseded (or logically deleted). The database contents then look like this:
NameCityValid fromValid toEnteredSuperseded
John DoeSmallville1975-04-031975-04-041994-12-27
John DoeSmallville1975-04-031994-08-261994-12-27
John DoeBigtown1994-08-261994-12-272001-02-02
John DoeBigtown1994-08-261995-06-012001-02-02
John DoeBeachy1995-06-012000-09-032001-02-02
John DoeBigtown2000-09-032001-02-022001-04-01
John DoeBigtown2000-09-032001-04-012001-04-01
The database records not only what happened in the real world, but also what was officially recorded at different times.

Using three axes: valid time, decision time, and transaction time

Decision time is an alternative to the transaction time period for recording the time at which a database entry may be accepted as correct. This enables queries that show the officially recognized facts at a given time, even if there was a delay in committing those facts to the database. Support for decision time preserves the entire history and prevents the loss of information during updates.[4]

Decision time periods can only occur in the past or up to the transaction time. As in a transaction time table, records are never deleted. Only new records can be inserted, and existing ones updated by setting their decision end time to show that they are no longer current.

To enable decision time, two more fields are added to a database table: decision_from and decision_to. Here, decision_from is the time a decision was made, and decision_to is the time that the decision was superseded (which may be infinity if it has not yet been superseded). When combined with transaction time, this makes the table into a tritemporal table.The following is a list of real events that occurred between the 1964 and 1976 United States presidential elections:

DateDecision makerReal world event
1964-11-03Electoral CollegeElection of 1964
1968-11-05Electoral CollegeElection of 1968
1972-11-07Electoral CollegeElection of 1972
1973-10-10Spiro AgnewAgnew resigns
1973-10-12Richard NixonNixon nominates Ford
1973-12-06CongressCongress confirms Ford
1974-08-09Richard NixonNixon resigns
1974-08-20Gerald FordFord nominates Rockefeller
1974-12-19CongressCongress confirms Rockefeller
1976-11-02Electoral CollegeElection of 1976

In this example, a constant 7-day delay is assumed between the decision time and the transaction time when the data is committed to the database. Given those conditions, the database would have contained the following information after the election in 1976:

ValidDecisionTransaction
PresidentViceFromToFromToFromTo
JohnsonHumphrey1965-01-201969-01-201964-11-031964-11-10
NixonAgnew1969-01-201973-01-201968-11-051968-11-12
NixonAgnew1973-01-201977-01-201972-11-071972-11-141973-10-17
NixonAgnew1973-01-201977-01-201972-11-071973-10-101973-10-17
NixonAgnew1973-01-201973-10-101973-10-101973-10-17
Nixon(Vacant)1973-10-101977-01-201973-10-101973-10-171973-12-13
NixonFord1977-01-201973-10-121973-10-191973-12-13
Nixon(Vacant)1973-10-101977-01-201973-10-101973-12-061973-12-13
Nixon(Vacant)1973-10-101973-12-061973-12-061973-12-13
NixonFord1977-01-201973-10-121973-12-061973-12-13
NixonFord1973-12-061977-01-201973-12-061973-12-131974-08-15
NixonFord1973-12-061977-01-201973-12-061974-08-081974-08-15
NixonFord1973-12-061974-08-091974-10-081974-08-15
Ford(Vacant)1974-08-091977-01-201974-10-081974-08-151974-12-26
FordRockefeller1977-01-201974-10-201974-08-271974-12-26
Ford(Vacant)1974-08-091977-01-201974-10-081974-12-191974-12-26
Ford(Vacant)1974-08-091974-12-191974-12-191974-12-26
FordRockefeller1977-01-201974-08-201974-12-191974-12-26
FordRockefeller1974-12-191977-01-201974-12-191974-12-26
CarterMondale1977-01-201981-01-201976-11-021976-11-09
Given the 7-day delayed table above, the question "who was president and vice president for the valid time of 1977-01-01" (which given the 7-day delay could provide data for 1976-12-25) would be:

Bitemporal modelling

See main article: article and Bitemporal modeling. A bitemporal model contains both valid and transaction time. This provides both historical and rollback information. Historical information (e.g.: "Where did John live in 1992?") is provided by the valid time. Rollback (e.g.: "In 1992, where did the database believe John lived?") is provided by the transaction time. The answers to these example questions may not be the same the database may have been altered since 1992, causing the queries to produce different results.

The valid time and transaction time do not have to be the same for a single fact. For example, consider a temporal database storing data about the 18th century. The valid time of these facts is somewhere between 1701 and 1800. The transaction time would show when the facts were inserted into the database (for example 1998-01-21).

Schema evolution

See main article: article and Schema evolution. A challenging issue is the support of temporal queries in a transaction time database under evolving schema. In order to achieve perfect archival quality it is of key importance to store the data under the schema version under which they first appeared. However, even the most simple temporal query rewriting the history of an attribute value would be required to be manually rewritten under each of the schema versions, potentially hundreds as in the case of MediaWiki.[5] This process would be particularly taxing for users. A proposed solution is to provide automatic query rewriting,[6] [7] although this is not part of SQL or similar standards.

Approaches to minimize the complexities of schema evolution are to:

Implementations in notable products

The following implementations provide temporal features in a relational database management system (RDBMS).

Non-relational, NoSQL database management systems that provide temporal features including the following:

Temporal databases were one of the earliest forms of data version control, and influenced the development of modern data versioning systems.[18]

Alternatives

Slowly changing dimensions can be used to model temporal relations.

Further reading

See also

External links

Notes and References

  1. Snodgrass, 1999, p. 9
  2. Web site: TSQL2 Temporal Query Language . www.cs.arizona.edu . Richard T. Snodgrass . Richard T. Snodgrass . Computer Science Department of the University of Arizona . 14 July 2009.
  3. Hugh Darwen, C.J. Date, “An overview and Analysis of Proposals Based on the TSQL2 Approach”, In Date on Database: Writings 2000-2006, C.J. Date, Apress, 2006, pp. 481-514
  4. Mario A. Nascimento, Margaret H. Eich, “Decision Time in Temporal Databases”, In Proceedings of the Second International Workshop on Temporal Representation and Reasoning, 1995, pp. 157-162
  5. http://yellowstone.cs.ucla.edu/schema-evolution/index.php/Schema_Evolution_Benchmark Schema Evolution Benchmark - Schema Evolution
  6. Managing and querying transaction-time databases under schema evolution . Hyun J. Moon . Carlo A. Curino . Alin Deutsch . C.-Y. Hou . Carlo Zaniolo . amp . Very Large Data Base VLDB . 2008 .
  7. Scalable Architecture and Query Optimization for Transaction-time DBs with Evolving Schemas . Hyun J. Moon . Carlo A. Curino . Carlo Zaniolo . amp . SIGMOD . 2010 .
  8. Why Banks Care About Bitemporality . Anthony B. Coates . MarkLogic World 2015 . 2015 .
  9. Web site: System-Versioned Tables.
  10. Web site: Paquier. Michael. Postgres 9.2 highlight: range types . 1 November 2012 . https://web.archive.org/web/20160423215529/http://michael.otacoo.com/postgresql-2/postgres-9-2-highlight-range-types/ . 2016-04-23 . Michael Paquier - Open source developer based in Japan.
  11. Web site: Katz. Jonathan S.. Range Types: Your Life Will Never Be The Same. 14 July 2014.
  12. Al-Kateb, Mohammed et al. "Temporal Query Processing in Teradata". EDBT/ICDT ’13 March 18–22, 2013, Genoa, Italy
  13. Web site: A matter of time: Temporal data management in DB2 10 . Saracco. Cynthia M. . Nicola. Matthias . Gandhi. Lenisha . . 3 April 2012 . https://web.archive.org/web/20121025082348/http://www.ibm.com/developerworks/data/library/techarticle/dm-1204db2temporaldata/. en. 2020-10-27. 2012-10-25.
  14. Kulkarni, Krishna, and Jan-Eike Michels. "Temporal features in SQL: 2011". ACM SIGMOD Record 41.3 (2012): 34-43.
  15. Web site: terminusdb/terminusdb-server. 2020-09-04. GitHub. en.
  16. Web site: Bridgwater. Adrian. Data Is Good, 'Bidirectionalized Bitemporal' Data Is Better. . 24 November 2014.
  17. Web site: Datomic Data Model: Time Model. 29 April 2024.
  18. Bhardwaj . Anant . Bhattacherjee . Souvik . Chavan . Amit . Deshpande . Amol . Elmore . Aaron J. . Madden . Samuel . Parameswaran . Aditya G. . 2014-09-02 . DataHub: Collaborative Data Science & Dataset Version Management at Scale . cs.DB . 1409.0798 .