Heat map explained

A heat map (or heatmap) is a 2-dimensional data visualization technique that represents the magnitude of individual values within a dataset as a color. The variation in color may be by hue or intensity.

In some applications such as crime analytics or website click-tracking, color is used to represent the density of data points rather than a value associated with each point.

"Heat map" is a relatively new term, but the practice of shading matrices has existed for over a century.[1]

History

Heat maps originated in 2D displays of the values in a data matrix. Larger values were represented by small dark gray or black squares (pixels) and smaller values by lighter squares. Toussaint Loua (1873) used a shading matrix to visualize social statistics across the districts of Paris. Sneath (1957) displayed the results of a cluster analysis by permuting the rows and the columns of a matrix to place similar values near each other according to the clustering. Jacques Bertin used a similar representation to display data that conformed to a Guttman scale. The idea for joining cluster trees to the rows and columns of the data matrix originated with Robert Ling in 1973. Ling used overstruck printer characters to represent different shades of gray, one character-width per pixel. Leland Wilkinson developed the first computer program in 1994 (SYSTAT) to produce cluster heat maps with high-resolution color graphics. The Eisen et al. display shown in the figure is a replication of the earlier SYSTAT design.

Software designer Cormac Kinney trademarked the term 'heat map' in 1991 to describe a 2D display depicting financial market information.[2] The company that acquired Kinney's invention in 2003 unintentionally allowed the trademark to lapse.[3]

Types

There are two main type of heat maps: spatial, and grid.

A spatial heat map displays the magnitude of a spatial phenomena as color, usually cast over a map. In the image labeled "Spatial Heat Map Example," temperature is displayed by color range across a map of the world. Color ranges from blue (cold) to red (hot).

A grid heat map displays magnitude as color in a two-dimensional matrix, with each dimension representing a category of trait and the color representing the magnitude of some measurement on the combined traits from each of the two categories. For example, one dimension might represent year, and the other dimension might represent month, and the value measured might be temperature. This heat map would show how temperature changed over the years in each month. Grid heat maps are further categorized into two different types of matrices: clustered, and correlogram.

In a grid heat map, colors are presented in a grid of a fixed size, with every cell in the grid also being an equal size and shape. The goal is to detect clustering, or suggest the presence of clusters.

A spatial heat map is often used on maps or satellite imagery (see GIS), where there is no concept of cells, and instead the colours vary continuously.

Uses

Heat maps have a wide range of possibilities amongst applications due to their ability to simplify data and make for visually appealing to read data analysis. Many applications using different types of heat maps are listed below.

Business Analysis

Heat maps are used in business analytics to give a visual representation about a company's current functioning, performance, and the need for improvements. Heat maps are a way to analyze a company's existing data and update it to reflect growth and other specific efforts. Heat maps visually appeal to team members and clients of the business or company.

Websites: There are many different ways heat maps are used within websites to determine a visiting users actions. Typically, there are multiple heat maps used together to determine insight to a website on what are the best and worst performing elements on the page. Some specific heat maps used for website analysis are listed below.

Exploratory Data Analysis

Working with small and large data sets, data scientists and data analysts look at and determine essential relationships and characteristics amongst different points in a data set as well as features of those data points. Data scientists and analysts work with a team of others in different professions. The use of heat maps make for a visually easy way to summarize findings and main components. There are other ways to represent data, however heat maps can visualize these data points and their relationships in a high dimensional space without becoming too compact and visually unappealing. Heat maps in data analysis, allow for specific variables of rows and/or columns on the axes and even on the diagonal.

Financial Analysis

The values of different product and assets fluctuate both rapidly and/or gradually over time. The need to log changes to the daily markets is imperative. It allows for the ability to draw predictions from patterns while being able to revisit past numerical data. Heat maps are able to remove the tedious process and enable the user to visualize data points and compare amongst the different performers.[5]

Geographical Visualization: Heat maps are used to visualize and display a geographic distribution of data. Heat maps represent different densities of data points on a geographical map to help users see the intensities of certain phenomena and to show items of most or least importance. Heat maps used in geographical visualization are sometimes confused with Choropleth maps, but the difference comes with how certain data is presented which differentiate the two.[6]

Sports: Heat maps can be used in many sports and can influence manager's and/or coaches decisions based on high and low densities of data displayed. Users can identify patterns within the game, the strategies of opponents and one's own team, make more informed decisions benefitting the player, team, and business, and can enhance performance in different areas by identifying enhancement is needed. Heat maps also visualize comparisons and relationships amongst different teams in the same sport or between different sports all together.[7]

Color schemes

Many different color schemes can be used to illustrate the heat map, with perceptual advantages and disadvantages for each. Choosing a good color scheme is integral to accurately and effectively displaying data, whereas a poor color scheme can lead viewers to inaccurate conclusions or exclude those with color deficiencies from proper analysis of said data.

Rainbow color maps are a common choice, as humans can perceive more shades of color than they can of gray, and this would purportedly increase the amount of detail perceivable in the image. However, this is heavily discouraged in the scientific community for a number of reasons. Possibly the largest reason is that when there is a large number of colors involved, the visualization may give off the impression that there exist gradients in the data that are not really present. The more colors used in a visualization the more values begin to bleed together and color lacks the natural perceptual ordering found in grayscale or blackbody spectrum colormaps. Additionally, values represented by different shades of the same color can imply that the values are related when they are not.[8] [9] [10]

An important consideration when choosing a color scheme is whether or not the data will be viewed by anyone with any form of color deficiency. If the audience contains individuals with any form of color blindness, it may be wise to avoid color schemes with prominent reds and greens or uneven color gradients.In addition to audience considerations, it is also important to consider the form in which the data will be viewed. For example, if the data is to be printed in black and white or projected onto a large screen, it may be wise to adjust one's choice in color scheme. Common colormaps (like the "jet" colormap used as the default in many visualization software packages) have uncontrolled changes in luminance that prevent meaningful conversion to grayscale for display or printing. This also distracts from the actual data, arbitrarily making yellow and cyan regions appear more prominent than the regions of the data that are actually most important.

Software implementations

Several heat map software implementations are freely available:

Choropleth maps versus heat maps

Choropleth maps and heat maps are often used in place of one another incorrectly when referring to data visualized geographically.[23] Both techniques show the proportion of a variable of interest, but the two differ in how the boundaries for the variable's data aggregations are constructed. If the data were collected and aggregated using irregular boundaries, such as administrative units, then a heat map displaying that data will be the same as a choropleth map, encouraging confusion about how the two differ.

Choropleth maps show data grouped by geographic boundaries like countries, states, provinces or even floodplains. Each region has a singular value, visualized by color intensity, shading or pattern. The figure on the right displaying a choropleth map showing the United States' population density by state may be used as an example. The figure illustrates a singular value (population) denoted by blue color intensity proportionate to the state's value relative to all other states' values, bounded by each state's border.

Similarly, heat maps may also visualize data over a geographic region. However, unlike choropleth maps, heat maps show the proportion of a variable over an arbitrary, but usually small grid size, independent of geographic boundaries.[24] [25] The figure on the right displaying a heat map of world population is an example. The figure illustrates a single value (population) bounded in an arbitrary grid (square kilometers) with each cell in the grid represented by a color intensity proportionate to the value of the cell relative to all other cells. Some heat maps that are created using approximated regional data may show familiar geographic borders in the visualization where none really exist. The illusion of geographic borders is due to the existence of patterns within the dataset rather than the visualization technique. The figure on the right displaying a heat map of world population also contains this occurrence. Areas in rural parts of the United States and South America may closely resemble familiar geographic borders in those regions.

See also

References

Further reading

. Jacques Bertin . Bertin J . Sémiologie Graphique. Les diagrammes, les réseaux, les cartes . Graphic semiotics. Diagrams, networks, maps . French . 1967 . Gauthier-Villars . 2656278.

. Leland Wilkinson . Wilkinson L . Advanced Applications: Systat for DOS Version 6 . 1994 . SYSTAT . 978-0-13-447285-0.

External links

Notes and References

  1. Wilkinson L, Friendly M . The History of the Cluster Heat Map. The American Statistician. May 2009. 63. 2. 179–184. 10.1198/tas.2009.0033. 10.1.1.165.7924. 122792460.
  2. Web site: United States Patent and Trademark Office, registration #75263259 . 1993-09-01.
  3. Book: Software Engineering Perspectives and Application in Intelligent Systems . Silhavy . Radek . Senkerik . Roman . Oplatkova . Zuzana Kominkova . Silhavy . Petr . Prokopova . Zdenka . vanc . 2016-04-26 . 978-3-319-33622-0 .
  4. Web site: A Guide to Heatmaps: What is a Heatmap, the Use, and Types? | Attention Insight. 27 May 2021.
  5. Web site: 5 Real Heat Map Examples from Leading Industries [2022] | VWO. 20 January 2020.
  6. Web site: Guide to Geographic Heat Maps [Types & Examples]. 20 December 2021.
  7. Web site: 5 Real Heat Map Examples from Leading Industries [2022] | VWO. 20 January 2020.
  8. Borland D, Taylor MR . 2007 . Rainbow color map (still) considered harmful . IEEE Computer Graphics and Applications . 27 . 2 . 14–7 . 10.1109/MCG.2007.323435 . 17388198.
  9. 6 . Borkin MA, Gajos KZ, Peters A, Mitsouras D, Melchionna S, Rybicki FJ, Feldman CL, Pfister H . December 2011 . Evaluation of artery visualizations for heart disease diagnosis . IEEE Transactions on Visualization and Computer Graphics . 17 . 12 . 2479–88 . 10.1.1.309.590 . 10.1109/TVCG.2011.192 . 22034369 . 2548700.
  10. Crameri F, Shephard GE, Heron PJ . October 2020 . The misuse of colour in science communication . Nature Communications . 11 . 1 . 5444 . 2020NatCo..11.5444C . 10.1038/s41467-020-19160-7 . 7595127 . 33116149.
  11. Web site: Using R to draw a heat map from Microarray Data . Molecular Organisation and Assembly in Cells . 26 Nov 2009 .
  12. Web site: Draw a Heat Map . R Manual .
  13. Web site: Gnuplot demo script: Heatmaps.dem.
  14. Web site: Fusion Tables Help - Create a heat map. Jan 2018. support.google.com
  15. Web site: Dave Green's 'cubehelix' colour scheme.
  16. Web site: ol/layer/Heatmap~Heatmap . OpenLayers . 2019-01-01 .
  17. Web site: Heatmap . D3.js Graph Gallery . 25 July 2020.
  18. Web site: Most basic heatmap in d3.js . D3.js Graph Gallery . 25 July 2020.
  19. Web site: Heat Map Chart . AnyChart Documentation . 25 July 2020.
  20. Web site: Heat Map Charts - Gallery . AnyChart Gallery . 25 July 2020.
  21. Web site: Heatmap - Highcharts docs . Highcharts . 9 December 2019.
  22. Web site: Heat and tree maps - Highcharts demos . Highcharts . 9 December 2019.
  23. Web site: Heatmaps vs Choropleths . 2024-03-15 . www.standardco.de.
  24. Web site: Choropleth vs. Heat Map « Cartographer's Toolkit . 2022-04-15.
  25. Web site: Heatmaps vs Choropleths . 2022-04-15 . www.standardco.de.