Alternative data (finance) explained

Alternative data (in finance) refers to data used to obtain insight into the investment process.[1] [2] These data sets are often used by hedge fund managers and other institutional investment professionals within an investment company.[3] [4] [5] Alternative data sets are information about a particular company that is published by sources outside of the company, which can provide unique and timely insights into investment opportunities.[6]

Alternative data sets are often categorized as big data,[7] which means that they may be very large and complex and often cannot be handled by software traditionally used for storing or handling data, such as Microsoft Excel. An alternative data set can be compiled from various sources such as financial transactions, sensors, mobile devices, satellites, public records, and the internet.[8] [9] [10] Alternative data can be compared with data that is traditionally used by investment companies such as investor presentations, SEC filings, and press releases.[11] These examples of "traditional data" are produced directly by the company itself.

Since alternative data sets originate as a product of a company's operations, these data sets are often less readily accessible and less structured than traditional sources of data.[12] Alternative data is also known as "data exhaust".[13] The company that produces alternative data generally overlooks the value of the data to institutional investors. During the last decade, many data brokers, aggregators, and other intermediaries began specializing in providing alternative data to investors and analysts.[14] [15]

Types

Examples of alternative data include:

Uses

Alternative data is being used by fundamental and quantitative institutional investors to create innovative sources of alpha. The field is still in the early phases of development, yet depending on the resources and risk tolerance of a fund, multiple approaches abound to participate in this new paradigm.[19] [20]

The process to extract benefits from alternative data can be extremely challenging. The analytics, systems, and technologies for processing such data are relatively new and most institutional investors do not have capabilities to integrate alternative data into their investment decision process.[21] However, with the right tools and strategy, a fund can mitigate costs while creating an enduring competitive advantage.

Most alternative data research projects are lengthy and resource intensive; therefore, due-diligence is required before working with a data set. The due-diligence should include an approval from the compliance team, validation of processes that create and deliver this data set, and identification of investment insights that can be additive to the investment process.[22]

However, the usage of the alternative data is not restricted by investment sphere, it is successfully used in economics and politics as well as retail and e-commerce spheres. It is possible to predict geopolitical risk through a profound alternative data analysis, while social media sites reveal a host of data for consumer sentiment analysis.

Methodology

Alternative data can be accessed via:

Analysis

In finance, Alternative data is often analyzed in the following ways:

Best practices

While compliance and internal regulation are widely practiced in the alternative data field, there exists a need for an industry-wide best practices standard. Such a standard should address personally identifiable information (PII) obfuscation and access scheme requirements among other issues. Compliance professionals and decision makers can benefit from proactively creating internal guidelines for data operations. Publications such as NIST 800-122[24] provide guidelines for protecting PII and are useful when developing internal best practices. Investment Data Standards Organization (IDSO) was established to develop, maintain, and promote industry-wide standards and best practices for the Alternative Data industry.

Web Scraping

Legal aspects surrounding web scraping of alternative data have yet to be defined. Current best practices address the following issues when determining legal compliance of web crawling operations:

Web scraped data refers to data harvested from public websites. With 4 billion webpages and 1.2 million terabytes of data on the internet, there is a mountain of information that can be valuable to investors when analyzing a corporate performance.The companies that specialize in this type of data collection, like Thinknum Alternative Data,[25] [26] [27] write programs that access targeted websites and collect and store the scraped information on a periodic basis. In some cases web scraping requires use of public APIs as a way to access the data within those pages directly without visiting the actual website.Types of web scraped data include:

Standards Board for Alternative Investment (SBAI) is the global standard-setting agency for the alternative investment industry and guardian of the Alternative Investment Standards. The agency supported by approximately 200 alternative investment managers and institutional investors and collectively manage $3.5 trillion. The SBAI has published the Standardised Trial Data License Agreement which addresses investment managers' issues when comes to new data trailing process, like alternative data and big data.[29] Thomas Deinet, Executive Director of the SBAI said: "This Trial Data Licence Agreement template highlights a number of very important issues, including personal data protection, which has become a hot topic in light of the overhaul of data protection regulation in many jurisdictions. It also includes key protections for managers in areas such as prevention of insider trading and 'right to use data'. It is crucial that managers and data vendors fully understand all risks when selling and using new data."[30]

See also

Further reading

Notes and References

  1. News: Z.. W.. Why investors want alternative data. The Economist. 21 August 2017. 2016-08-22.
  2. Web site: Flanagan. Terry. 'Early Days' For Alternative Data. Markets Media. 21 August 2017. 2016-12-07.
  3. Web site: Kolanovic. Marko. Krishnamachari. Rajesh. Big Data and AI Strategies - Machine Learning and Alternative Data Approach to Investing. RavenPack. J.P. Morgan, Global Quantitative & Derivatives Strategy.. June 29, 2017. 1. en. https://web.archive.org/web/20180722070124/https://www.ravenpack.com/research/jp-morgan-big-data-ai-machine-learning-alternative-data/. July 22, 2018. dead.
  4. Web site: Belissent. Jennifer. The Age of Alt: Data Commercialization Brings Alternative Data To Market. Forrester Research. Forrester Research, Inc.. 20 August 2017. 2017-06-23.
  5. Web site: 2022-06-16 . Unlocking Trading Opportunities Through Alternative Data . 2023-01-02 . Acuity Trading . en-GB.
  6. Web site: Hafez. Peter. Data Hoarding and Alternative Data In Finance – How to Overcome the Challenges. RavenPack.
  7. Web site: Savi. Raffaele. Shen. Jeff. Betts. Brad. MacCartney. Bill. The Evolution of Active Investing Finding Big Alpha in Big Data. BlackRock. August 9, 2017.
  8. Web site: Kilburn. Faye. Quants look to image recognition to process alternative data. Risk.net. 21 August 2017. 2017-07-19.
  9. Web site: Sapnu. Raquel. Why Alternative Data is the New Financial Data for Industry Investors. Datafloq. 24 September 2016. 21 August 2017.
  10. Web site: Barnes. Dan. The role of data in gaining valuable financial insights. Raconteur. Raconteur Media Ltd.. 21 August 2017. 2017-07-02.
  11. Web site: Turner. Matt. This is the future of investing, and you probably can't afford it. Business Insider. 11 August 2017.
  12. Web site: Iati. Robert. Alternative Data: The Hidden Source of Alpha.. Dun & Bradstreet. August 9, 2017.
  13. Web site: Noyes. Katherine. 5 things you need to know about data exhaust. Computer World. IDG News. 11 August 2017. 2016-05-13.
  14. Web site: Levy. Rachael. Hedge funds are tracking your every move, and 'it's the future of investing. Business Insider. 21 August 2017.
  15. News: Wigglesworth. Robin. Investors mine Big Data for cutting-edge strategies. Financial Times. 30 March 2016. Financial Times. 21 August 2017.
  16. Web site: Deloitte . 2018 . Collective intelligence investing: Alpha generation via alternative data brings new risks .
  17. Web site: Borzykowski. Bryan. How investors are using social media to make money.. cnbc.com. August 3, 2017. 2016-06-09.
  18. Web site: Wieczner. Jen. How Social Media Is Helping Investors Make Money.. Fortune. August 4, 2017.
  19. Web site: Ekster. Gene. Driving Investment Performance with Alternative Data.. Integrity Research. August 2, 2017.
  20. Web site: McPartland. Kevin. Alternative Data for Alpha. Dun & Bradstreet. GREENWICH ASSOCIATES. 11 August 2017.
  21. Book: Najork. Marc. Heydon. Allan. Handbook of Massive Data Sets.. 2002. Springer US.. 9781461348825. 25–45. 10.1007/978-1-4615-0005-6. 46033589.
  22. Web site: Ekster. Gene. Alternative Data Cross-functional Teams and Workflow.. Integrity Research. August 7, 2017. 2015-08-19.
  23. Web site: Ekster. Gene. Mitigating Alternative Data Compliance Risks Associated with Web Crawling.. Integrity Research. June 20, 2017. 2016-05-02.
  24. Web site: McCallister. Erika. Grance. Tim. Scarfone. Karen. National Institute of Standards and Technology Special Publication 800-122: Guide to Protecting the Confidentiality of Personally Identifiable Information (PII).. National Institute of Standards and Technology. June 25, 2017.
  25. Web site: Data firm that monitors Reddit says it saw GameStop mentions spiking days ago. CNBC. 25 February 2021.
  26. News: GameStop Stock Frenzy May Not be So Bad for Wall Street. Wall Street Journal. February 2021. Demos. Telis.
  27. News: How the rich got richer: Reddit trading frenzy benefited Wall Street elite . 2021-02-09 . 2021-02-08 . Douglas MacMillan . Yeganeh Torbati . . Washington, D.C. . 0190-8286 . 1330888409.
  28. Johnson, Richard.Data in Action: Web-Scraping." 14 January 2019
  29. Web site: 6 February 2019 . Hedge Fund Standards Board Publishes Standardised Trial Data License Agreement . 15 May 2019.
  30. https://www.hedgeweek.com/2019/02/06/272798/sbai-publishes-standardised-trial-data-license-agreement/"SBAI publishes Standardised Trial Data License Agreement."6 February 2019. Retrieved 15 May 2019.