InterPlanetary File System explained

InterPlanetary File System
Author:	Juan Benet and Protocol Labs^[1]
Developer:	Protocol Labs
Language:	Go, JavaScript, Python
License:	MIT license, Apache license 2.0

The InterPlanetary File System (IPFS) is a protocol, hypermedia and file sharing peer-to-peer network for storing and sharing data in a distributed file system. By using content addressing, IPFS uniquely identifies each file in a global namespace that connects IPFS hosts, creating a resilient system of file storage and sharing.^{[2] [3]}

IPFS allows users to host and receive content in a manner similar to BitTorrent. As opposed to a centrally located server, IPFS is built around a decentralized system of user-operators who hold a portion of the overall data. Any user in the network can serve a file by its content address, and other peers in the network can find and request that content from any node who has it using a distributed hash table (DHT).^[4]

In contrast to traditional location-based protocols like HTTP and HTTPS, IPFS uses content-based addressing to provide a decentralized alternative for distributing the World Wide Web.^{[3] [5] [6]}

IPFS is used in decentralized applications and content archiving.^{[7] [8]}

Design

The InterPlanetary File System (IPFS) is a decentralized protocol, hypermedia, and peer-to-peer (P2P) network for distributed file storage and sharing. By using content-addressing, IPFS uniquely identifies files in a global namespace that interlinks IPFS hosts, creating a hypermedia system that enables efficient and reliable data distribution.^[9]

IPFS allows users to host and receive content in a manner similar to BitTorrent. As opposed to a centrally located server, IPFS is built around a decentralized system of user-operators who hold a portion of the overall data, creating a resilient system of file storage and sharing. Any user in the network can serve a file by its content address, and other peers in the network can find and request that content from any node who has it using a distributed hash table (DHT). In contrast to BitTorrent, IPFS aims to create a single global network. This means that if two users publish a block of data with the same hash, the peers downloading content from one user will also exchange data with those downloading it from the second.^[10]

Key features of IPFS include:

• Content-addressed file storage: Each file is uniquely identified based on its content hash, ensuring data integrity and facilitating efficient retrieval.
• Peer-to-peer architecture: A distributed network of nodes facilitates direct file sharing without the need for centralized servers.
• Versioned file system: Supports file versioning and allows users to track changes over time.
• Interoperability with distributed applications: IPFS seamlessly integrates with decentralized applications (dApps), offering a robust storage layer for blockchain and Web3 ecosystems.

IPFS aims to replace protocols used for static webpage delivery by using gateways that are accessible with HTTP.^[11] Users may choose not to install an IPFS client on their device and instead use a public gateway. A list of these gateways is maintained on the IPFS GitHub page.^[12]

Beyond providing an alternative for web hosting, IPFS is widely used in decentralized applications, scientific data sharing, and content archiving, serving as a foundational layer for the emerging decentralized internet.^{[13] [14] [15]}

History

IPFS was created by Juan Benet, who later founded Protocol Labs in May 2014.^[16] An alpha version was launched in February 2015, and by October of the same year was described by TechCrunch as "quickly spreading by word of mouth."Network service provider Cloudflare started using IPFS in 2018 and launched its own gateway in the system in 2022.

In March 2020, the Opera browser provided access to the centralized resources of the Unstoppable Domains provider by hosting content in IPFS.

Applications

• Filecoin is an IPFS-based cooperative storage cloud, also authored by Protocol Labs.^[17]
• Cloudflare runs a distributed web gateway to simplify, speed up, and secure access to IPFS without needing a local node.^[18]
• The shadow libraries Anna's Archive and Library Genesis also deliver books via IPFS,^{[19] [20] [21]} enabling the largest online library of books to be more resilient.
• In 2018 the Internet Archive and Protocol Labs hosted a Decentralized Web summit, exploring applications of IPFS and other technologies to a fully decentralized internet.^[22] In 2022 the Archive explored putting the Wayback Machine data onto IPFS.^[23]
• Brave uses Origin Protocol and IPFS to host its decentralized merchandise store^[24] and, in 2021, added support into their browser.^[25]
• Opera for Android has default support for IPFS, allowing mobile users to browse links to access data on the IPFS network.^[26]

Anti-censorship

• The Catalan independence referendum, taking place in September–October 2017, was deemed illegal by the Constitutional Court of Spain and many related websites were blocked. Subsequently, the Catalan Pirate Party mirrored the website on IPFS to bypass the High Court of Justice of Catalonia order of blocking.^{[27] [28]}
• During the block of Wikipedia in Turkey, IPFS was used to create a mirror of Wikipedia, which allowed access to archived static Wikipedia content despite the ban.^[29] The mirror has now been expanded to more languages, such as English, Ukrainian, Russian, Arabic, and Chinese. A collection of the mirrors can be viewed by using its CID at an IPFS Gateway.

Malware

Phishing attacks have also been distributed through Cloudflare's IPFS gateway since July 2018. The phishing scam HTML is stored on IPFS, and displayed via Cloudflare's gateway. The connection shows as secure via a Cloudflare TLS certificate.^[30]

The IPStorm botnet, first detected in June 2019, uses IPFS so it can hide its command-and-control amongst the flow of legitimate data on the IPFS network.^[31] Security researchers had worked out previously the theoretical possibility of using IPFS as a botnet command-and-control system.^{[32] [33]}

See also

• Content-addressable storage
• Dat (software)
• Distributed file system
• Freenet
• GNUnet
• I2P
• Mnet (peer-to-peer network) aka MojoNation
• ZeroNet

External links

• • Specifications

Notes and References

1. Web site: Case . Amber . Amber Case . 2015-10-04 . Why The Internet Needs IPFS Before It's Too Late . live . https://web.archive.org/web/20220205042345/https://techcrunch.com/2015/10/04/why-the-internet-needs-ipfs-before-its-too-late/ . 2022-02-05 . 2019-07-16 . . en-US.
2. Benet. Juan. 2014-07-14. IPFS - Content Addressed, Versioned, P2P File System. cs.NI . 1407.3561.
3. Finley . Klint . 2016-06-20 . The Inventors of the Internet Are Trying to Build a Truly Permanent Web . live . . 1078-3148 . 24479723 . https://web.archive.org/web/20201215171224/https://www.wired.com/2016/06/inventors-internet-trying-build-truly-permanent-web/ . 2020-12-15 . 2017-03-07 . limited.
4. Krishnan . Armin . 2020 . Blockchain Empowers Social Resistance and Terrorism Through Decentralized Autonomous Organizations . . 13 . 1 . 41–58 . 10.5038/1944-0472.13.1.1743 . 1944-0464 . 26907412 . free.
5. Youtube: Stanford Seminar - "IPFS and the Permanent Web"- Juan Benet of Protocol Labs Quote: "...The InterPlanetary File System (IPFS) is a new hypermedia distribution protocol, to complement--and eventually replace--HTTP. It improves the security, performance, operation modes, and data friendliness of the Web. In particular, it yields a powerful new model, where websites and web applications are decoupled from origin servers, are distributed trustlessly through the network, and are encrypted, authenticated, and executed safely..."
6. Youtube: IPFS: Interplanetary file storage!
7. Benet . Juan . IPFS - Content Addressed, Versioned, P2P File System . 2014 . 1 . 1–21 . cs.NI . 1407.3561 .
8. Web site: IPFS powers the distributed web . 2024-05-09.
9. Krishnan . Armin . 2020 . Blockchain Empowers Social Resistance and Terrorism Through Decentralized Autonomous Organizations . . 13 . 1 . 41–58 . 10.5038/1944-0472.13.1.1743 . 1944-0464 . 26907412 . free.
10. Web site: Content addressing . live . https://web.archive.org/web/20200829083138/https://docs.ipfs.tech/concepts/content-addressing/ . 2020-08-29 . 2020-08-29 . docs.ipfs.tech . en.
11. Web site: IPFS Gateway . live . https://web.archive.org/web/20200829083134/https://docs.ipfs.tech/concepts/ipfs-gateway/ . 2020-08-29 . 2020-08-29 . docs.ipfs.tech . en.
12. Web site: Public Gateway Checker IPFS . live . https://web.archive.org/web/20200824182008/https://ipfs.github.io/public-gateway-checker/ . 2020-08-24 . 2020-08-29 . GitHub.
13. Benet . Juan . IPFS - Content Addressed, Versioned, P2P File System . 2014 . cs.NI . 1407.3561.
14. Web site: IPFS powers the distributed web . 2024-05-09.
15. Web site: What is IPFS? . 2024-05-09.
16. Web site: About . live . https://web.archive.org/web/20210428163146/https://protocol.ai/about/ . 2021-04-28 . 2021-04-28 . Protocol Labs . en.
17. News: Johnson . Steven . 2018-01-16 . Beyond the Bitcoin Bubble . en . . live . subscription . 2018-09-26 . https://web.archive.org/web/20211221233257/https://www.nytimes.com/2018/01/16/magazine/beyond-the-bitcoin-bubble.html . 2021-12-21 . 1553-8095 . 1645522.
18. Orcutt . Mike . 2018-10-05 . A big tech company is working to free the internet from big tech companies . live . . en . 0040-1692 . https://web.archive.org/web/20210126212931/https://www.technologyreview.com/2018/10/05/139885/a-big-tech-company-is-working-to-free-the-internet-from-big-tech-companies/ . 2021-01-26 . 2020-04-21.
19. News: "Anna's Archive" Opens the Door to Z-Library and Other Pirate Libraries * TorrentFreak . 8 January 2023 . TorrentFreak . en . 2022-11-19 . https://web.archive.org/web/20221119123734/https://torrentfreak.com/annas-archive-opens-the-door-to-z-library-and-other-pirate-libraries-221118/ . live .
20. News: 'Shadow Libraries' Are Moving Their Pirated Books to The Dark Web After Fed Crackdowns . 8 January 2023 . VICE . en . 2022-11-30 . https://web.archive.org/web/20221130181558/https://www.vice.com/en/article/v7vnn4/shadow-libraries-are-moving-their-pirated-books-to-the-dark-web-after-fed-crackdowns . live .
21. News: Web3 tech helps banned books on piracy site Library Genesis slip through the Great Firewall's cracks, but for how long? . 8 January 2023 . South China Morning Post . 16 April 2022 . en . 2022-11-29 . https://web.archive.org/web/20221129233050/https://www.scmp.com/tech/tech-trends/article/3172431/web3-tech-helps-banned-books-piracy-site-library-genesis-slip . live .
22. Web site: Internet Archive: Digital Library of Free & Borrowable Books, Movies, Music & Wayback Machine . 2024-04-16 . archive.org.
23. Universal Access to All Knowledge: Decentralization Experiments at the Internet Archive . en . 2024-04-16 . archive.devcon.org.
24. Brave Launches New Swag Store Powered by Origin . 2020-03-24 . en . 2020-04-21 . live . https://web.archive.org/web/20200425042551/https://brave.com/brave-launches-new-swag-store-powered-by-origin/ . 2020-04-25 . Brave.
25. Web site: Porter . Jon . 2021-01-19 . Brave browser takes step toward enabling a decentralized web . live . https://web.archive.org/web/20210226170457/https://www.theverge.com/2021/1/19/22238334/brave-browser-ipfs-peer-to-peer-decentralized-transfer-protocol-http-nodes . 2021-02-26 . 2021-01-29 . . en.
26. Opera introduces major updates to its blockchain-browser on Android . 2020-03-03 . en . 2020-04-21 . live . https://web.archive.org/web/20200402222330/https://press.opera.com/2020/03/30/opera-introduces-major-updates-to-its-blockchain-browser-on-android/ . 2020-04-02 . Opera.
27. Balcell . Marta Poblet . 2017-10-05 . Inside Catalonia's cypherpunk referendum . live . . en-AU . 27 . 20 . 1833-7724 . https://web.archive.org/web/20210915035537/https://www.eurekastreet.com.au/article/inside-catalonia-s-cypherpunk-referendum . 2021-09-15 . 2021-09-15.
28. News: Hill . Paul . 2017-09-30 . Catalan referendum app removed from Google Play Store . en . . live . 2017-10-06 . https://web.archive.org/web/20201101023421/https://www.neowin.net/news/catalan-referendum-app-removed-from-google-play-store . 2020-11-01.
29. News: Dale . Brady . 2017-05-10 . Turkey Can't Block This Copy of Wikipedia . en . . live . 2017-12-20 . https://web.archive.org/web/20171018092720/http://observer.com/2017/05/turkey-wikipedia-ipfs/ . 2017-10-18 . 1052-2948.
30. Web site: Abrams . Lawrence . 2018-10-04 . Phishing Attacks Distributed Through Cloudflare's IPFS Gateway . live . https://web.archive.org/web/20191009125848/https://www.bleepingcomputer.com/news/security/phishing-attacks-distributed-through-cloudflares-ipfs-gateway/ . 2019-10-09 . 2019-08-31 . . en.
31. Web site: Palmer . Danny . 2019-06-11 . This unusual Windows malware is controlled via a P2P network . live . https://web.archive.org/web/20190906223819/https://www.zdnet.com/article/this-unusual-windows-malware-is-controlled-via-a-p2p-network/ . 2019-09-06 . 2019-08-31 . . en.
32. Patsakis . Constantinos . Casino . Fran . 2019-06-04 . Hydras and IPFS: a decentralised playground for malware . International Journal of Information Security . en . 18 . 6 . 787–799 . 1905.11880 . 10.1007/s10207-019-00443-0 . 167217444.
33. Macabeus . Bruno . Vinicius . Marcus . Cavalcante . João Paolo . de Souza . Cidcley Teixeira . 2018-05-06 . Protocolos IPFS e IPNS como meio para o controle de botnet: prova de conceito . Workshop de Segurança Cibernética em Dispositivos Conectados . pt-BR . https://web.archive.org/web/20210117104344/https://sol.sbc.org.br/index.php/wscdc/article/view/2400/2364 . 2021-01-17 . 2021-04-27 . SBC Open Lib . live.