Archive.today explained

archive.today
Screenshot Size:300px
Type:Web archiving
Language:Multilingual
Registration:No
Launch Date:[1]

archive.today (or archive.is) is a web archiving website founded in 2012 that saves snapshots on demand, and has support for JavaScript-heavy sites such as Google Maps, and Twitter.[2] archive.today records two snapshots: one replicates the original webpage including any functional live links; the other is a screenshot of the page.[3]

The identity of its operator is not apparent.[4]

History

Archive.today was founded in 2012. The site originally branded itself as archive.today, but changed the primary mirror to archive.is in May 2015.[5] It began to deprecate the archive.is domain in favor of other mirrors in January 2019.[6]

archive.today had saved about 500 million pages.

Features

Functionality

Archive.today can capture individual pages in response to explicit user requests.[7] [8] [9] Since its beginning, it has supported crawling pages with URLs containing the now-deprecated hash-bang fragment .[10]

Archive.today records only text and images, excluding XML, RTF, spreadsheet (xls or ods) and other non-static content. However, videos for certain sites, like X (formerly Twitter), are saved.[11] It keeps track of the history of snapshots saved, requesting confirmation before adding a new snapshot of an already saved page.[12]

Pages are captured at a browser width of 1,024 pixels. CSS is converted to inline CSS, removing responsive web design and selectors such as :hover and :active. Content generated using JavaScript during the crawling process appears in a frozen state.[13] HTML class names are preserved inside the old-class attribute.When text is selected, a JavaScript applet generates a URL fragment seen in the browser's address bar that automatically highlights that portion of the text when visited again.

Web pages can be duplicated from archive.today to web.archive.org as second-level backup, but archive.today does not save its snapshots in WARC format. The reverse—from web.archive.org to archive.today—is also possible,[14] but the copy usually takes more time than a direct capture. Historically, website owners had the option to opt out of Wayback Machine through the use of the robots exclusion standard (robots.txt), and these exclusions were also applied retroactively.[15] Archive.today does not obey robots.txt because it acts "as a direct agent of the human user."[9] As of 2019, Wayback Machine no longer obeys robots.txt.

The research toolbar enables advanced keywords operators, using as the wildcard character. A couple of quotation marks address the search to an exact sequence of keywords present in the title or in the body of the webpage, whereas the insite operator restricts it to a specific Internet domain.[16]

Once a web page is archived, it cannot be deleted directly by any Internet user.[17] Removing advertisements, popups or expanding links from archived pages is possible by asking the owner to do it on his blog.[18]

While saving a dynamic list, archive.today search box shows only a result that links the previous and the following section of the list (e.g. 20 links for page).[19] The other web pages saved are filtered, and sometimes may be found by one of their occurrences.

The search feature is backed by Google CustomSearch. If it delivers no results, archive.today attempts to utilize Yandex Search.[20]

While saving a page, a list of URLs for individual page elements and their content sizes, HTTP statuses and MIME types is shown. This list can only be viewed during the crawling process.

One can download archived pages as a ZIP file, except pages archived when archive.today changed their browser engine from PhantomJS to Chromium.[21]

In July 2013, Archive.today began supporting the API of the Memento Project.[22] [23]

Worldwide availability

Australia and New Zealand

See also: Internet censorship in Australia and Internet censorship in New Zealand. In March 2019, the site was blocked for six months by several internet providers in Australia and New Zealand in the aftermath of the Christchurch mosque shootings in an attempt to limit distribution of the footage of the attack.[24] [25]

China

According to GreatFire.org, archive.today has been blocked in mainland China [26] archive.li [27] archive.fo [28] as well as archive.ph [29]

Finland

On 21 July 2015, the operators blocked access to the service from all Finnish IP addresses, stating on Twitter that they did this in order to avoid escalating a dispute they allegedly had with the Finnish government.[30]

Russia

See also: Internet censorship in Russia.

In 2016, the Russian communications agency Roskomnadzor began blocking access to archive.is from Russia.[31] [32]

Cloudflare DNS availability

Since May 2018[33] [34] Cloudflare's 1.1.1.1 DNS service would not resolve archive.today's web addresses, making it inaccessible to users of the Cloudflare DNS service. Both organizations claimed the other was responsible for the issue. Cloudflare staff stated that the problem was on archive.today's DNS infrastructure, as its authoritative nameservers return invalid records when Cloudflare's network systems made requests to archive.today. archive.today countered that the issue was due to Cloudflare requests not being compliant with DNS standards, as Cloudflare does not send EDNS Client Subnet information in its DNS requests.[35] [36]

See also

External links

Notes and References

  1. Web site: When did the Archive-is site originally launch?. Archive.is blog. Tumblr. February 18, 2014. 10 April 2021. 20 March 2021. https://archive.today/20210320075425/https://blog.archive.today/post/77015559437/when-did-the-archive-is-site-originally-launch. live.
  2. Web site: Brinkmann. Martin. 22 April 2015. Create publicly available web page archives with Archive.is. live. https://web.archive.org/web/20190412072055/https://www.ghacks.net/2015/04/22/create-publicly-available-web-page-archives-with-archive-is/. 12 April 2019. 13 June 2015. Ghacks.
  3. Brunelle. Justin F.. Kelly. Mat. Weigle. Michele C.. Nelson. Michael L.. 25 January 2015. The impact of JavaScript on archivability. live. International Journal on Digital Libraries. 17. 2. 95–117. 10.1007/s00799-015-0140-8. 8433375. https://web.archive.org/web/20190527064810/https://www.cs.odu.edu/~mweigle/papers/brunelle-ijdl16.pdf. 27 May 2019.
  4. Web site: Jani. Patokallio. 2023-08-05. archive.today: On the trail of the mysterious guerrilla archivist of the Internet. 2024-01-01. Gyrovague. en. 13 August 2023. https://web.archive.org/web/20230813201525/https://gyrovague.com/2023/08/05/archive-today-on-the-trail-of-the-mysterious-guerrilla-archivist-of-the-internet/. live.
  5. Web site: Why did you change the URL back from archive-today to archive-is?. Archive.is Blog. 3 May 2015. https://web.archive.org/web/20150601001607/http://blog.archive.is/post/118010496181/why-did-you-change-the-url-back-from-archive-today. 1 June 2015. live. 6 January 2019.
  6. archiveis . 1081276424781287427 . Please do not use archive.IS mirror for linking, use others mirrors [.TODAY .FO .LI .VN .MD .PH]. .IS might stop working soon.. 4 January 2019. https://web.archive.org/web/20190106000101/https://twitter.com/archiveis/status/1081276424781287427. 6 January 2019. live.
  7. Web site: Dascalescu. Dan. Dan Dascalescu. Web page archiving – Dan Dascalescu's Wiki (review). Wiki.dandascalescu.com. 18 February 2013. 3 October 2013. https://web.archive.org/web/20130922192354/http://wiki.dandascalescu.com/reviews/online_services/web_page_archiving. 22 September 2013. dead.
  8. Web site: Koebler. Jason. Dear GamerGate: Please Stop Stealing Our Shit. 29 October 2014. Motherboard. https://archive.today/20190527064603/https://www.vice.com/en_us/article/ypw5mj/dear-gamergate-please-stop-stealing-our-shit. 27 May 2019. live. There is no way for a website to protect itself from having an Archive.today user mirror the site.. 22 March 2017.
  9. Web site: Archive.today FAQ. archive.today. 15 February 2019. en.
  10. Web site: Home page of Archive.is in 2013. https://web.archive.org/web/20130112221411/https://archive.is/. 12 January 2013. dead.
  11. Web site: Archive.today blog. live. https://web.archive.org/web/20210907153549/https://blog.archive.today/post/657607767402659840/have-you-considered-allowing-small-mp4s-and-webms. 2021-09-07.
  12. Web site: Example snapshot history on archive.is.
  13. JavaScript-generated loading animation of Dailymotion video appearing in a frozen state
  14. Web site: Example: Page saved from Web Archive to Archive.is. https://archive.today/20130520191911/https://es.wikipedia.org/wiki/Wikipedia. dead. 20 May 2013. 23 October 2019. es.
  15. Web site: FAQs - Some sites are not available because of Robots.txt or other exclusions. What does that mean? . Internet Archive Wayback Machine . https://web.archive.org/web/20110415130934/https://web.archive.org/collections/web/faqs.html#exclusions . April 15, 2011.
  16. For example, the string insite: https://en.wikipedia.org "World Cup" returns the related snapshots
  17. Web site: Some Frequently Asked Question. 24 January 2013. archive.is. blog. https://web.archive.org/web/20130926093655/https://blog.archive.is/post/41395737942/how-can-i-delete-an-archived-page. 26 September 2013. live. 12 November 2018.
  18. Web site: Example user request on the Archive.is blog. 2022-04-07. Archive.is blog. 29 April 2022. https://web.archive.org/web/20220429215629/https://blog.archive.today/post/677427547064156160/could-you-expand-17wus-and-links-under-same. live.
  19. Example of dynamic list: Web site: au:"thomas aquinas". WorldCat. 15 December 2018. 23 March 2019. https://web.archive.org/web/20190323131756/https://www.worldcat.org/search?q=au%3A%22thomas+aquinas%22&fq=&dblist=638&start=21&qt=page_number_link. live.
  20. Web site: Just realized that I can search for keywords in the search bar for archive today, was this a recently added feature?. January 18, 2022. 2022-01-27. Archive.is blog. 27 January 2022. https://web.archive.org/web/20220127183557/https://blog.archive.today/post/673695282217762816/just-realized-that-i-can-search-for-keywords-in. live.
  21. Web site: The "download zip" button has been giving a "Not found" error for quite some time.. Archive.is blog. 17 July 2020. live. https://web.archive.org/web/20201003125618/https://blog.archive.today/post/623883809154383872/the-download-zip-button-has-been-giving-a-not. 3 October 2020.
  22. Web site: Nelson. Michael L.. Archive.is Supports Memento. Web Science and Digital Libraries Research Group at Old Dominion University. Research and Teaching Updates. 9 July 2013. https://web.archive.org/web/20130727194715/https://ws-dl.blogspot.de/2013/07/2013-07-09-archiveis-supports-memento.html. 27 July 2013. live. 17 September 2013. en.
  23. Web site: archive.is. Memento Protocol Information. Memento Development Group. 17 September 2013. https://web.archive.org/web/20130915191950/https://mementoweb.org/depot/native/archiveis/. 15 September 2013.
  24. Web site: ISPs in AU and NZ start censoring the internet without legal precedent. Private Internet Access. 20 March 2019. 19 March 2019. 28 April 2023. https://web.archive.org/web/20230428152352/https://www.privateinternetaccess.com/blog/isps-in-au-and-nz-start-censoring-the-internet-without-legal-precedent/. live.
  25. Web site: New Zealand ISPs Say They're Blocking Sites That Fail To Remove Christchurch Shooting Video. 19 March 2019. Gizmodo Australia. https://web.archive.org/web/20190518223849/https://www.gizmodo.com.au/2019/03/new-zealand-isps-say-theyre-blocking-sites-that-fail-to-remove-christchurch-shooting-video/. 18 May 2019. live. 20 March 2019.
  26. Web site: archive.is is 100% blocked in China. 12 August 2018. GreatFire Analyzer. https://archive.today/20180812150852/https://en.greatfire.org/https/archive.is. 12 August 2018. live.
  27. Web site: archive.li is 100% blocked in China. 12 August 2018. Great Fire Analyzer. https://archive.today/20180812154815/https://en.greatfire.org/https/archive.li. 12 August 2018. live.
  28. Web site: archive.fo is 100% blocked in China. 12 August 2018. Great Fire Analyzer. https://archive.today/20180812152220/https://en.greatfire.org/https/archive.fo. 12 August 2018. live.
  29. Web site: archive.ph is 100% blocked in China. 2022-04-07. en.greatfire.org. 29 April 2022. https://web.archive.org/web/20220429215631/https://en.greatfire.org/https/archive.ph. live.
  30. Web site: Suomalaisilta estettiin haktivistien suosimalla verkkosivulla käynti. Lapintie. Lassi. 22 July 2015. Iltalehti. Finns' access to website used by hacktivists blocked. https://web.archive.org/web/20190527064017/https://www.iltalehti.fi/digi/a/2015072220070969. 27 May 2019. live. 4 March 2016. fi.
  31. Web site: Roskomnadzor zablokiroval servis archive.is, khranyashchiy kopii veb-saytov. ru:Роскомнадзор заблокировал сервис archive.is, хранящий копии веб-сайтов. Elistratov. Vladimir. 29 January 2016. 30 January 2016. TJournal. https://web.archive.org/web/20170830055553/https://tjournal.ru/21966-roskomnadzor-zablokiroval-servis-archive-is-hranyashchiy-kopii-veb-saytov. 30 August 2017. live. ru.
  32. Web site: Russia Blocks Another Archive Site Because It Might Contain Old Pages About Drugs. Cushing. Tim. 4 February 2016. Techdirt. https://web.archive.org/web/20190323131754/https://www.techdirt.com/articles/20160203/08365233504/russia-blocks-another-archive-site-because-it-might-contain-old-pages-about-drugs.shtml. 23 March 2019. live. 26 February 2016.
  33. Web site: 2018-05-15. Archive.is – Error 1001. 2021-12-02. Cloudflare Community. en. 2 December 2021. https://web.archive.org/web/20211202024457/https://community.cloudflare.com/t/archive-is-error-1001/18227. live.
  34. Web site: 2024-03-03. Archive.today & related sites failing again. 2024-03-20 . Cloudflare Community. en . live . https://archive.today/20240403235704/https://community.cloudflare.com/t/archive-today-related-sites-failing-again/623376/1 . 2024-04-03 .
  35. archiveis. 1018691421182791680. "Having to do" is not so direct here. Absence of EDNS and massive mismatch (not only on AS/Country, but even on the continent level) of where DNS and related HTTP requests come from causes so many troubles so I consider EDNS-less requests from Cloudflare as invalid. . live . https://web.archive.org/web/20230802171855/https://twitter.com/archiveis/status/1018691421182791680 . 2 August 2023 .
  36. Web site: Comment by Matthew Prince on Hacker News. https://archive.today/20220513070623/https://news.ycombinator.com/item?id=19828702. 2022-05-13. 4 May 2019. Hacker News. 4 October 2021.

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "Archive.today".

Except where otherwise indicated, Everything.Explained.Today is © Copyright 2009-2024, A B Cryer, All Rights Reserved. Cookie policy.