File Transfer Protocol Explained

File Transfer Protocol
Purpose:File transfer
Developer:Abhay Bhushan for RFC 114
Osilayer:Application layer
Ports:21 for control, 20 for data transfer
Rfcs:RFC 959

The File Transfer Protocol (FTP) is a standard communication protocol used for the transfer of computer files from a server to a client on a computer network. FTP is built on a client–server model architecture using separate control and data connections between the client and the server.[1] FTP users may authenticate themselves with a plain-text sign-in protocol, normally in the form of a username and password, but can connect anonymously if the server is configured to allow it. For secure transmission that protects the username and password, and encrypts the content, FTP is often secured with SSL/TLS (FTPS) or replaced with SSH File Transfer Protocol (SFTP).

The first FTP client applications were command-line programs developed before operating systems had graphical user interfaces, and are still shipped with most Windows, Unix, and Linux operating systems.[2] Many dedicated FTP clients and automation utilities have since been developed for desktops, servers, mobile devices, and hardware, and FTP has been incorporated into productivity applications such as HTML editors and file managers.

An FTP client used to be commonly integrated in web browsers, where file servers are browsed with the URI prefix "ftp://". In 2021, FTP support was dropped by Google Chrome and Firefox,[3] [4] two major web browser vendors, due to it being superseded by the more secure SFTP and FTPS; although neither of them have implemented the newer protocols.[5] [6]

History of FTP servers

The original specification for the File Transfer Protocol was written by Abhay Bhushan and published as on 16 April 1971. Until 1980, FTP ran on NCP, the predecessor of TCP/IP. The protocol was later replaced by a TCP/IP version, (June 1980) and (October 1985), the current specification. Several proposed standards amend, for example (February 1994) enables Firewall-Friendly FTP (passive mode), (June 1997) proposes security extensions, (September 1998) adds support for IPv6 and defines a new type of passive mode.[7]

Protocol overview

Communication and data transfer

FTP may run in active or passive mode, which determines how the data connection is established.[8] (This sense of "mode" is different from that of the MODE command in the FTP protocol.)

Both modes were updated in September 1998 to support IPv6. Further changes were introduced to the passive mode at that time, updating it to extended passive mode.[11]

The server responds over the control connection with three-digit status codes in ASCII with an optional text message. For example, "200" (or "200 OK") means that the last command was successful. The numbers represent the code for the response and the optional text represents a human-readable explanation or request (e.g. <Need account for storing file>). An ongoing transfer of file data over the data connection can be aborted using an interrupt message sent over the control connection.

FTP needs two ports (one for sending and one for receiving) because it was originally designed to operate on top of Network Control Protocol (NCP), which was a simplex protocol that utilized two port addresses, establishing two connections, for two-way communications. An odd and an even port were reserved for each application layer application or protocol. The standardization of TCP and UDP reduced the need for the use of two simplex ports for each application down to one duplex port,[12] but the FTP protocol was never altered to only use one port, and continued using two for backwards compatibility.

NAT and firewall traversal

FTP normally transfers data by having the server connect back to the client, after the PORT command is sent by the client. This is problematic for both NATs and firewalls, which do not allow connections from the Internet towards internal hosts.[13] For NATs, an additional complication is that the representation of the IP addresses and port number in the PORT command refer to the internal host's IP address and port, rather than the public IP address and port of the NAT.

There are two approaches to solve this problem. One is that the FTP client and FTP server use the PASV command, which causes the data connection to be established from the FTP client to the server. This is widely used by modern FTP clients. Another approach is for the NAT to alter the values of the PORT command, using an application-level gateway for this purpose.

Data types

While transferring data over the network, five data types are defined:

Note these data types are commonly called "modes", although ambiguously that word is also used to refer to active-vs-passive communication mode (see above), and the modes set by the FTP protocol MODE command (see below).

For text files (TYPE A and TYPE E), three different format control options are provided, to control how the file would be printed:

These formats were mainly relevant to line printers; most contemporary FTP clients/servers only support the default format control of N.

File structures

File organization is specified using the STRU command. The following file structures are defined in section 3.1.1 of RFC959:

Most contemporary FTP clients and servers only support STRU F. STRU R is still in use in mainframe and minicomputer file transfer applications.

Data transfer modes

Data transfer can be done in any of three modes:

Most contemporary FTP clients and servers do not implement MODE B or MODE C; FTP clients and servers for mainframe and minicomputer operating systems are the exception to that.

Some FTP software also implements a DEFLATE-based compressed mode, sometimes called "Mode Z" after the command that enables it. This mode was described in an Internet Draft, but not standardized.[15]

GridFTP defines additional modes, MODE E[16] and MODE X,[17] as extensions of MODE B.

Additional commands

More recent implementations of FTP support the Modify Fact: Modification Time (MFMT) command, which allows a client to adjust that file attribute remotely, enabling the preservation of that attribute when uploading files.[18] [19]

To retrieve a remote file timestamp, there's MDTM command. Some servers (and clients) support nonstandard syntax of the MDTM command with two arguments, that works the same way as MFMT[20]

Login

FTP login uses normal username and password scheme for granting access. The username is sent to the server using the USER command, and the password is sent using the PASS command. This sequence is unencrypted "on the wire", so may be vulnerable to a network sniffing attack.[21] If the information provided by the client is accepted by the server, the server will send a greeting to the client and the session will commence. If the server supports it, users may log in without providing login credentials, but the same server may authorize only limited access for such sessions.

Anonymous FTP

A host that provides an FTP service may provide anonymous FTP access. Users typically log into the service with an 'anonymous' (lower-case and case-sensitive in some FTP servers) account when prompted for user name. Although users are commonly asked to send their email address instead of a password,[22] no verification is actually performed on the supplied data.[23] Many FTP hosts whose purpose is to provide software updates will allow anonymous logins.

Differences from HTTP

HTTP essentially fixes the bugs in FTP that made it inconvenient to use for many small ephemeral transfers as are typical in web pages.

FTP has a stateful control connection which maintains a current working directory and other flags, and each transfer requires a secondary connection through which the data are transferred. In "passive" mode this secondary connection is from client to server, whereas in the default "active" mode this connection is from server to client. This apparent role reversal when in active mode, and random port numbers for all transfers, is why firewalls and NAT gateways have such a hard time with FTP. HTTP is stateless and multiplexes control and data over a single connection from client to server on well-known port numbers, which trivially passes through NAT gateways and is simple for firewalls to manage.

Setting up an FTP control connection is quite slow due to the round-trip delays of sending all of the required commands and awaiting responses, so it is customary to bring up a control connection and hold it open for multiple file transfers rather than drop and re-establish the session afresh each time. In contrast, HTTP originally dropped the connection after each transfer because doing so was so cheap. While HTTP has subsequently gained the ability to reuse the TCP connection for multiple transfers, the conceptual model is still of independent requests rather than a session.

When FTP is transferring over the data connection, the control connection is idle. If the transfer takes too long, the firewall or NAT may decide that the control connection is dead and stop tracking it, effectively breaking the connection and confusing the download. The single HTTP connection is only idle between requests and it is normal and expected for such connections to be dropped after a time-out.

Software support

File managers

Many file managers tend to have FTP access implemented, such as File Explorer (formerly Windows Explorer) on Microsoft Windows. This client is only recommended for small file transfers from a server, due to limitations compared to dedicated client software.[24] It does not support SFTP.[25]

Both the native file managers for KDE on Linux (Dolphin and Konqueror) support FTP as well as SFTP.[26] [27] On Android, the My Files file manager on Samsung Galaxy has a built-in FTP and SFTP client.[28]

Web browser

For a long time, most common web browsers were able to retrieve files hosted on FTP servers, although not all of them had support for protocol extensions such as FTPS.[29] When an FTP—rather than an HTTP—URL is supplied, the accessible contents on the remote server are presented in a manner that is similar to that used for other web content.

Google Chrome removed FTP support entirely in Chrome 88, also affecting other Chromium-based browsers such as Microsoft Edge.[30] Firefox 88 disabled FTP support by default, with Firefox 90 dropping support entirely.[31]

FireFTP is a discontinued browser extension that was designed as a full-featured FTP client to be run within Firefox, but when Firefox dropped support for FTP the extension developer recommended using Waterfox.[32] Some browsers, such as the text-based Lynx, still support FTP.[33]

Syntax

FTP URL syntax is described in, taking the form: ftp://[user[:password]@]host[:port]/[url-path] (the bracketed parts are optional).

For example, the URL ftp://public.ftp-servers.example.com/mydirectory/myfile.txt represents the file myfile.txt from the directory mydirectory on the server public.ftp-servers.example.com as an FTP resource. The URL ftp://user001:secretpassword@private.ftp-servers.example.com/mydirectory/myfile.txt adds a specification of the username and password that must be used to access this resource.

More details on specifying a username and password may be found in the browsers' documentation (e.g., Firefox[34] and Internet Explorer[35]). By default, most web browsers use passive (PASV) mode, which more easily traverses end-user firewalls.

Some variation has existed in how different browsers treat path resolution in cases where there is a non-root home directory for a user.[36]

Download manager

Most common download managers can receive files hosted on FTP servers, while some of them also give the interface to retrieve the files hosted on FTP servers. DownloadStudio allows not only download a file from FTP server but also view the list of files on a FTP server.[37]

Other

LibreOffice declared its FTP support deprecated from 7.4 release, this was later removed in 24.2 release.[38] [39]

Security

FTP was not designed to be a secure protocol, and has many security weaknesses.[40] In May 1999, the authors of listed a vulnerability to the following problems:

FTP does not encrypt its traffic; all transmissions are in clear text, and usernames, passwords, commands and data can be read by anyone able to perform packet capture (sniffing) on the network. This problem is common to many of the Internet Protocol specifications (such as SMTP, Telnet, POP and IMAP) that were designed prior to the creation of encryption mechanisms such as TLS or SSL.

Common solutions to this problem include:

  1. Using the secure versions of the insecure protocols, e.g., FTPS instead of FTP and TelnetS instead of Telnet.
  2. Using a different, more secure protocol that can handle the job, e.g. SSH File Transfer Protocol or Secure Copy Protocol.
  3. Using a secure tunnel such as Secure Shell (SSH) or virtual private network (VPN).

FTP over SSH

FTP over SSH is the practice of tunneling a normal FTP session over a Secure Shell connection.[40] Because FTP uses multiple TCP connections (unusual for a TCP/IP protocol that is still in use), it is particularly difficult to tunnel over SSH. With many SSH clients, attempting to set up a tunnel for the control channel (the initial client-to-server connection on port 21) will protect only that channel; when data is transferred, the FTP software at either end sets up new TCP connections (data channels) and thus have no confidentiality or integrity protection.

Otherwise, it is necessary for the SSH client software to have specific knowledge of the FTP protocol, to monitor and rewrite FTP control channel messages and autonomously open new packet forwardings for FTP data channels. Software packages that support this mode include:

FTP over SSH should not be confused with SSH File Transfer Protocol (SFTP).

Derivatives

FTPS

See main article: article and FTPS. Explicit FTPS is an extension to the FTP standard that allows clients to request FTP sessions to be encrypted. This is done by sending the "AUTH TLS" command. The server has the option of allowing or denying connections that do not request TLS. This protocol extension is defined in . Implicit FTPS is an outdated standard for FTP that required the use of a SSL or TLS connection. It was specified to use different ports than plain FTP.

SSH File Transfer Protocol

See main article: article and SSH File Transfer Protocol. The SSH file transfer protocol (chronologically the second of the two protocols abbreviated SFTP) transfers files and has a similar command set for users, but uses the Secure Shell protocol (SSH) to transfer files. Unlike FTP, it encrypts both commands and data, preventing passwords and sensitive information from being transmitted openly over the network. It cannot interoperate with FTP software, though some FTP client software offers support for the SSH file transfer protocol as well.

Trivial File Transfer Protocol

See main article: article and Trivial File Transfer Protocol. Trivial File Transfer Protocol (TFTP) is a simple, lock-step FTP that allows a client to get a file from or put a file onto a remote host. One of its primary uses is in the early stages of booting from a local area network, because TFTP is very simple to implement. TFTP lacks security and most of the advanced features offered by more robust file transfer protocols such as File Transfer Protocol. TFTP was first standardized in 1981 and the current specification for the protocol can be found in .

Simple File Transfer Protocol

Simple File Transfer Protocol (the first protocol abbreviated SFTP), as defined by, was proposed as an (unsecured) file transfer protocol with a level of complexity intermediate between TFTP and FTP. It was never widely accepted on the Internet, and is now assigned Historic status by the IETF. It runs through port 115, and often receives the initialism of SFTP. It has a command set of 11 commands and support three types of data transmission: ASCII, binary and continuous. For systems with a word size that is a multiple of 8 bits, the implementation of binary and continuous is the same. The protocol also supports login with user ID and password, hierarchical folders and file management (including rename, delete, upload, download, download with overwrite, and download with append).

FTP commands

See main article: article and List of FTP commands.

FTP reply codes

See main article: article and List of FTP server return codes. Below is a summary of FTP reply codes that may be returned by an FTP server. These codes have been standardized in by the IETF. The reply code is a three-digit value. The first digit is used to indicate one of three possible outcomes — success, failure, or to indicate an error or incomplete reply:

The second digit defines the kind of error:

The third digit of the reply code is used to provide additional detail for each of the categories defined by the second digit.

Further reading

External links

Notes and References

  1. Book: Forouzan, B.A. . 2000 . TCP/IP: Protocol Suite . 1st . New Delhi, India . Tata McGraw-Hill Publishing Company Limited.
  2. Web site: Kozierok . Charles M. . 2005 . The TCP/IP Guide v3.0 . Tcpipguide.com.
  3. Web site: Vonau. Manuel. 2021-07-07. Firefox follows in Chrome's footsteps and drops FTP support (APK Download). 2021-07-12. Android Police. en-US.
  4. Web site: Remove FTP support - Chrome Platform Status. 2021-09-02. www.chromestatus.com.
  5. Web site: by . Written . 2020-03-23 . Firefox is dropping FTP support . 2023-10-13 . Sophos News . en-US.
  6. Web site: Edwards . Benj . 2022-07-14 . Chrome and Firefox Killed FTP Support: Here's an Easy Alternative . 2023-10-13 . How-To Geek . en.
  7. Book: Clark, M.P. . 2003 . Data Networks IP and the Internet . 1st . West Sussex, England . John Wiley & Sons Ltd..
  8. Web site: Active FTP vs. Passive FTP, a Definitive Explanation . Slacksite.com.
  9. Web site: Weis . Olga . 2022-10-18 . FTP Port: Full Guide about FTP and Port Numbers . 2024-03-29 . Comprehensive Mac software apps . en-US.
  10. (Standard) File Transfer Protocol (FTP). Postel, J. & Reynolds, J. (October 1985).
  11. (Proposed Standard) Extensions for IPv6, NAT, and Extended Passive Mode. Allman, M. & Metz, C. & Ostermann, S. (September 1998).
  12. Book: Stevens, W. Richard . TCP/IP Illustrated Volume I . Reading, Massachusetts, USA . Addison-Wesley Publishing Company . 1994 . 0-201-63346-9 . 1 .
  13. Web site: Gleason . Mike . 2005 . The File Transfer Protocol and Your Firewall/NAT . Ncftp.com.
  14. Klensin. John. FTP TYPE Extension for Internationalized Text. draft-klensin-ftpext-typeu-00. 2020-06-09.
  15. Deflate transmission mode for FTP . draft-preston-ftpext-deflate-03 . J. . Preston . January 2005 . . 27 January 2016.
  16. Web site: Allcock. W.. April 2003. GridFTP: Protocol Extensions to FTP for the Grid.
  17. Web site: Mandrichenko. I.. May 4, 2005. GridFTP v2 Protocol Description.
  18. Web site: MFMT FTP command . support.solarwinds.com . 2018-10-11.
  19. Web site: FTP Commands: DSIZ, MFCT, MFMT, AVBL, PASS, XPWD, XMKD Serv-U . www.serv-u.com . en.
  20. Web site: MDTM FTP command . support.solarwinds.com . 2018-10-11.
  21. Web site: Prince. Brian. Should Organizations Retire FTP for Security?. Security Week. 24 January 2012 . 14 September 2017.
  22. Book: Dean, Tamara . Network+ Guide to Networks . Delmar . 2010 . 168–171.
  23. (Informational) How to Use Anonymous FTP. P. & Emtage, A. & Marine, A. (May 1994).
  24. https://helpdesk.egnyte.com/hc/en-us/articles/201637914-FTP-Access-through-Windows-Explorer FTP Access through Windows Explorer
  25. Web site: CSC373/406: SSH [2011/03/27-29] ]. 2023-10-13 . fpl.cs.depaul.edu.
  26. Web site: FTP . 2023-10-13 . docs.kde.org.
  27. Web site: Cohen . Brent . 2023-07-26 . How To Connect to FTP/SFTP in Dolphin DeviceTests . 2023-10-13 . en-US.
  28. Web site: Staff . Moyens . 2022-02-28 . Samsung My Files vs Google Files: Which File Manager is Better on Galaxy Phones . 2023-10-13 . Moyens I/O . en-GB.
  29. Book: Matthews, J. . 2005 . Computer Networking: Internet Protocols in Action . 1st . Danvers, MA . John Wiley & Sons Inc..
  30. Web site: Linux Release Roundup: GParted, Lightworks, Google Chrome + More. 2021-01-26. 2021-01-30. omgubuntu.co.uk. Joey. Sneddon.
  31. Web site: 2021-04-19. See what's new in Firefox: 88.0 Firefox Release. 2021-04-20. mozilla.org.
  32. Web site: FireFTP - The Free FTP Client for Waterfox . dead . https://web.archive.org/web/20220301212656/https://fireftp.net/ . 2022-03-01 . FireFTP.net.
  33. Web site: URL Schemes Supported in Lynx . 2023-07-06 . Lynx website.
  34. Web site: Accessing FTP servers | How to | Firefox Help . Support.mozilla.com . 2012-09-05 . 2013-01-16.
  35. Web site: How to Enter FTP Site Password in Internet Explorer . 13 February 2020 . 2 July 2015 . https://web.archive.org/web/20150702005840/https://support.microsoft.com/en-us/kb/135975 . bot: unknown . Written for IE versions 6 and earlier. Might work with newer versions.
  36. Web site: FTP URLs . Jukka “Yucca” Korpela . "IT and communication" (jkorpela.fi) . 1997-09-18 . 2020-01-26.
  37. Web site: DownloadStudio - Internet Download Manager And Download Accelerator - Features . Conceiva . 2021-10-19.
  38. Web site: LibreOffice 7.4: Release Notes . The Document Foundation's Wiki . 2022-09-10 .
  39. Web site: ReleaseNotes/24.2 . The Document Foundation's Wiki . 2024-03-24 .
  40. Web site: Securing FTP using SSH . Nurdletech.com.
  41. Web site: Components of the Information Assurance Platform (section Tectia ConnectSecure). ssh.com. https://web.archive.org/web/20200731160323/https://www.ssh.com/manuals/mft-events-product/63/ssh-solutions-your-business-components.html. 2020-07-31.