2 .\" Title: gitprotocol-http
3 .\" Author: [FIXME: author] [see http://www.docbook.org/tdg5/en/html/author]
4 .\" Generator: DocBook XSL Stylesheets v1.79.2 <http://docbook.sf.net/>
7 .\" Source: Git 2.47.0.305.g4083a6f052
10 .TH "GITPROTOCOL\-HTTP" "5" "2024-11-20" "Git 2\&.47\&.0\&.305\&.g4083a6" "Git Manual"
11 .\" -----------------------------------------------------------------
12 .\" * Define some portability stuff
13 .\" -----------------------------------------------------------------
14 .\" ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
15 .\" http://bugs.debian.org/507673
16 .\" http://lists.gnu.org/archive/html/groff/2009-02/msg00013.html
17 .\" ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
20 .\" -----------------------------------------------------------------
21 .\" * set default formatting
22 .\" -----------------------------------------------------------------
23 .\" disable hyphenation
25 .\" disable justification (adjust text to left margin only)
27 .\" -----------------------------------------------------------------
28 .\" * MAIN CONTENT STARTS HERE *
29 .\" -----------------------------------------------------------------
31 gitprotocol-http \- Git HTTP\-based protocols
35 <over\-the\-wire\-protocol>
39 Git supports two HTTP based transfer protocols\&. A "dumb" protocol which requires only a standard HTTP server on the server end of the connection, and a "smart" protocol which requires a Git aware CGI (or server module)\&. This document describes both protocols\&.
41 As a design feature smart clients can automatically upgrade "dumb" protocol URLs to smart URLs\&. This permits all users to have the same published URL, and the peers automatically select the most efficient transport available to them\&.
44 URLs for Git repositories accessed by HTTP use the standard HTTP URL syntax documented by RFC 1738, so they are of the form:
50 http://<host>:<port>/<path>?<searchpart>
56 Within this documentation the placeholder \fB$GIT_URL\fR will stand for the http:// repository URL entered by the end\-user\&.
58 Servers SHOULD handle all requests to locations matching \fB$GIT_URL\fR, as both the "smart" and "dumb" HTTP protocols used by Git operate by appending additional path components onto the end of the user supplied \fB$GIT_URL\fR string\&.
60 An example of a dumb client requesting a loose object:
66 $GIT_URL: http://example\&.com:8080/git/repo\&.git
67 URL request: http://example\&.com:8080/git/repo\&.git/objects/d0/49f6c27a2244e12041955e262a404c7faba355
73 An example of a smart request to a catch\-all gateway:
79 $GIT_URL: http://example\&.com/daemon\&.cgi?svc=git&q=
80 URL request: http://example\&.com/daemon\&.cgi?svc=git&q=/info/refs&service=git\-receive\-pack
86 An example of a request to a submodule:
92 $GIT_URL: http://example\&.com/git/repo\&.git/path/submodule\&.git
93 URL request: http://example\&.com/git/repo\&.git/path/submodule\&.git/info/refs
99 Clients MUST strip a trailing \fB/\fR, if present, from the user supplied \fB$GIT_URL\fR string to prevent empty path tokens (\fB//\fR) from appearing in any URL sent to a server\&. Compatible clients MUST expand \fB$GIT_URL/info/refs\fR as \fBfoo/info/refs\fR and not \fBfoo//info/refs\fR\&.
102 Standard HTTP authentication is used if authentication is required to access a repository, and MAY be configured and enforced by the HTTP server software\&.
104 Because Git repositories are accessed by standard path components server administrators MAY use directory based permissions within their HTTP server to control repository access\&.
106 Clients SHOULD support Basic authentication as described by RFC 2617\&. Servers SHOULD support Basic authentication by relying upon the HTTP server placed in front of the Git server software\&.
108 Servers SHOULD NOT require HTTP cookies for the purposes of authentication or access control\&.
110 Clients and servers MAY support other common forms of HTTP based authentication, such as Digest authentication\&.
113 Clients and servers SHOULD support SSL, particularly to protect passwords when relying on Basic HTTP authentication\&.
116 The Git over HTTP protocol (much like HTTP itself) is stateless from the perspective of the HTTP server side\&. All state MUST be retained and managed by the client process\&. This permits simple round\-robin load\-balancing on the server side, without needing to worry about state management\&.
118 Clients MUST NOT require state management on the server side in order to function correctly\&.
120 Servers MUST NOT require HTTP cookies in order to function correctly\&. Clients MAY store and forward HTTP cookies during request processing as described by RFC 2616 (HTTP/1\&.1)\&. Servers SHOULD ignore any cookies sent by a client\&.
121 .SH "GENERAL REQUEST PROCESSING"
123 Except where noted, all standard HTTP behavior SHOULD be assumed by both client and server\&. This includes (but is not necessarily limited to):
125 If there is no repository at \fB$GIT_URL\fR, or the resource pointed to by a location matching \fB$GIT_URL\fR does not exist, the server MUST NOT respond with \fB200\fR \fBOK\fR response\&. A server SHOULD respond with \fB404\fR \fBNot\fR \fBFound\fR, \fB410\fR \fBGone\fR, or any other suitable HTTP status code which does not imply the resource exists as requested\&.
127 If there is a repository at \fB$GIT_URL\fR, but access is not currently permitted, the server MUST respond with the \fB403\fR \fBForbidden\fR HTTP status code\&.
129 Servers SHOULD support both HTTP 1\&.0 and HTTP 1\&.1\&. Servers SHOULD support chunked encoding for both request and response bodies\&.
131 Clients SHOULD support both HTTP 1\&.0 and HTTP 1\&.1\&. Clients SHOULD support chunked encoding for both request and response bodies\&.
133 Servers MAY return ETag and/or Last\-Modified headers\&.
135 Clients MAY revalidate cached entities by including If\-Modified\-Since and/or If\-None\-Match request headers\&.
137 Servers MAY return \fB304\fR \fBNot\fR \fBModified\fR if the relevant headers appear in the request and the entity has not changed\&. Clients MUST treat \fB304\fR \fBNot\fR \fBModified\fR identical to \fB200\fR \fBOK\fR by reusing the cached entity\&.
139 Clients MAY reuse a cached entity without revalidation if the Cache\-Control and/or Expires header permits caching\&. Clients and servers MUST follow RFC 2616 for cache controls\&.
140 .SH "DISCOVERING REFERENCES"
142 All HTTP clients MUST begin either a fetch or a push exchange by discovering the references available on the remote repository\&.
145 HTTP clients that only support the "dumb" protocol MUST discover references by making a request for the special info/refs file of the repository\&.
147 Dumb HTTP clients MUST make a \fBGET\fR request to \fB$GIT_URL/info/refs\fR, without any search/query parameters\&.
153 C: GET $GIT_URL/info/refs HTTP/1\&.0
165 S: 95dcfa3633004da0049d3d0fa03f80589cbcaf31 refs/heads/maint
166 S: d049f6c27a2244e12041955e262a404c7faba355 refs/heads/master
167 S: 2cb58b79488a98d2721cea644875a8dd0026b115 refs/tags/v1\&.0
168 S: a3c2e2402b99163d1d59756e5f207ae21cccba4c refs/tags/v1\&.0^{}
174 The Content\-Type of the returned info/refs entity SHOULD be \fBtext/plain\fR; \fBcharset=utf\-8\fR, but MAY be any content type\&. Clients MUST NOT attempt to validate the returned Content\-Type\&. Dumb servers MUST NOT return a return type starting with \fBapplication/x\-git\-\fR\&.
176 Cache\-Control headers MAY be returned to disable caching of the returned entity\&.
178 When examining the response clients SHOULD only examine the HTTP status code\&. Valid responses are \fB200\fR \fBOK\fR, or \fB304\fR \fBNot\fR \fBModified\fR\&.
180 The returned content is a UNIX formatted text file describing each ref and its known value\&. The file SHOULD be sorted by name according to the C locale ordering\&. The file SHOULD NOT include the default ref named \fBHEAD\fR\&.
186 info_refs = *( ref_record )
187 ref_record = any_ref / peeled_ref
197 any_ref = obj\-id HTAB refname LF
198 peeled_ref = obj\-id HTAB refname LF
199 obj\-id HTAB refname "^{}" LF
206 HTTP clients that support the "smart" protocol (or both the "smart" and "dumb" protocols) MUST discover references by making a parameterized request for the info/refs file of the repository\&.
208 The request MUST contain exactly one query parameter, \fBservice=$servicename\fR, where \fB$servicename\fR MUST be the service name the client wishes to contact to complete the operation\&. The request MUST NOT contain additional query parameters\&.
214 C: GET $GIT_URL/info/refs?service=git\-upload\-pack HTTP/1\&.0
228 S: 95dcfa3633004da0049d3d0fa03f80589cbcaf31 refs/heads/maint
229 S: d049f6c27a2244e12041955e262a404c7faba355 refs/heads/master
230 S: 2cb58b79488a98d2721cea644875a8dd0026b115 refs/tags/v1\&.0
231 S: a3c2e2402b99163d1d59756e5f207ae21cccba4c refs/tags/v1\&.0^{}
244 S: Content\-Type: application/x\-git\-upload\-pack\-advertisement
245 S: Cache\-Control: no\-cache
247 S: 001e# service=git\-upload\-pack\en
249 S: 004895dcfa3633004da0049d3d0fa03f80589cbcaf31 refs/heads/maint\e0multi_ack\en
250 S: 003fd049f6c27a2244e12041955e262a404c7faba355 refs/heads/master\en
251 S: 003c2cb58b79488a98d2721cea644875a8dd0026b115 refs/tags/v1\&.0\en
252 S: 003fa3c2e2402b99163d1d59756e5f207ae21cccba4c refs/tags/v1\&.0^{}\en
259 The client may send Extra Parameters (see \fBgitprotocol-pack\fR(5)) as a colon\-separated string in the Git\-Protocol HTTP header\&.
261 Uses the \fB\-\-http\-backend\-info\-refs\fR option to \fBgit-upload-pack\fR(1)\&.
264 .nr an-no-space-flag 1
268 \fBDumb Server Response\fR
271 Dumb servers MUST respond with the dumb server reply format\&.
273 See the prior section under dumb clients for a more detailed description of the dumb server response\&.
277 .nr an-no-space-flag 1
281 \fBSmart Server Response\fR
284 If the server does not recognize the requested service name, or the requested service name has been disabled by the server administrator, the server MUST respond with the \fB403\fR \fBForbidden\fR HTTP status code\&.
286 Otherwise, smart servers MUST respond with the smart server reply format for the requested service name\&.
288 Cache\-Control headers SHOULD be used to disable caching of the returned entity\&.
290 The Content\-Type MUST be \fBapplication/x\-$servicename\-advertisement\fR\&. Clients SHOULD fall back to the dumb protocol if another content type is returned\&. When falling back to the dumb protocol clients SHOULD NOT make an additional request to \fB$GIT_URL/info/refs\fR, but instead SHOULD use the response already in hand\&. Clients MUST NOT continue if they do not support the dumb protocol\&.
292 Clients MUST validate the status code is either \fB200\fR \fBOK\fR or \fB304\fR \fBNot\fR \fBModified\fR\&.
294 Clients MUST validate the first five bytes of the response entity matches the regex \fB^\fR[\fB0\-9a\-f\fR]{4}#\&. If this test fails, clients MUST NOT continue\&.
296 Clients MUST parse the entire response as a sequence of pkt\-line records\&.
298 Clients MUST verify the first pkt\-line is # \fBservice=$servicename\fR\&. Servers MUST set $servicename to be the request parameter value\&. Servers SHOULD include an LF at the end of this line\&. Clients MUST ignore an LF at the end of the line\&.
300 Servers MUST terminate the response with the magic \fB0000\fR end pkt\-line marker\&.
302 The returned response is a pkt\-line stream describing each ref and its known value\&. The stream SHOULD be sorted by name according to the C locale ordering\&. The stream SHOULD include the default ref named \fBHEAD\fR as the first ref\&. The stream MUST include capability declarations behind a NUL on the first ref\&.
304 The returned response contains "version 1" if "version=1" was sent as an Extra Parameter\&.
310 smart_reply = PKT\-LINE("# service=$servicename" LF)
315 ref_list = empty_list / non_empty_list
325 empty_list = PKT\-LINE(zero\-id SP "capabilities^{}" NUL cap\-list LF)
335 non_empty_list = PKT\-LINE(obj\-id SP name NUL cap_list LF)
346 cap\-list = capability *(SP capability)
347 capability = 1*(LC_ALPHA / DIGIT / "\-" / "_")
358 ref_record = any_ref / peeled_ref
359 any_ref = PKT\-LINE(obj\-id SP name LF)
360 peeled_ref = PKT\-LINE(obj\-id SP name LF)
361 PKT\-LINE(obj\-id SP name "^{}" LF
367 .SH "SMART SERVICE GIT\-UPLOAD\-PACK"
369 This service reads from the repository pointed to by \fB$GIT_URL\fR\&.
371 Clients MUST first perform ref discovery with \fB$GIT_URL/info/refs\fR?service=git\-upload\-pack\&.
377 C: POST $GIT_URL/git\-upload\-pack HTTP/1\&.0
378 C: Content\-Type: application/x\-git\-upload\-pack\-request
380 C: 0032want 0a53e9ddeaddad63ad106860237bbf53411d11a7\en
381 C: 0032have 441b40d833fdfa93eb2908e52742248faf0ee993\en
393 S: Content\-Type: application/x\-git\-upload\-pack\-result
394 S: Cache\-Control: no\-cache
396 S: \&.\&.\&.\&.ACK %s, continue
403 Clients MUST NOT reuse or revalidate a cached response\&. Servers MUST include sufficient Cache\-Control headers to prevent caching of the response\&.
405 Servers SHOULD support all capabilities defined here\&.
407 Clients MUST send at least one "want" command in the request body\&. Clients MUST NOT reference an id in a "want" command which did not appear in the response obtained through ref discovery unless the server advertises capability \fBallow\-tip\-sha1\-in\-want\fR or \fBallow\-reachable\-sha1\-in\-want\fR\&.
413 compute_request = want_list
416 request_end = "0000" / "done"
426 want_list = PKT\-LINE(want SP cap_list LF)
428 want_pkt = PKT\-LINE(want LF)
430 cap_list = capability *(SP capability)
440 have_list = *PKT\-LINE("have" SP id LF)
446 TODO: Document this further\&.
447 .SS "The Negotiation Algorithm"
449 The computation to select the minimal pack proceeds as follows (C = client, S = server):
453 C: Use ref discovery to obtain the advertised refs\&.
455 C: Place any object seen into set \fBadvertised\fR\&.
457 C: Build an empty set, \fBcommon\fR, to hold the objects that are later determined to be on both ends\&.
459 C: Build a set, \fBwant\fR, of the objects from \fBadvertised\fR that the client wants to fetch, based on what it saw during ref discovery\&.
461 C: Start a queue, \fBc_pending\fR, ordered by commit time (popping newest first)\&. Add all client refs\&. When a commit is popped from the queue its parents SHOULD be automatically inserted back\&. Commits MUST only enter the queue once\&.
463 \fIone compute step:\fR
465 C: Send one \fB$GIT_URL/git\-upload\-pack\fR request:
471 C: 0032want <want\-#1>\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.
472 C: 0032want <want\-#2>\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.
474 C: 0032have <common\-#1>\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.
475 C: 0032have <common\-#2>\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.
477 C: 0032have <have\-#1>\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.
478 C: 0032have <have\-#2>\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.\&.
486 The stream is organized into "commands", with each command appearing by itself in a pkt\-line\&. Within a command line, the text leading up to the first space is the command name, and the remainder of the line to the first LF is the value\&. Command lines are terminated with an LF as the last byte of the pkt\-line value\&.
488 Commands MUST appear in the following order, if they appear at all in the request stream:
512 The stream is terminated by a pkt\-line flush (\fB0000\fR)\&.
514 A single "want" or "have" command MUST have one hex formatted object name as its value\&. Multiple object names MUST be sent by sending multiple commands\&. Object names MUST be given using the object format negotiated through the \fBobject\-format\fR capability (default SHA\-1)\&.
516 The \fBhave\fR list is created by popping the first 32 commits from \fBc_pending\fR\&. Fewer can be supplied if \fBc_pending\fR empties\&.
518 If the client has sent 256 "have" commits and has not yet received one of those back from \fBs_common\fR, or the client has emptied \fBc_pending\fR it SHOULD include a "done" command to let the server know it won\(cqt proceed:
530 S: Parse the git\-upload\-pack request:
532 Verify all objects in \fBwant\fR are directly reachable from refs\&.
534 The server MAY walk backwards through history or through the reflog to permit slightly stale requests\&.
536 If no "want" objects are received, send an error: TODO: Define error if no "want" lines are requested\&.
538 If any "want" object is not reachable, send an error: TODO: Define error if an invalid "want" is requested\&.
540 Create an empty list, \fBs_common\fR\&.
544 Loop through the objects in the order supplied by the client\&.
546 For each object, if the server has the object reachable from a ref, add it to \fBs_common\fR\&. If a commit is added to \fBs_common\fR, do not add any ancestors, even if they also appear in \fBhave\fR\&.
548 S: Send the git\-upload\-pack response:
550 If the server has found a closed set of objects to pack or the request ends with "done", it replies with the pack\&. TODO: Document the pack based response
562 The returned stream is the side\-band\-64k protocol supported by the git\-upload\-pack service, and the pack is embedded into stream 1\&. Progress messages from the server side MAY appear in stream 2\&.
564 Here a "closed set of objects" is defined to have at least one path from every "want" to at least one "common" object\&.
566 If the server needs more information, it replies with a status continue response: TODO: Document the non\-pack response
568 C: Parse the upload\-pack response: TODO: Document parsing response
570 \fIDo another compute step\&.\fR
571 .SH "SMART SERVICE GIT\-RECEIVE\-PACK"
573 This service reads from the repository pointed to by \fB$GIT_URL\fR\&.
575 Clients MUST first perform ref discovery with \fB$GIT_URL/info/refs\fR?service=git\-receive\-pack\&.
581 C: POST $GIT_URL/git\-receive\-pack HTTP/1\&.0
582 C: Content\-Type: application/x\-git\-receive\-pack\-request
584 C: \&.\&.\&.\&.0a53e9ddeaddad63ad106860237bbf53411d11a7 441b40d833fdfa93eb2908e52742248faf0ee993 refs/heads/maint\e0 report\-status
597 S: Content\-Type: application/x\-git\-receive\-pack\-result
598 S: Cache\-Control: no\-cache
606 Clients MUST NOT reuse or revalidate a cached response\&. Servers MUST include sufficient Cache\-Control headers to prevent caching of the response\&.
608 Servers SHOULD support all capabilities defined here\&.
610 Clients MUST send at least one command in the request body\&. Within the command portion of the request body clients SHOULD send the id obtained through ref discovery as old_id\&.
616 update_request = command_list
617 "PACK" <binary\-data>
627 command_list = PKT\-LINE(command NUL cap_list LF)
629 command_pkt = PKT\-LINE(command LF)
630 cap_list = *(SP capability) SP
640 command = create / delete / update
641 create = zero\-id SP new_id SP name
642 delete = old_id SP zero\-id SP name
643 update = old_id SP new_id SP name
649 TODO: Document this further\&.
652 \m[blue]\fBRFC 1738: Uniform Resource Locators (URL)\fR\m[]\&\s-2\u[1]\d\s+2 \m[blue]\fBRFC 2616: Hypertext Transfer Protocol \(em HTTP/1\&.1\fR\m[]\&\s-2\u[2]\d\s+2
655 \fBgitprotocol-pack\fR(5) \fBgitprotocol-capabilities\fR(5)
658 Part of the \fBgit\fR(1) suite
661 RFC 1738: Uniform Resource Locators (URL)
663 \%https://www.ietf.org/rfc/rfc1738.txt
666 RFC 2616: Hypertext Transfer Protocol \(em HTTP/1.1
668 \%https://www.ietf.org/rfc/rfc2616.txt