rclone/rclone

Rclone does not validate the Content-Range when using Range requests for webdav backend and others

Open

#6,980 opened on Apr 26, 2023

View on GitHub
 (4 comments) (0 reactions) (0 assignees)Go (5,090 forks)batch import
bughelp wanted

Repository metrics

Stars
 (57,185 stars)
PR merge metrics
 (Avg merge 32d 20h) (23 merged PRs in 30d)

Description

The associated forum post URL from https://forum.rclone.org

https://forum.rclone.org/t/webdav-server-behind-cloudflare-fails-to-download-correctly

What is the problem you are having with rclone?

Rclone does not check the range request response for valid Content-Range, causing invalid download if the origin server is misconfigured or sometimes ignore Content-Range on first chunk response case in point non-cached file using cloudflare as proxy. Mostly relates to using multi-thread-streams flag.

What is your rclone version (output from rclone version)

rclone v1.61.1

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 5.19.0-41-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.19.4
  • go/linking: static
  • go/tags: none

Which OS you are using and how many bits (e.g. Windows 7, 64 bit)

Ubuntu 22.04, 64bit

Which cloud storage system are you using? (e.g. Google Drive)

Webdav

The command you were trying to run (e.g. rclone copy /tmp remote:tmp)

rclone copy wd:/files/test/ . -stats-file-name-length 0 --multi-thread-streams 16 --progress --checksum -vvv

A log from the command with the -vv flag (e.g. output from rclone -vv copy /tmp remote:tmp)

2023/04/21 23:03:05 DEBUG : Setting --bind "10.0.1.3" from environment variable RCLONE_BIND="10.0.1.3"
2023/04/21 23:03:05 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "copy" "--stats-file-name-length" "0" "wd:/downloads/test.mp4" "." "--multi-thread-streams" "16" "--progress" "--checksum" "-vvv" "--dump" "headers"]
2023/04/21 23:03:05 DEBUG : Creating backend with remote "wd:/downloads/test.mp4"
2023/04/21 23:03:05 DEBUG : Using config file from "/home/user/.config/rclone/rclone.conf"
2023/04/21 23:03:05 DEBUG : found headers:
2023/04/21 23:03:05 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2023/04/21 23:03:05 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/04/21 23:03:05 DEBUG : HTTP REQUEST (req 0xc000b06500)
2023/04/21 23:03:05 DEBUG : PROPFIND /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 1
Referer: https://webdav.my-domain.com/
Accept-Encoding: gzip

2023/04/21 23:03:05 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023/04/21 23:03:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/04/21 23:03:06 DEBUG : HTTP RESPONSE (req 0xc000b06500)
2023/04/21 23:03:06 DEBUG : HTTP/2.0 207 Multi-Status
Content-Length: 662
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: DYNAMIC
Cf-Ray: random_cf_id
Content-Type: text/xml; charset=utf-8
Date: Fri, 21 Apr 2023 20:03:06 GMT
Server: cloudflare

2023/04/21 23:03:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023/04/21 23:03:06 DEBUG : fs cache: adding new entry for parent of "wd:/downloads/test.mp4", "wd:downloads"
2023/04/21 23:03:06 DEBUG : Creating backend with remote "."
2023/04/21 23:03:06 DEBUG : fs cache: renaming cache item "." to be canonical "/downloads"
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : HTTP REQUEST (req 0xc000b06800)
2023-04-21 23:03:06 DEBUG : PROPFIND /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 1
Referer: https://webdav.my-domain.com/
Accept-Encoding: gzip
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:06 DEBUG : HTTP RESPONSE (req 0xc000b06800)
2023-04-21 23:03:06 DEBUG : HTTP/2.0 207 Multi-Status
Content-Length: 662
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: DYNAMIC
Cf-Ray: random_cf_id
Content-Type: text/xml; charset=utf-8
Date: Fri, 21 Apr 2023 20:03:06 GMT
Server: cloudflare
2023-04-21 23:03:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:06 DEBUG : test.mp4: Need to transfer - File not found at Destination
2023-04-21 23:03:06 DEBUG : test.mp4: Starting multi-thread copy with 5 parts of size 267.875Mi
2023-04-21 23:03:06 DEBUG : test.mp4: multi-thread copy: stream 5/5 (1123549184-1404163477) size 267.615Mi starting
2023-04-21 23:03:06 DEBUG : test.mp4: multi-thread copy: stream 1/5 (0-280887296) size 267.875Mi starting
2023-04-21 23:03:06 DEBUG : test.mp4: multi-thread copy: stream 3/5 (561774592-842661888) size 267.875Mi starting
2023-04-21 23:03:06 DEBUG : test.mp4: multi-thread copy: stream 2/5 (280887296-561774592) size 267.875Mi starting
2023-04-21 23:03:06 DEBUG : test.mp4: multi-thread copy: stream 4/5 (842661888-1123549184) size 267.875Mi starting
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : HTTP REQUEST (req 0xc000b06300)
2023-04-21 23:03:06 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=1123549184-1404163476
Referer: https://webdav.my-domain.com/
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : HTTP REQUEST (req 0xc000498200)
2023-04-21 23:03:06 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=0-280887295
Referer: https://webdav.my-domain.com/
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : HTTP REQUEST (req 0xc000498b00)
2023-04-21 23:03:06 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=561774592-842661887
Referer: https://webdav.my-domain.com/
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : HTTP REQUEST (req 0xc000270700)
2023-04-21 23:03:06 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=280887296-561774591
Referer: https://webdav.my-domain.com/
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:06 DEBUG : HTTP REQUEST (req 0xc000271000)
2023-04-21 23:03:06 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=842661888-1123549183
Referer: https://webdav.my-domain.com/
2023-04-21 23:03:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:03:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:07 DEBUG : HTTP RESPONSE (req 0xc000b06300)
2023-04-21 23:03:07 DEBUG : HTTP/2.0 200 OK
Content-Length: 1404163477
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:03:07 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:03:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:07 DEBUG : HTTP RESPONSE (req 0xc000498200)
2023-04-21 23:03:07 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 0-280887295/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:03:07 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:03:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:07 DEBUG : HTTP RESPONSE (req 0xc000498b00)
2023-04-21 23:03:07 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 561774592-842661887/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:03:07 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:03:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:08 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:08 DEBUG : HTTP RESPONSE (req 0xc000271000)
2023-04-21 23:03:08 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 842661888-1123549183/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:03:08 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:03:08 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:08 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:08 DEBUG : HTTP RESPONSE (req 0xc000270700)
2023-04-21 23:03:08 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 280887296-561774591/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:03:08 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:03:08 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:03:44 DEBUG : test.mp4: multi-thread copy: stream 3/5 (561774592-842661888) size 267.875Mi finished
2023-04-21 23:03:46 DEBUG : test.mp4: multi-thread copy: stream 1/5 (0-280887296) size 267.875Mi finished
2023-04-21 23:03:46 DEBUG : test.mp4: multi-thread copy: stream 4/5 (842661888-1123549184) size 267.875Mi finished
2023-04-21 23:03:47 DEBUG : test.mp4: multi-thread copy: stream 2/5 (280887296-561774592) size 267.875Mi finished
2023-04-21 23:04:28 DEBUG : test.mp4: multi-thread copy: stream 5/5 failed: multipart copy: wrote 1404163477 bytes but expected to write 280614293
2023-04-21 23:04:28 ERROR : test.mp4: Failed to copy: multipart copy: wrote 1404163477 bytes but expected to write 280614293
2023-04-21 23:04:28 ERROR : Attempt 1/3 failed with 1 errors and: multipart copy: wrote 1404163477 bytes but expected to write 280614293
2023-04-21 23:04:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:28 DEBUG : HTTP REQUEST (req 0xc000a14a00)
2023-04-21 23:04:28 DEBUG : PROPFIND /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 1
Referer: https://webdav.my-domain.com/
Accept-Encoding: gzip
2023-04-21 23:04:28 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:28 DEBUG : HTTP RESPONSE (req 0xc000a14a00)
2023-04-21 23:04:28 DEBUG : HTTP/2.0 207 Multi-Status
Content-Length: 662
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: DYNAMIC
Cf-Ray: random_cf_id
Content-Type: text/xml; charset=utf-8
Date: Fri, 21 Apr 2023 20:04:28 GMT
Server: cloudflare
2023-04-21 23:04:28 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:28 DEBUG : test.mp4: Sizes differ (src 1404163477 vs dst 2527712661)
2023-04-21 23:04:29 DEBUG : test.mp4: Starting multi-thread copy with 5 parts of size 267.875Mi
2023-04-21 23:04:29 DEBUG : test.mp4: multi-thread copy: stream 5/5 (1123549184-1404163477) size 267.615Mi starting
2023-04-21 23:04:29 DEBUG : test.mp4: multi-thread copy: stream 3/5 (561774592-842661888) size 267.875Mi starting
2023-04-21 23:04:29 DEBUG : test.mp4: multi-thread copy: stream 1/5 (0-280887296) size 267.875Mi starting
2023-04-21 23:04:29 DEBUG : test.mp4: multi-thread copy: stream 2/5 (280887296-561774592) size 267.875Mi starting
2023-04-21 23:04:29 DEBUG : test.mp4: multi-thread copy: stream 4/5 (842661888-1123549184) size 267.875Mi starting
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : HTTP REQUEST (req 0xc0004baa00)
2023-04-21 23:04:29 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=1123549184-1404163476
Referer: https://webdav.my-domain.com/
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : HTTP REQUEST (req 0xc000271000)
2023-04-21 23:04:29 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=561774592-842661887
Referer: https://webdav.my-domain.com/
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : HTTP REQUEST (req 0xc00058e100)
2023-04-21 23:04:29 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=0-280887295
Referer: https://webdav.my-domain.com/
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : HTTP REQUEST (req 0xc00058e300)
2023-04-21 23:04:29 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=280887296-561774591
Referer: https://webdav.my-domain.com/
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : HTTP REQUEST (req 0xc00058e500)
2023-04-21 23:04:29 DEBUG : GET /downloads/test.mp4 HTTP/1.1
Host: webdav.my-domain.com
User-Agent: rclone/v1.61.1
Authorization: XXXX
Depth: 0
Range: bytes=842661888-1123549183
Referer: https://webdav.my-domain.com/
2023-04-21 23:04:29 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : HTTP RESPONSE (req 0xc0004baa00)
2023-04-21 23:04:29 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280614293
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 1123549184-1404163476/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:04:29 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : HTTP RESPONSE (req 0xc000271000)
2023-04-21 23:04:29 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 561774592-842661887/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:04:29 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : HTTP RESPONSE (req 0xc00058e500)
2023-04-21 23:04:29 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 842661888-1123549183/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:04:29 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : HTTP RESPONSE (req 0xc00058e100)
2023-04-21 23:04:29 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 0-280887295/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:04:29 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:04:29 DEBUG : HTTP RESPONSE (req 0xc00058e300)
2023-04-21 23:04:29 DEBUG : HTTP/2.0 206 Partial Content
Content-Length: 280887296
Alt-Svc: h3=":443"; ma=86400, h3-29=":443"; ma=86400
Cf-Cache-Status: BYPASS
Cf-Ray: random_cf_id
Content-Range: bytes 280887296-561774591/1404163477
Content-Type: video/mp4
Date: Fri, 21 Apr 2023 20:04:29 GMT
Etag: "17580bb2258abcc453b1d595"
Last-Modified: Fri, 21 Apr 2023 20:02:00 GMT
Server: cloudflare
2023-04-21 23:04:29 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2023-04-21 23:05:05 DEBUG : test.mp4: multi-thread copy: stream 2/5 (280887296-561774592) size 267.875Mi finished
2023-04-21 23:05:06 DEBUG : test.mp4: multi-thread copy: stream 4/5 (842661888-1123549184) size 267.875Mi finished
2023-04-21 23:05:06 DEBUG : test.mp4: multi-thread copy: stream 3/5 (561774592-842661888) size 267.875Mi finished
2023-04-21 23:05:06 DEBUG : test.mp4: multi-thread copy: stream 5/5 (1123549184-1404163477) size 267.615Mi finished
2023-04-21 23:05:06 DEBUG : test.mp4: multi-thread copy: stream 1/5 (0-280887296) size 267.875Mi finished
2023-04-21 23:05:06 DEBUG : test.mp4: Finished multi-thread copy with 5 parts of size 267.875Mi
2023-04-21 23:05:06 INFO  : test.mp4: Multi-thread Copied (replaced existing)
2023-04-21 23:05:06 ERROR : Attempt 2/3 succeeded
Transferred:        3.662 GiB / 3.662 GiB, 100%, 34.119 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:       2m0.6s
2023/04/21 23:05:06 INFO  :
Transferred:        3.662 GiB / 3.662 GiB, 100%, 34.119 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:       2m0.6s

2023/04/21 23:05:06 DEBUG : 4 go routines active

How to use GitHub

  • Please use the 👍 reaction to show that you are affected by the same issue.
  • Please don't comment if you have no relevant information to add. It's just extra noise for everyone subscribed to this issue.
  • Subscribe to receive notifications on status change and new comments.

Contributor guide

Research direction
Investigate how rclone handles Content Range in range responses and add validation to ensure the response matches the requested range.
Tech stack
go
Domain
backend
Issue type
Bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GoHTTP
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
55