7362162be0
Fix -Wformat warning
2022-12-01 09:01:50 -08:00
a71d985518
Fix the bug of variable int32 overflow.
...
1.the content length from http response transformed using 'atoi' would rise int32 overflow.
2.the offset's aligning would rise int32 overflow.
2022-11-29 15:40:03 +08:00
4fd64630e8
Convert literal string ref instances to use _sr suffix
2022-09-19 11:35:58 -07:00
28cd5bb559
Address comments.
2022-08-22 11:16:48 -07:00
657e6f8b60
Complete the proxy support for backup to S3.
2022-08-22 11:16:48 -07:00
dc9599f2e9
Get network interfaces ready for https proxy. ( #7556 )
...
* Move HTTP from fdbclient/ to fdbrpc/.
* Move md5 and libb64 to contrib/.
* Get network interfaces ready for https proxy.
* Rebase
2022-07-25 17:08:32 -07:00
9d80ee0cb6
fdbrpc is compiling
2022-06-23 17:15:49 -06:00
da346d718f
Fix compatibility issue of s3 backup
...
1. For v4 signature, http request path should be encoded, currently only parameters are encoded.
2. For v2 signature, http request date header should be in form of either the http date header or x-amz-date, currently in form of ISO 8601
3. Empty response header value cause http_bad_response error.
4. Skip verifying MD5 for range get request and if http response code 206 is returned.
2022-05-25 09:48:54 -05:00
333aadb903
Interface to enable clients to send/receive REST requests/responses ( #6866 )
...
* Interface to enable clients to send/receive REST requests/responses
Description
Major changes:
1. Add RESTClient interface enabling client to send/receive REST HTTP
requests. Support REST APIs are: get, head, put, post, delete, trace
2. Add RESTUtil file introducing below interfaces:
2.1. RESTUrl - Extract URI information: host, service, request-parameters.
2.2. RESTConnectionPool-
Connection establishment, life-cycle management, connection-pool (TTL)
2.3. RESTClientKnobs - supports REST Knob parameter management and updates
Testing
Unit test - fdbrpc/RESTClient, fdbrpc/RESTUtils
2022-04-27 12:17:52 -07:00
776b289bfe
Move AsyncFileBlobStore and related files to fdbclient.
2018-10-26 13:49:42 -07:00
0bae9880f1
remove trailing whitespace from our copyright headers ; fixed formatting of python setup.py
2018-02-21 10:25:11 -08:00
d8879dc3f3
HTTP::doRequest() now reads responses in parallel with sending requests, so if the server responds before receiving all of the the request the client can stop sending the remainder of the request. For PUT requests which upload files, this prevents sending potentially several megabytes of unnecessary bytes if the server responds with an error (such as 429) before the request is completely sent. Updated the backup container unit test to use more parallelism in order to test this new behavior.
2018-02-07 10:38:31 -08:00
f2524ffd33
AsyncFileBlobStoreWrite was prohibiting the writing of 0-byte files. Improved HTTP verbose logging to stdout. Added writing a 0-byte file to BackupContainer unit test. Added backup log and snapshot sizes to backup description.
2017-12-21 21:15:26 -08:00
1f949240f5
Make fdbbackup s3 compatible.
...
s3 sends response in XML. FDB backup expects json response. Added a new libraray xml2json to convert xml to json.
2017-12-05 17:13:15 -08:00
d30c730f75
Add the ability to access name and description in Error. Update error descriptions.
2017-09-28 12:35:03 -07:00
a674cb4ef4
Initial repository commit
2017-05-25 13:48:44 -07:00
sfc-gh-tclinkenbeard