Downloads 634this week

GitHub stars 0

Extension repository on GitHub

Extension descriptor (YAML)

Add per-operation timeout and retry for httpfs extension

Installing and Loading

INSTALL httpfs_timeout_retry FROM community;
LOAD httpfs_timeout_retry;

Example

SET httpfs_timeout_file_operation_ms = 30000;      -- 30 seconds
SET httpfs_timeout_list_ms = 60000;      -- 60 seconds
SET httpfs_timeout_delete_ms = 30000;    -- 30 seconds
SET httpfs_timeout_stat_ms = 10000;      -- 10 seconds
SET httpfs_timeout_create_dir_ms = 20000; -- 20 seconds
SET http_timeout = 30000;  -- This will be used for operations without per-operation settings

SET httpfs_retries_file_operation = 3;  -- applies to open, read, and write operations
SET httpfs_retries_list = 3;
SET httpfs_retries_delete = 2;
SET httpfs_retries_stat = 2;
SET httpfs_retries_create_dir = 3;
SET http_retries = 3;  -- This will be used for operations without per-operation settings

About httpfs_timeout_retry

This extension allows per-operation timeout and retry config to DuckDB httpfs extension. It supports a few key features:

• It's 100% compatible to httpfs extension, so users don't need to change any of their code.
• It supports a few IO operations, like, open/read/write, list, stats, etc.

Added Functions

| function_name | function_type | description | comment | examples | |—————|—————|————-|———|———-|

Overloaded Functions

| function_name | function_type | description | comment | examples | |—————|—————|————-|———|———-|

Added Types

| type_name | type_size | logical_type | type_category | internal | |———–|———-:|————–|—————|———-|

Added Settings