The exclude_s3 value determines whether to refuse to preview image objects on S3 volumes.
True: Image objects on s3 volumes are not shown in the preview window.
False: Image objects on s3 volumes are shown in the preview window.
"exclude_s3":
value: False
s3_max_bytes (required)
Use exclude_s3 to prevent situations from attempting to preview very large files. When a large file is selected for preview, DataIQ immediately displays a message that a preview is not available.
The value is the maximum size in bytes of S3 image objects to try to preview. The default value is 1073741824 (= 1 GiB).
"s3_max_bytes":
value: 1073741824
S3 buckets (optional)
Format:
"S3 buckets:"
<On the DataIQ host, add "value:". Do not add "value:" on worker nodes>
"<bucket_name>": # Repeat this section for each bucket
"dataiq_volume": "< DataIQ Volume Name >"
"access_key": "< bucket access key >"
"secret_key": "< bucket secret key >"
"endpoint": "< endpoint url >"
< bucket_name > (required)
The name of the S3 bucket. The name must match the bucket name that is used on the S3 service. Buckets with the same name are not supported.
dataiq_volume (optional)
The name of the volume within DataIQ. Only use this setting when the S3 bucket is already represented as a volume within DataIQ. The name must match the DataIQ volume name, and it must be prepended with a forward slash (/). If this value is not present, the bucket may have files that are transferred to it, but no transfer will be allowed from the bucket to the file system.