daft.io.GCSConfig

class GCSConfig(project_id=None, credentials=None, token=None, anonymous=None)

Create configurations to be used when accessing Google Cloud Storage.

Credentials may be provided directly with the credentials parameter, or set with the GOOGLE_APPLICATION_CREDENTIALS_JSON or GOOGLE_APPLICATION_CREDENTIALS environment variables.

Parameters:

• project_id (str, optional) – Google Project ID, defaults to value in credentials file or Google Cloud metadata service

• credentials (str, optional) – Path to credentials file or JSON string with credentials

• token (str, optional) – OAuth2 token to use for authentication. You likely want to use credentials instead, since it can be used to refresh the token. This value is used when vended by a data catalog.

• anonymous (bool, optional) – Whether or not to use “anonymous mode”, which will access Google Storage without any credentials. Defaults to false

Example

>>> io_config = IOConfig(gcs=GCSConfig(anonymous=True))
>>> daft.read_parquet("gs://some-path", io_config=io_config)

__init__()

Methods

__init__()
replace([project_id, credentials, token, ...])

Attributes

anonymous	Whether to use anonymous mode
credentials	Credentials file path or string to use when accessing Google Cloud Storage
project_id	Project ID to use when accessing Google Cloud Storage
token	OAuth2 token to use when accessing Google Cloud Storage

• Get Started
• Documentation
• Github
• Blog
• Community