Resolving Authentication Failures (Anonymous Caller / ADC) for Local Python Access to Private GCS Buckets

Hi everyone,

I am encountering persistent authentication errors while trying to access private genomic data stored in a Google Cloud Storage bucket (alphagenome) from my local Linux computation node while initializing the default_organism_settings() function.

This function defines paths to reference files hosted on GCS. When the code attempts to fetch these files (as shown in the snippet below), it fails with access denied errors.
Detail of errors:

W0000 00:00:1782094870.725551 4025452 google_auth_provider.cc:196] All attempts to get a Google authentication bearer token failed, returning an empty token. Retrieving token from files failed with “NOT_FOUND: Could not locate the credentials file.”. Retrieving token from GCE failed with “FAILED_PRECONDITION: Error executing an HTTP request: libcurl code 6 meaning ‘Could not resolve hostname’, error details: Could not resolve host: metadata.google.internal”.

E0000 00:00:1782092624.267569 3947800 curl_http_request.cc:625] The transmission of request 0x55688c160650 (URI: https://www.googleapis.com/storage/v1/b/alphagenome/o/data%2Fhg38%2Fcalibration_scores.pb?fields=size%2Cgeneration%2Cupdated) has been stuck at 0 of 0 bytes for 61 seconds and will be aborted. CURL timing information: lookup time: 0.002166 (No error), connect time: 0 (No error), pre-transfer time: 0 (No error), start-transfer time: 0 (No error);

---------------------------------------------------------------------------

Any guidance or documentation links would be greatly appreciated!

Hi @ZhongtingHuang05,

See my reply Updating variant score quantiles - #4 by tward to your other post, but this looks like a network issue on your end. Hopefully the options presented in other post help!

Tom