Google Cloud Storage source
This event source receives change notifications from a Google Cloud Storage bucket by subscribing to a Google Cloud Pub/Sub topic.
With tmctl
:
tmctl create source googlecloudstorage --bucket <bucket> --pubsub.project <project> --serviceAccountKey $(cat ./key.txt)
On Kubernetes:
apiVersion: sources.triggermesh.io/v1alpha1
kind: GoogleCloudStorageSource
metadata:
name: sample
spec:
bucket: my-bucket
pubsub:
project: my-project
# Alternatively, provide a pre-existing Pub/Sub topic:
# topic: projects/my-project/topics/my-topic
eventTypes:
- OBJECT_FINALIZE
- OBJECT_DELETE
objectNamePrefix: myprefix
serviceAccountKey:
value: >-
{
"type": "service_account",
"project_id": "my-project",
"private_key_id": "0000000000000000000000000000000000000000",
"private_key": "-----BEGIN PRIVATE KEY-----\nMIIE...\n-----END PRIVATE KEY-----\n",
"client_email": "triggermesh-storage-source@my-project.iam.gserviceaccount.com",
"client_id": "000000000000000000000",
"auth_uri": "https://accounts.google.com/o/oauth2/auth",
"token_uri": "https://oauth2.googleapis.com/token",
"auth_provider_x509_cert_url": "https://www.googleapis.com/oauth2/v1/certs",
"client_x509_cert_url": "https://www.googleapis.com/robot/v1/metadata/x509/triggermesh-storage-source%40my-project.iam.gserviceaccount.com"
}
sink:
ref:
apiVersion: eventing.triggermesh.io/v1alpha1
kind: RedisBroker
name: triggermesh
Events produced have the following attributes:
- type
com.google.cloud.storage.notification
See the Kubernetes object reference for more details.
Prerequisite(s)
- Event Source for Google Cloud Pub/Sub
- Storage Bucket
- Notification Configuration
Event Source for Google Cloud Pub/Sub
Change notifications from Cloud Storage buckets can not be consumed directly, but are instead sent to a Google Cloud Pub/Sub topic. Follow the instructions at Event Source for Google Cloud Pub/Sub for setting up a Pub/Sub topic and running an instance of the Pub/Sub event source.
Note
As an alternative to a manual creation, the Pub/Sub topic will be created automatically while enabling the Notification Configuration if it doesn't already exist.
Storage Bucket
You can create a Cloud Storage bucket by following the instructions from the Cloud Storage How-To Guides.
Notification Configuration
Change notifications need to be enabled in the selected bucket by applying a notification configuration. Follow the
instructions at Using Pub/Sub notifications for Cloud Storage to add a new notification
configuration using the gsutil
command-line tool.
Below is an example of command which applies a notification configuration to a bucket called eventsource-dev
, with a
Pub/Sub topic called triggermesh-storage-source
set as event destination.