Author Archives: anuj
Migrating from Cloud SQL to Cloud Spanner
Here are some considerations when planning a trial or actual migration from Cloud SQL To Cloud Spanner on GCP. Design Spanner Schema Adapt Schema for Spanner: Spanner does not support…
Grafana versus Datadog – Data Observability Tools
Grafana and Datadog are both popular tools for data observability, but they have different strengths, features, and target audiences. Here's a comparison of the two: ### **1. Overview** - **Grafana:**…
Building a Data Lake on GCP
Building a data lake on Google Cloud Platform (GCP) involves leveraging a variety of services that are designed to handle storage, processing, and management of large-scale data. Here are some…
Firebase Cloud Messaging
Cross Platform Messaging Service - Free of Cost. For sending push notifications to devices
GCP logs JSON Extract – Load into BigQuery
Use JSON Extract - JSON_EXTRACT SELECT REGEXP_EXTRACT(, '^projects/+/datasets/(+)/tables') AS datasetRef, COUNTIF(JSON_EXTRACT(, "$.tableDataRead") IS NOT NULL) AS dataReadEvents, FROM * WHERE JSON_EXTRACT(, "$.tableDataRead") IS NOT NULL GROUP BY datasetRef ORDER BY…
Cloud Custodian – for Multi Cloud Open Source Asset Governance
Cloud Custodian is an open source suite of software for asset governance (cloud assets that is). Cloud Asset Governance Some of the more useful features include actions via pipelines -…
GKE Security and Cloud Armor
GKE Security and Cloud Armor What about GKE Backends? Google Cloud Armor with Google Kubernetes Engine (GKE) Ingress Use Case - Your application is running on GKE Cluster and it…
OAuth Tokens from GCP Service Accounts?
Delegated API Access You can use your Service accounts to call public Google APIs. This is called Delegated API Access. How does it work? Essentially, your service account receives an…
HL7 Messages and DataFlow Streaming Healthcare API
Just a quick note - from the field. There's two things to watch out for - Is the payload TEXT (JSON is also TEXT) or BINARY (preferred). The Base64 encoding…
Restricting what your API Key can call in GCP (and otherwise)
Consuming GCP APIs from a client There's TWO ways you can consume an API from a client a. API Keys -Least SEcure way - since the KEY is passwordless -and…