Topic bigtable

Bigtable

Bigtable Product Playbook

Section 1

Bigtable Product Playbook

Bigtable

Product Baseline — standalone product knowledge block. This file contains the product knowledge needed to study this product independently.

Learning Map

By the end of this chapter, you should be able to reason about:

  • Purpose and workload fit
  • Core architecture and resource model
  • Key capabilities and operational model
  • Security and IAM
  • Networking / connectivity where relevant
  • Reliability, scaling and failure modes
  • Cost and performance considerations
  • Migration / integration patterns
  • Adjacent products and decision boundaries
  • Common anti-patterns and troubleshooting signals

Official Learning Resources

Section 2

Product Identity

Product Identity

  • Plain-language purpose: Petabyte-scale, low-latency, non-relational.

  • Catalogue category: Databases

  • Catalogue summary: Petabyte-scale, low-latency, non-relational

  • Known aliases: Bigtable, Cloud Bigtable

Need to Know

Bigtable — managed wide-column database for high-throughput, low-latency key-based access. Row-key design is a core architectural decision.

When to Choose

Choose Bigtable for massive operational datasets where reads/writes are primarily key/range based and low latency at scale matters.

Common Patterns

PatternProduct guidance
Evenly distributed row keysDesign row keys so reads and writes distribute across the keyspace instead of concentrating traffic on a small range.
Hotspot diagnosisTreat monotonically increasing keys, concentrated prefixes, and skewed access as schema-design signals before adding capacity.
Capacity after schemaBenchmark again after correcting key distribution; scale nodes when the workload is well distributed and additional capacity is still required.

Decision rule: When Bigtable traffic is skewed, fix row-key distribution before assuming more nodes will solve the problem.

Common Anti-Patterns

  • Using Bigtable for ad hoc analytical SQL.
  • Monotonically increasing or poorly distributed row keys that create hotspots.
  • Adding nodes before fixing a skewed key design.

Open Source / Existing Platform → Google Product

HBase/Cassandra-style access patterns → Bigtable can be a natural direction, but key/schema design must be reassessed for Bigtable rather than copied blindly.

Architecture

flowchart TD
    A[Access pattern] --> B[Design row key]
    B --> C{Even distribution?}
    C -->|No| D[Redesign key]
    C -->|Yes| E[Benchmark workload]
    D --> E
    E --> F[Scale capacity if still required]

Adjacent Products / Decision Boundaries

Bigtable — low-latency key access | BigQuery — analytics | Spanner — relational/global transactions | Cloud SQL — conventional relational.

Performance, Reliability, Security & Cost

Performance depends heavily on row-key distribution and access pattern. Treat hotspotting as a data-model problem before a capacity problem.

Section 3

Terminology for Reasoning

Terminology for Reasoning

Start with the product’s own vocabulary. The third column turns each term into a reasoning cue rather than a definition to memorize.

Product termMeaningWhy it matters when reasoning
InstanceAdministrative Bigtable resource containing clusters and tables.Capacity, replication, and routing decisions are tied to the instance/cluster topology.
ClusterSet of Bigtable nodes in a zone that serves table data.Multiple clusters support replication and availability/traffic-routing strategies.
Row keyUnique byte-string key that determines row ordering and distribution.The most important schema-design choice: key shape drives locality and can create or avoid hotspots.
Column familyLogical grouping of related columns with shared policy such as garbage collection.Model stable data families here; qualifiers can remain sparse and dynamic.
TabletContiguous range of rows distributed across Bigtable nodes.Hot key ranges translate into hot tablets; adding nodes cannot fully compensate for pathological key distribution.
Garbage-collection policyRule controlling automatic removal of older cell versions.Use to bound retained versions/age and storage growth; it is not a transactional delete workflow.
App profileApplication-specific routing configuration for requests.Reason about single- versus multi-cluster routing and consistency/availability trade-offs.

Cross-product reasoning vocabulary

Reasoning termMeaning
PurposeThe primary problem the product exists to solve.
Workload shapeThe characteristic form of the work, such as batch, streaming, transactional, analytical, orchestration, messaging, or storage.
Architectural layerWhere the product acts in the system, such as ingestion, transport, processing, storage, serving, orchestration, governance, security, or operations.
Operational modelWhat Google manages and what the customer still configures, secures, monitors, and operates.
Decision boundaryThe requirement that makes this product a better or worse fit than an adjacent product.
Anti-patternA requirement or design choice that conflicts with the product’s purpose or operating model.

Use the product terms first, then use the cross-product vocabulary to explain why those concepts change an architectural decision.

Section 4

Knowledge Check

Knowledge Check

QuestionResolution guidance
What primary workload is Bigtable designed to solve?Resolve: Bigtable is primarily for petabyte-scale, low-latency, non-relational. Then classify that purpose by workload shape and architectural layer, and explain why that makes the service a fit. Do not stop at a feature list.
When is Bigtable the wrong choice?Use the anti-patterns and decision boundaries. Name cases where another product better matches the workload, access pattern, compatibility, failure domain, or operational-control requirement.
What adjacent products are most easily confused with it?State the decisive boundary as: Choose X when …; choose Y when …. Prefer workload and constraint reasoning over feature lists.
What operational responsibilities remain with the customer?Separate what Google manages from what the customer must still design, configure, secure, monitor, test, or operate.
What reliability, security, performance, and cost factors matter most?Explain the important failure boundaries, controls, performance levers, and cost drivers, including why each design choice changes the outcome.
How would you recognize Bigtable without seeing the product name?Recognize the workload, hard constraints, architectural layer, compatibility requirements, and operational model—the problem signature that points toward Bigtable.
Section 5

Conclusion

Conclusion

  • Start with the workload: understand the problem Bigtable is designed to solve before memorizing features.
  • Use constraints to decide: access pattern, compatibility, failure domain, operational ownership, security, performance, and cost should drive the choice.
  • Know the boundaries: explain when an adjacent product is a better fit and why.
  • Reason about operations: distinguish managed capabilities from customer responsibilities.
  • Recognize the problem signature: identify Bigtable from architectural requirements even when its name is absent.
  • Revisit weak areas: use the Learning Map and Knowledge Check to decide what to review next.
Section 6

Maintenance Notes

Maintenance Notes

Prefer durable product facts and product-level decision boundaries. Verify volatile runtime, version, quota, pricing, and availability details against official product documentation before updating this material.