Resources on Jikkou

Iceberg Namespace

Mon, 01 Jan 0001 00:00:00 +0000

IcebergNamespace resources are used to define the namespaces (databases) you want to manage in your Iceberg catalog. A namespace groups tables and carries metadata as key/value properties.

`IcebergNamespace`

Specification

Here is the resource definition file for defining an IcebergNamespace.

apiVersion: "iceberg.jikkou.io/v1beta1" # The api version (required)
kind: "IcebergNamespace" # The resource kind (required)
metadata:
 name: <namespace name>  # Dot-separated namespace path (required)
 labels: { }
 annotations: { }
spec:
 properties: # Namespace-level metadata (optional)
 <key>: <value>

The metadata.name property is mandatory. Nested namespaces are expressed using dot notation — for example, analytics.events creates a namespace events inside analytics.

Iceberg Table

Mon, 01 Jan 0001 00:00:00 +0000

IcebergTable resources are used to define the tables you want to manage in your Iceberg catalog. An IcebergTable resource defines the schema, partition layout, sort order, and table-level properties. Jikkou performs safe schema evolution — adding, renaming, updating, and dropping columns — without data loss.

`IcebergTable`

Specification

Here is the resource definition file for defining an IcebergTable.

apiVersion: "iceberg.jikkou.io/v1beta1" # The api version (required)
kind: "IcebergTable" # The resource kind (required)
metadata:
 name: <namespace>.<table>  # Fully qualified table name (required)
 labels: { }
 annotations: { }
spec:
 location: <storage path>  # Override the default table location (optional)
 schema:
 identifierFields: # Primary-key columns for MERGE/UPSERT semantics (optional)
 - <column name>
 columns: # Ordered list of columns (required)
 - name: <column name>  # Column name (required)
 type: <type>  # Column type (required) — see type reference below
 required: <true|false> # Whether the column is non-nullable (default: false)
 doc: <description>  # Documentation string (optional)
 default: <value>  # Initial default value, immutable after creation (optional)
 writeDefault: <value>  # Write-default for absent values, updatable (optional)
 previousName: <old name>  # Triggers a safe rename instead of drop+add (optional)
 partitionFields: # Partition layout (optional)
 - sourceColumn: <column>  # Source column to partition on (required)
 transform: <transform>  # Partition transform (required) — see transforms below
 name: <partition field name>  # Custom partition field name (optional)
 sortFields: # Default write sort order (optional)
 - column: <column>  # Column name (mutually exclusive with term)
 term: <expression>  # Sort expression e.g. bucket[16](user_id) (mutually exclusive with column)
 direction: <asc|desc> # Sort direction (default: asc)
 nullOrder: <first|last> # Null placement (default: last)
 properties: # Table-level metadata properties (optional)
 <key>: <value>

Column Types

Jikkou maps a set of type strings to the underlying Iceberg types:

Iceberg View

Mon, 01 Jan 0001 00:00:00 +0000

IcebergView resources are used to define SQL views in your Iceberg catalog. A view is a logical definition backed by one or more SQL queries — the output schema is inferred by the engine and populated on collect.

`IcebergView`

Specification

Here is the resource definition file for defining an IcebergView.

apiVersion: "iceberg.jikkou.io/v1beta1" # The api version (required)
kind: "IcebergView" # The resource kind (required)
metadata:
 name: <namespace>.<view>  # Fully qualified view name (required)
 labels: { }
 annotations: { }
spec:
 schema: # Output schema (read-only, inferred by the engine)
 columns:
 - name: <column name>
 type: <type>
 required: <true|false>
 doc: <description>
 queries: # SQL query definitions (at least one required)
 - sql: <SQL SELECT statement>  # The SQL defining the view (required)
 dialect: <dialect>  # SQL dialect e.g. 'spark', 'trino', 'presto', 'hive' (required)
 defaultNamespace: <namespace>  # Default namespace for unqualified table references (optional)
 defaultCatalog: <catalog>  # Default catalog for unqualified table references (optional)
 properties: # View-level metadata properties (optional)
 <key>: <value>

Examples

Simple view with daily aggregation

file: iceberg-daily-page-stats.yaml