Streaming Data Processing with Apache Kafka and KSQL

  1. ksqlDB Data Definition Language (DDL)
    1. Working with Streams
      1. CREATE STREAM Statement
        1. Syntax and Options
          1. WITH Clause Parameters
            1. Stream Configuration
            2. Defining Columns and Data Types
              1. Supported Data Types
                1. Column Constraints
                  1. Nullable vs. Non-Nullable Columns
                  2. Specifying Data Format
                    1. JSON Format
                      1. AVRO Format
                        1. PROTOBUF Format
                          1. DELIMITED Format
                          2. Specifying the Backing Kafka Topic
                            1. Linking Streams to Topics
                              1. Auto-Creation of Topics
                                1. Topic Naming Conventions
                                2. CREATE STREAM AS SELECT (CSAS)
                                  1. Creating Derived Streams
                                    1. Query Examples
                                      1. Persistent Query Creation
                                    2. Working with Tables
                                      1. CREATE TABLE Statement
                                        1. Syntax and Options
                                          1. WITH Clause Parameters
                                            1. Table Configuration
                                            2. Defining Primary Keys
                                              1. Importance of Primary Keys
                                                1. Key Constraints
                                                  1. Composite Keys
                                                  2. CREATE TABLE AS SELECT (CTAS)
                                                    1. Creating Derived Tables
                                                      1. Query Examples
                                                        1. Materialized View Creation
                                                      2. Managing Metadata
                                                        1. DESCRIBE
                                                          1. Stream Schema Inspection
                                                            1. Table Schema Inspection
                                                              1. Extended Descriptions
                                                              2. SHOW STREAMS
                                                                1. Listing Existing Streams
                                                                2. SHOW TABLES
                                                                  1. Listing Existing Tables
                                                                  2. SHOW TOPICS
                                                                    1. Listing Kafka Topics
                                                                    2. DROP STREAM
                                                                      1. Deleting Streams
                                                                        1. Impact on Underlying Topics
                                                                        2. DROP TABLE
                                                                          1. Deleting Tables
                                                                            1. Cleanup Considerations