Overview

Overview

Extract Nodes is a set of Source Connectors based on Apache Flink^® for extracting data from different source systems.

Supported Extract Nodes

Extract Node	Version	Driver
Kafka	Kafka: 0.10+	None
Pulsar	Pulsar: 2.8.x+	None
MongoDB-CDC	MongoDB: 3.6, 4.x, 5.0	None
MySQL-CDC	MySQL: 5.6, 5.7, 8.0.x RDS MySQL: 5.6, 5.7, 8.0.x PolarDB MySQL: 5.6, 5.7, 8.0.x Aurora MySQL: 5.6, 5.7, 8.0.x MariaDB: 10.x PolarDB X: 2.0.1	JDBC Driver: 8.0.21
Oracle-CDC	Oracle: 11, 12, 19	Oracle Driver: 19.3.0.0
PostgreSQL-CDC	PostgreSQL: 9.6, 10, 11, 12	JDBC Driver: 42.2.12
SqlServer-CDC	SQLServer: 2012, 2014, 2016, 2017, 2019	None

Supported Flink Versions

The following table shows the version mapping between InLong^® Extract Nodes and Flink^®:

InLong® Extract Nodes Version	Flink® Version
1.2.0	1.13.5

Usage for SQL API

• Deploy InLong Sort
• Create Data Node

The example shows how to create a MySQL Extract Node in Flink SQL Client and execute queries on it.

-- Creates a MySQL Extract Node
CREATE TABLE mysql_extract_node (
 id INT NOT NULL,
 name STRING,
 age INT,
 weight DECIMAL(10,3),
 PRIMARY KEY(id) NOT ENFORCED
) WITH (
 'connector' = 'mysql-cdc-inlong',
 'hostname' = 'YourHostname',
 'port' = '3306',
 'username' = 'YourUsername',
 'password' = 'YourPassword',
 'database-name' = 'YourDatabaseName',
 'table-name' = 'YourTableName'
);

SELECT id, name, age, weight FROM mysql_extract_node;