Skip to main content
Version: 1.7.0

Overview

Overview

Load Nodes is a set of Sink Connectors based on Apache Flink® for loading data to different storage systems.

Supported Load Nodes

Load NodeVersionDriver
KafkaKafka: 0.10+None
HBaseHBase: 2.2.xNone
PostgreSQLPostgreSQL: 9.6, 10, 11, 12JDBC Driver: 42.2.12
OracleOracle: 11, 12, 19Oracle Driver: 19.3.0.0
MySQLMySQL: 5.6, 5.7, 8.0.x
RDS MySQL: 5.6, 5.7, 8.0.x
PolarDB MySQL: 5.6, 5.7, 8.0.x
Aurora MySQL: 5.6, 5.7, 8.0.x
MariaDB: 10.x
PolarDB X: 2.0.1
JDBC Driver: 8.0.21
TDSQL-PostgreSQLTDSQL-PostgreSQL: 10.17JDBC Driver: 42.2.12
GreenplumGreenplum: 4.x, 5.x, 6.xJDBC Driver: 42.2.12
ElasticsearchElasticsearch: 6.x, 7.xNone
ClickHouseClickHouse: 20.7+JDBC Driver: 0.3.1
HiveHive: 1.x, 2.x, 3.xNone
SQLServerSQLServer: 2012, 2014, 2016, 2017, 2019JDBC Driver: 7.2.2.jre8
HDFSHDFS: 2.x, 3.xNone
IcebergIceberg: 0.13.1+None
HudiHudi: 0.12.xNone

The following table shows the version mapping between InLong® Load Nodes and Flink®:

InLong® Load Nodes VersionFlink® Version
1.2.01.13.5

Usage for SQL API

The example shows how to create a MySQL Load Node in Flink SQL Client and load data to it.

-- Creates a MySQL Extract Node
CREATE TABLE mysql_extract_node (
id INT NOT NULL,
name STRING,
age INT,
weight DECIMAL(10,3),
PRIMARY KEY(id) NOT ENFORCED
) WITH (
'connector' = 'mysql-cdc-inlong',
'hostname' = 'YourHostname',
'port' = '3306',
'username' = 'YourUsername',
'password' = 'YourPassword',
'database-name' = 'YourDatabaseName',
'table-name' = 'YourTableName'
);
-- Creates a MySQL Load Node
CREATE TABLE mysql_load_node (
id INT NOT NULL,
name STRING,
age INT,
weight DECIMAL(10,3),
PRIMARY KEY(id) NOT ENFORCED
) WITH (
'connector' = 'jdbc-inlong',
'url' = 'jdbc:mysql://YourHostname:3306/YourDatabaseName',
'username' = 'YourUsername',
'password' = 'YourPassword',
'table-name' = 'YourTableName'
);

INSERT INTO mysql_load_node SELECT id, name, age, weight FROM mysql_extract_node;