Overview
Overview
Extract Nodes is a set of Source Connectors based on Apache Flink® for extracting data from different source systems.
Supported Extract Nodes
Extract Node | Version | Driver |
---|---|---|
Kafka | Kafka: 0.10+ | None |
Pulsar | Pulsar: 2.8.x+ | None |
MongoDB-CDC | MongoDB: 3.6, 4.x, 5.0 | None |
MySQL-CDC | MySQL: 5.6, 5.7, 8.0.x RDS MySQL: 5.6, 5.7, 8.0.x PolarDB MySQL: 5.6, 5.7, 8.0.x Aurora MySQL: 5.6, 5.7, 8.0.x MariaDB: 10.x PolarDB X: 2.0.1 | JDBC Driver: 8.0.21 |
Oracle-CDC | Oracle: 11, 12, 19 | Oracle Driver: 19.3.0.0 |
PostgreSQL-CDC | PostgreSQL: 9.6, 10, 11, 12 | JDBC Driver: 42.2.12 |
SqlServer-CDC | SQLServer: 2012, 2014, 2016, 2017, 2019 | None |
Supported Flink Versions
The following table shows the version mapping between InLong® Extract Nodes and Flink®:
InLong® Extract Nodes Version | Flink® Version |
---|---|
1.2.0 | 1.13.5 |
Usage for SQL API
- Deploy InLong Sort
- Create Data Node
The example shows how to create a MySQL Extract Node in Flink SQL Client and execute queries on it.
-- Creates a MySQL Extract Node
CREATE TABLE mysql_extract_node (
id INT NOT NULL,
name STRING,
age INT,
weight DECIMAL(10,3),
PRIMARY KEY(id) NOT ENFORCED
) WITH (
'connector' = 'mysql-cdc-inlong',
'hostname' = 'YourHostname',
'port' = '3306',
'username' = 'YourUsername',
'password' = 'YourPassword',
'database-name' = 'YourDatabaseName',
'table-name' = 'YourTableName'
);
SELECT id, name, age, weight FROM mysql_extract_node;