Skip to main content
Version: Next

Prerequisites

  • JDK 1.8 or above
  • Maven 2.5 or above

Installing SDK Dependencies

You need to include the SDK library in your project to use the SDK. The library can be obtained in the following two ways:

  • Obtain the source code, compile it yourself, and deploy the SDK package to the local repository. See How to Compile for details.
  • Directly reference the existing library in the Apache repository. xml
<dependency>
    <groupId>org.apache.inlong</groupId>
    <artifactId>transform-sdk</artifactId>
    <version>1.13.0</version>
</dependency>

Specific Examples

Transform Requirements​

  • Filter out the video playback start data in the Shenzhen region, the original fields include:
    • event_time
    • zone, optional values: [ shenzhen, shanghai, beijing ]
    • video_id
    • username
    • operation_type, optional values [ start, end ]
  • Original test data, CSV format, vertical bar delimited.
2024-05-09 20:00:01|shenzhen|1111|zhangsan|start
2024-05-09 20:00:02|shanghai|1111|lisi|start
2024-05-09 20:00:03|shanghai|1111|lisi|end
2024-05-09 20:00:04|shenzhen|1111|zhangsan|end
2024-05-09 20:00:05|beijing|1111|zhangsan|start
2024-05-09 20:00:06|beijing|1111|zhangsan|end
  • Expected result data, KV format
event_time=2024-05-09 20:00:02&zone=shanghai&video_id=1111&username=lisi&operation_type=start

Transform SDK Implementation​

Configure Source Data Configuration​

// source
SourceInfo csvSource = new CsvSourceInfo("UTF-8", "|", "\\", null);

Configure Result Data Configuration​

// sink
SinkInfo kvSink = new KvSinkInfo("UTF-8", null);

Execute Transformation Logic​

String transformSql = "select $1 event_time,$2 zone,$3 video_id,$4 username,$5 operation_type from source where $2='shenzhen' and $5='start' ";
TransformConfig config = new TransformConfig(csvSource, kvSink, transformSql);

Build SDK Object and Execute Transformation​

TransformProcessor processor = new TransformProcessor(config);

String srcString = "2024-05-09 20:00:01|shenzhen|1111|zhangsan|start\n"
  + "2024-05-09 20:00:02|shanghai|1111|lisi|start\n"
  + "2024-05-09 20:00:03|shanghai|1111|lisi|end\n"
  + "2024-05-09 20:00:04|shenzhen|1111|zhangsan|end\n"
  + "2024-05-09 20:00:05|beijing|1111|zhangsan|start\n"
  + "2024-05-09 20:00:06|beijing|1111|zhangsan|end";

List<String> outputs = processor.transform("2024-04-28 00:00:00|ok", new HashMap<>());

// Expected outcome：[event_time=2024-05-09 20:00:02&zone=shanghai&video_id=1111&username=lisi&operation_type=start]
System.out.println(outputs);

More Transform Examples