Qlik Talend Cloud Data Integration improvements

The following improvements require Qlik Data Gateway – Data Movement 2024.11.14 or later. For upgrade instructions and a list of resolved issues, see Upgrading the Data Movement gateway installation.

PostgreSQL failover certification

Working with a secondary database after failover has been certified with the following data sources (which can all be accessed using the PostgreSQL source connector):

• Google Cloud SQL for PostgreSQL
• Amazon RDS for PostgreSQL
• PostgreSQL (on-premises)

See also: Setting up failover

MySQL performance improvement

In previous versions, when using a MySQL-based source endpoint in a task that was configured with limited LOB size, Data Movement gateway would use source lookup to read the LOB columns. Now, Data Movement gateway will read the LOB columns directly from binlog, thereby improving performance.

Data type mapping changes

Mappings to LOB columns have been changed for Amazon Redshift and Snowflake target.

Amazon Redshift target

• BLOB is now mapped to VARBYTE(16777216)
• NCLOB is now mapped to NVARCHAR(65535)
• CLOB is now mapped to NVARCHAR(65535)

Snowflake target

• BLOB is now mapped to BINARY (8388608)
• NCLOB is now mapped to NVARCHAR(16777216)
• CLOB is now mapped to VARCHAR(16777216)

Newly supported data types

• IBM DB2 for LUW source

  Now supports the BOOLEAN data type (from DB2 for LUW 11.5).

• Google BigQuery target

  Now supports the BIGNUMERIC data type.

Expanded target support for the DDL History control table

In previous Data Movement gateway versions, the DDL History control table was supported with Databricks and Microsoft Fabric targets only. This version introduces support for the following additional targets connectors:

• Amazon Redshift
• Amazon S3
• Google Cloud Storage
• Snowflake

See also: DDL history

Support for using a non-superuser with Google Cloud SQL for PostgreSQL

From this version, it is now possible to specify a non-superuser account when replicating from Google Cloud SQL for PostgreSQL

See also: Using an account without the superuser role

Newly certified platforms and driver versions

• Databricks target

  15.4 LTS

• Oracle source and target

  23ai

  • Oracle 23ai source and target are certified with Oracle Standard Edition only.
  • Oracle 23ai source is supported with TDE encryption only.

• Databricks driver update

  When moving data to Databricks, Simba Spark ODBC Driver 2.8.2 or later is now required. Customers should either run the driver installation utility or install the driver manually.

  See also: Driver setup

End of support

Support for the following database versions has been discontinued:

• PostgreSQL 12.x
• IBM DB2 for z/OS: z/OS 2.4
• Databricks 9.1