Release notes

3.0.0

  • Breaking: Require Apache Airflow 3.2.2. Airflow 2.x is no longer supported. See Upgrading to Airflow 3.

  • Update the provider to run on Apache Airflow 3.2.2.

  • Update provider code and example DAGs to use the Airflow 3 public interfaces, including airflow.sdk imports and the Airflow REST API v2.

  • Document Airflow 3 deployment requirements for the API server, DAG processor, execution API, and pluggable authentication manager.

  • Add apache-airflow-providers-fab as a provider dependency for deployments that use the FAB auth manager.

  • Add sql_audit_columns to I2EToSQLOperator for appending metadata columns to every inserted row.

2.3.0

  • Add I2EPrintTaskLogOperator, which prints the task log for a given I2E task.

  • Fix an issue in the I2EPickConnectionIDOperator where the round-robin strategy wouldn’t work correctly with queued DAG runs.

2.2.1

  • Fix ModelsHubHook API calls by forcing data to be sent as JSON.

2.2.0

  • Add HARTModelsHubFineTuneTokenOperator.

  • Refactor ModelsHubHook to pass through all model tags

  • Support passing REJECTED assertion rows in the HARTHook to Models Hub for negative mining

2.1.0

  • Add SQLQueryToI2EOperator.

  • Rename SQLToI2EOperator to SQLTimestampToI2EOperator (SQLToI2EOperator remains as an alias for backwards compatibility).

  • Fix an issue in the SQLQueryToI2EOperator where some special characters were being removed instead of being correctly escaped.

  • Reduce memory usage of the SQLTimestampToI2EOperator.

2.0.1

  • Improve the performance of the I2EToSQLOperator.

  • Fix an issue in the SQLToI2EOperator where some special characters in an SQL input table would cause an error when processed.

2.0.0

Initial release of the IQVIA NLP Airflow provider. This release includes:

  • Operators for interacting with I2E, HART, and Models Hub:

    • I2EMakeIndexOperator

    • I2ERunQueryOperator

    • I2EPickConnectionIDOperator

    • I2EDeleteResourcesOperator

    • HARTModelsHubPredictionOperator

    • HARTModelsHubFineTuneOperator

  • Transfer operators for copying source data to I2E:

    • S3ToI2EOperator

    • SQLToI2EOperator

    • LocalFilesystemToI2EOperator

  • Transfer operators for copying query results from I2E:

    • I2EToS3Operator

    • I2EToSQLOperator

    • I2EToLocalFilesystemOperator

  • Transfer operators for copying resource bundles to I2E:

    • S3ToI2EResourceBundleOperator

    • LocalFilesystemToI2EResourceBundleOperator

  • Hooks for interacting with I2E, legacy NLP Data Factory webhooks, HART, and Models Hub:

    • I2EHook

    • LegacyWebhookHook

    • HARTHook

    • ModelsHubHook

  • New documentation.

Previous versions

You can find the release notes for previous NLP Data Factory versions on the Linguamatics Community Site. The NLP Data Factory 1.x section also covers the key differences between previous NLP Data Factory versions and the current version, and guides you through the migration process.