OCF Connector Release Notes¶
Alation Cloud Service Applies to Alation Cloud Service instances of Alation
Customer Managed Applies to customer-managed instances of Alation
December 27, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.7.0¶
Enhancements¶
Support for New Dataset Parameter Formats¶
The connector now supports new dataset expression formats. For example: dbsources: vertica, saphana. For more information, see the Expressions Supported by Lineage table in Azure Power BI Scanner OCF Connector.
Additionally, the connector now extracts connection information from source expressions containing Japanese characters. (AL-173933)
Tableau OCF Connector: Version 1.12.5¶
Fixed Issues¶
Unable to Generate Lineage for Virtual Connections¶
Tableau OCF connector is unable to generate lineage between Snowflake and Tableau workbook when the user is connected to Snowflake virtually.
This issue is now resolved (AL-177665)
November 27, 2024¶
Adobe Analytics OCF Connector: Version 23.0.9034¶
The Adobe Analytics OCF Connector is now available on Connector Hub for public preview (AL-150845).
The connector is compatible with Alation version 2023.3 and higher.
Features¶
The Adobe Analytics connector supports OAuth authentication.
Supports features inclusive of Metadata Extraction (MDE) and Sampling and Profiling.
Hive OCF Connector: Version 1.3.1¶
Enhancements¶
JDK Upgrade¶
The JDK is now upgraded to OpenJDK11. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2022-21540, CVE-2023-41993 and CVE-2021-2388 (AL-175789)
Support for Query Service¶
The connector now supports the QueryService interface implemented in HiveDataSource. (AL-111828)
Fixed Issues¶
Unable to Extract Partition Columns¶
The connector fails to extract the partition columns when those do not have comments.
This issue is now resolved. (AL-164235)
Salesforce OCF Connector: Version 24.0.9092¶
Enhancements¶
Support for Both JDBC URI and Configuration Field Values¶
The connector will now read and utilize the connection parameters added in the JDBC URI and in the individual configuration fields (preferred). The value of a parameter configured in the JDBC URI takes precedence over the same parameter configured in the corresponding field in the Connector Settings section of the General Settings tab.
Fixed Issue¶
Test Connection and Metadata Extraction Fails Post the Upgrade¶
After upgrading to version 23.0.8994, the connector fails to connect to the Salesforce instance.
This issue is now resolved. (AL-172396)
November 20, 2024¶
Informatica CDI OCF Connector: Version 2.1.1¶
Fixed Issues¶
Unable to Generate Lineage¶
The connector fails to generate lineage during cross-system lineage generation.
This issue is now resolved.
Unable to Catalog Source and Target Into Alation¶
If the connection ID is NULL for source and target parameters, the connector fails to catalog source and target into Alation.
This issue is now resolved.
Exception While Invoking Informatica Field API¶
The connector displays an Illegal Argument exception when a pipe character is part of the URL to invoke the Informatica field API.
This issue is now resolved.
SQL Server OCF Connector: Version 1.7.1¶
Fixed Issues¶
Incorrect Column Sizes Retrieved for Data Types Defined As VARCHAR(MAX), NVARCHAR(MAX), and VARBINARY(MAX)¶
Connector extracts column sizes defined as varchar(max), nvarchar(max), and varbinary(max) data types in SQL Server database as varchar(-1), nvarchar(0), and varbinary(-1).
This issue is now resolved. (AL-172681)
Tableau OCF Connector: Version 1.12.4¶
Fixed Issues¶
Temporary Objects Displayed in Lineage for Google BigQuery¶
The Connector displays temporary (TMP) objects in Tableau and Google BigQuery lineage.
This issue is resolved. Now, the connector forms the fully qualified table name and creates lineage when Google BigQuery project ID is available from the Tableau metadata API. (AL-172023)
November 06, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.6.0¶
Enhancements¶
Support for New Dataset Parameter Formats¶
The connector now supports the following dataset parameter formats (AL-174370)
“”&@ parameter&””
@parameter
“”& parameter &””
Fixed Issues¶
Metadata Extraction Fails for Long Dataflow Column Names¶
Metadata Extraction fails for query-based dataflow column names exceeding 2000 characters.
This issue is resolved. Now, the connector will skip the connection columns with names exceeding 2000 characters and continue with Metadata Extraction. (AL-175651)
Metadata Extraction Fails for Certain Workspaces¶
Metadata Extraction fails when trying to extract objects from workspaces with upstream data flow that are cross-referenced from a different workspace to which the service principal does not have access.
This issue is now resolved. (AL-176312)
Fivetran OCF Connector: Version 3.0.0¶
The Fivetran OCF Connector is now available on Connector Hub for download. (AL-157546)
Compatible Alation version is 2024.3.2.
Note
The Fivetran connector is no more available as an add-on connector. You must use thea standalone Fivetran OCF connector to catalog a data source. If you are using an add-on connector for Fivetran, see Fivetran OCF Connector for information on how to migrate from add-on connector for Fivetran.
Enhancements¶
Fivetran deprecated the APIs used to connect and extract lineage information. For details, see the Fivetran announcement .
Alation provides an improved Fivetran user experience by:
Simplifying the setup. You can now enable the Fivetran configuration once in Alation instead of enabling it for every destination.
Providing a preview of the lineage that Alation generates based on the sources and destinations you have configured.
With this enhancement, you must decommission the Fivetran Add-on connector if you have one currently configured and use the new version.
For more information, see Fivetran OCF Connector.
Snowflake OCF Connector: Version 2.7.0¶
Enhancements¶
Support for Dynamic Table Extraction¶
Available from Alation version 2024.3.2
The Snowflake OCF connector now supports the extraction of dynamic tables. The connector can now extract SQL Definition, refresh_mode, and target_lag properties for dynamic tables and display them on the Catalog page. Dynamic tables are now visible in the lineage graph to help visualize the cross-system lineage. (AL-131160)
October 30, 2024¶
Amazon Athena OCF Connector: 1.5.1¶
Enhancements¶
SDK Upgrade¶
The SDK version is now upgraded to 4.9.7 along with updates to multiple packages in JVM.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-47554, CVE-2024-9143. (AL-176849)
Amazon S3 OCF Connector: 4.0.1¶
Enhancements¶
SDK Upgrade¶
The SDK version is now upgraded to 4.9.7 along with updates to multiple packages in JVM.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-47554, CVE-2024-9143. (AL-176849)
AWS Glue OCF Connector: Version 1.3.1¶
Enhancements¶
SDK Upgrade¶
The SDK version is now upgraded to 4.9.7 along with updates to multiple packages in JVM.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-47554, CVE-2024-9143. (AL-176849)
Databricks Unity Catalog OCF Connector: Version 3.1.3¶
Enhancements¶
SDK Upgrade¶
The SDK version is now upgraded to 4.9.7 along with updates to multiple packages in JVM.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-47554, CVE-2024-9143. (AL-176849)
Fixed Issues¶
URL in Dataflow Content in Lineage Graph Displays Null for Hostname¶
The URL shown in the dataflow content in the lineage graph for navigating to the original workbook displays NULL in place of hostname for certain JDBC URIs (https://null/?o=1050xxxx#notebook/xxxx).
This issue is now resolved. (AL-172526)
Message Prompting User Action on Irrelevant Objects¶
An action message appears prompting users to apply grant access on objects that are not available or are irrelevant to the user.
This issue is resolved. Now, a warning message appears informing the users to ignore the action message if it’s not relevant. (AL-172872).
IBM Db2 OCF Connector: Version 1.2.1¶
Fixed Issues¶
Connector Fails to Extract Foreign Keys After Metadata Extraction for Certain Schemas¶
Due to trailing white spaces in schema names, the connector fails to extract foreign keys after MDE. The issue occurs as the connector wasn’t able to resolve the referenced primary key schemas due to the schema name mismatch with foreign keys.
This issue is now resolved. (AL-165840)
CHAR(xx) Column Type from DB2 Appears As VARCHAR(xx) on Alation UI¶
The Alation user interface displays the CHAR(xx) column type from DB2 as VARCHAR(xx).
This issue is now resolved. (AL-173624)
PostgreSQL OCF Connector: Version 2.0.2¶
Enhancements¶
SDK Upgrade¶
The SDK version is now upgraded to 4.9.7 along with updates to multiple packages in JVM.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-47554, CVE-2024-9143. (AL-176849)
Snowflake OCF Connector: Version 2.6.3¶
Enhancements¶
SDK Upgrade¶
The SDK version is now upgraded to 4.9.7 along with updates to multiple packages in JVM.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-47554, CVE-2024-9143. (AL-176849)
Tableau OCF Connector: Version 1.12.3¶
Enhancements¶
Improved User Experience When Handling Data Source Connection and Lineage Data¶
The Tableau OCF connector now enables you to view table or query information related to published or unpublished/embedded data sources when this information is available as part of Tableau metadata API, even when host or port information is unavailable.
In such cases, users can view lineage by linking the BI, RDBMS, or EDW data source cataloged in Alation using the Lineage Settings tab on the Tableau OCF connector Settings page. (AL-170414)
Note
Rerun lineage computation or MDE after linking the data sources.
Improved Error Handling in Tableau Metadata API Response¶
The connector will now include the request ID in the Tableau metadata API error message for the following invalid response from Tableau metadata API:
The field at path ‘/publishedDatasourcesConnection/nodes[285]/site’ was declared as a non null type, but the code involved in retrieving data has wrongly returned a null value. The graphql specification requires that the parent field be set to null, or if that is non nullable that it bubble up null to its parent and so on. The non-nullable type is ‘TableauSite’ within parent type ‘PublishedDatasource’. Parameters -> first 1000, after cursor: null. There might be missing metadata for Published Datasources.
You can use the request ID to contact the Tableau Support team to resolve this issue. (AL-176692)
Fixed Issues¶
Teradata OCF Connector: Version 1.2.1¶
Fixed Issues¶
View and Table Columns Display Incorrect Data Types Or Missing Data Types¶
The connector displays data types of some view and table columns as NA.
This issue is now resolved. (AL-127337)
October 25, 2024¶
Snowflake OCF Connector: Version 2.6.2¶
Fixed issue¶
Metadata Extraction Fails to Comply With the Schema Filter When Extracting External Tables¶
Metadata Extraction doesn’t adhere to schema filter when extracting external tables.
The issue is now resolved. (AL-146187)
October 23, 2024¶
SSRS OCF Connector: Version 1.3.1¶
Fixed Issues¶
Metadata Extraction Fails for Dataset Fields With No Field Source Name¶
Metadata Extraction fails for dataset fields for which the field source name is missing in the API response.
The issue is resolved.
Now, the connector proceeds with Metadata Extraction for dataset fields with no field source value in embedded and shared datasets. When the field source value is not provided for a dataset in SSRS, the connector extracts the field name as the field source to set the dataset field name. (AL-175404)
Workday OCF Connector: Version 23.0.9049¶
The Workday OCF Connector is now available on Connector Hub for public preview (AL-144010).
The connector is compatible with Alation version 2023.3 and higher.
Features¶
The Workday connector supports basic and OAuth authentication.
Supports features inclusive of Metadata Extraction (MDE) and Sampling and Profiling.
October 16, 2024¶
Azure Databricks OCF Connector: Version 2.0.8¶
Fixed Issues¶
Queries with Multipart Object Name Fail to Appear in QLI Query History¶
Queries with multipart object names (catalog.schema.table) do not appear in the query history.
The issue is resolved. QLI processes are now updated to remove the catalog name (hive_metastore) from each query while using file-based QLI. (AL-174378)
Azure Data Factory OCF Connector: Version 1.1.0¶
Enhancements¶
SDK Upgrade¶
The Azure Data Factory OCF connector is now upgraded to SDK version 4.8.6. (AL-175461)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462, GHSA-xpw8-rcwv-8f8p, CVE-2022-37434
Docker CIS Benchmark Compliance¶
The Azure Data Factory OCF connector version 1.1.0 and newer are now Docker CIS benchmark compliant. (AL-175461)
Databricks Unity Catalog OCF Connector: Version 3.1.1¶
Fixed Issues¶
Lineage from External Tools Fails to Appear in Lineage Extraction¶
Connector fails to extract the lineage generated from external entity types such as dbt.
The issue is now resolved (AL-164977).
Informatica PowerCenter OCF Connector: Version 1.1.0¶
Enhancements¶
SDK Upgrade¶
The Informatica PowerCenter OCF connector is now upgraded to SDK version 4.8.6. (AL-175461)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462, GHSA-xpw8-rcwv-8f8p, CVE-2022-37434
Docker CIS Benchmark Compliance¶
The Informatica Powercenter OCF connector version 1.1.0 and newer are now Docker CIS benchmark compliant. (AL-175461)
Redshift OCF Connector: Version 1.10.0¶
Enhancements¶
Support for Query Service Cancellation in Compose¶
Query Service cancellation is now enabled in Compose for Redshift OCF connector. (AL-172835)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Redshift OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-171820)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Snowflake OCF Connector: Version 2.6.0¶
Enhancements¶
Addition of Application Name in JDBC URI¶
The application name parameter is now added automatically to JDBC URI to identify Alation with the value alation. (AL-174940).
Snowflake JDBC Driver Upgrade¶
The Snowflake JDBC driver is now upgraded from 3.16.0 to 3.19.0. (AL-174940)
Fixed Issues¶
Missing Offset Value in TEST_TIMESTAMP_LTZ and TEST_TIMESTAMP_TZ Column Types¶
The offset value is missing in both TEST_TIMESTAMP_LTZ and TEST_TIMESTAMP_TZ column types.
The issue is now resolved (AL-174940).
Unable to Sample Columns with BINARY Data Type From Snowflake¶
The connector fails to sample columns with BINARY data type from Snowflake.
This issue is resolved. (AL-174940)
October 09, 2024¶
Looker OCF Connector: Version 2.1.0¶
Enhancements¶
Support for Cataloging for Explores and Looks Fields¶
Supports cataloging Explores as BI datasources and Looks fields. Each Explore is cataloged as a datasource, has its own Fields and Connections, and is available as part of lineage.
Support for Column-Level Lineage¶
Supports lineage at the column level for the following RDBMS data sources:
Amazon Redshift
MySQL
Microsoft SQL Server
Oracle
PostgreSQL
Snowflake
Note
Enable the connector setting Extract superseded (legacy) objects with type as LookML and Datasource to extract older objects that were phased out and are now embodied with Explores. These older objects will be available in catalog pages (not in lineage). By default this setting is disabled (Recommended).
(AL-164600)
PostgreSQL OCF Connector: Version 2.0.1¶
Fixed Issues¶
QLI Fails to Extract All the Queries From a single SQL Transaction¶
QLI extracts only a single query from a list of queries from an SQL transaction that has multiple SQL statements clubbed in a single SQL transaction. If custom SQL based QLI is enabled, the query will need to be updated, refer to the connector documentation for the latest custom query SQL.
This issue is now resolved. (AL-171721)
October 01, 2024¶
Add-On OCF Connector for dbt: Version 3.1.0¶
Enhancements¶
Support for Databricks Unity Catalog OCF Connector¶
Add-on connector for dbt is now supported for Databricks Unity Catalog OCF connector version 3.1.1 and higher and Alation version 2024.3.1 and higher.
It includes features such as dbt descriptions and Jinja code support in the dataflow object. (AL-167670)
Azure Databricks OCF Connector: Version 2.0.7¶
Fixed Issues¶
Queries with Multipart Object Names Fail To Generate Lineage¶
Queries with multipart object names (catalog.schema.table) fails to generate lineage after QLI.
The issue is now resolved. (AL-152839)
Note
This fix is applicable only for table-based QLI.
SSRS OCF Connector: Version 1.3.0¶
Enhancements¶
Improved Extraction Features¶
The connector now extracts dataset fields and embedded datasets that are visible in the Catalog and the Lineage graph. (AL-171523)
Support for Lineage¶
The connector now supports table-level and column-level lineage with SQL Server as the connector extracts SQL query, host and port connection information of SQL server-based datasets. This enables Alation to support lineage mapping between RDBMS tables, datasets and reports. (AL-171523)
Note
Column-level lineage is supported when the names of the RDBMS table columns, dataset and report fields names match.
September 25, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.5.0¶
Support for Cross-System Lineage¶
The connector now supports cross-system lineage between:
Azure Power BI and Snowflake for parameters of the format
&@Database_Name&in the dataset mashup expression. (AL-172707)For information on expressions supported by lineage, see the Expressions Supported by Lineage section in Configure Lineage.
Azure Power BI and SQL server when the table information is part of Filtered Rows in the dataset mashup expression. (AL-154346)
September 18, 2024¶
FIPS Compliance¶
The following connectors are now FIPS compliant:
Amazon S3 OCF Connector: Version 4.0.0
Athena OCF Connector: Version 1.5.0
AWS Glue OCF Connector: Version 1.3.0
Databricks Unity Catalog OCF Connector: Version 3.1.0
PostgreSQL OCF Connector: Version 2.0.0
Snowflake OCF Connector: Version 2.5.0
The JDK for these connectors is now upgraded to Temurin-11.0.24+8. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-45490, CVE-2024-45491, CVE-2024-45492, CVE-2024-6119
Azure Synapse Analytics OCF Connector: Version 1.3.0¶
Enhancements¶
Improved Error Messages¶
The error messages have now been enhanced for clarity around scenarios such as invalid connections (host, port, or URI) and credential-related errors. (AL-166830)
Salesforce OCF Connector Version Downgrade¶
Alation released a downgraded version (23.0.8942) of the Salesforce OCF connector to address specific issues. The connector version 23.0.8994 is no longer available for download on Connector Hub. The changes introduced in connector version 23.0.8994 have been reverted.
September 11, 2024¶
Informatica CDI OCF Connector: Version 2.0.2¶
The Informatica CDI OCF Connector is now available on Connector Hub for public preview (AL-143291).
The connector is compatible with Alation version 2023.1 and higher.
Features¶
The Informatica CDI connector supports the basic authentication.
The Informatica CDI connector supports features inclusive of Metadata Extraction (MDE) and Lineage.
Tableau OCF Connector: Version 1.11.0¶
Enhancements¶
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-4741, CVE-2024-5535, CVE-2020-13956, CVE-2019-17571, CVE-2022-23305, CVE-2022-23307, CVE-2021-4104, CVE-2022-23302 (AL-131042)
Fixed Issues¶
Cross-System Lineage Missing for Hive and Oracle-Based Datasources¶
In the Tableau OCF connector, cross-system Lineage is unavailable for Hive and Oracle-based data sources.
This issue is now resolved. (AL-162504)
Important
This fix is available from Alation version 2024.1.3.
September 05, 2024¶
Talend OCF Connector: Version 2.1.0¶
Enhancements¶
Support for Column Level Lineage¶
Talend OCF connector now supports column-level lineage. (AL-163510)
Support for Direct Connection to Talend¶
Talend OCF connector now supports direct connection to Talend. This eliminates the dependency on any code repository software. (AL-163509)
Fixed Issues¶
MDE Job Fails for Incomplete Talend Jobs¶
In Talend OCF connector version 2.0.1, incomplete Talend Jobs result in MDE failure
The issue is now resolved. (AL-167269)
September 04, 2024¶
Add-On OCF Connector for dbt: Version 3.0.12¶
Fixed Issues¶
Metadata Extraction Fails for Large Manifest Files for dbt Core¶
When using dbt core with GitHub, if the manifest file size is more than 100MB, MDE fails.
The issue is now resolved. (AL-167304)
Azure Power BI Scanner OCF Connector: Version 2.4.1¶
Enhancements¶
Improved UI Text¶
The UI text for the Extract all workspaces from Azure Power BI option in the Connector Settings section in the user interface is now improved for better clarity around selective extraction. (AL-170777)
Databricks Unity Catalog OCF Connector: Version 3.0.1¶
Fixed Issues¶
Query Log Ingestion Fails for Empty QueryText¶
Query Log Ingestion Fails with the following error for empty or NULL QueryText:
Query text is missing in the query statement. Ensure that queryString column has data.
This issue is now resolved. (AL-169062)
Unable to Extract Struct Definitions for Columns of Struct Data Type¶
The connector fails to extract the struct definitions for Columns of Struct data type.
This issue is now resolved. (AL-166865)
August 28, 2024¶
OCF Connector Key Highlights¶
The following connectors are now upgraded to SDK version 4.8.16, JDK Temurin-11.0.23+9m, and have support for authentication based on AWS Secret Manager Credentials:
PostgreSQL OCF connector version 1.3.0
SAS Base OCF connector version 1.2.0
Oracle OCF connector version 1.8.0
IBM Db2 OCF connector version 1.2.0
Impala on CDP OCF connector version 2.2.0
SAP BusinessObjects OCF connector version 1.3.0
Tableau OCF connector version 1.10.0
Azure Power BI Scanner OCF connector version 2.4.0
Denodo OCF connector version 1.4.0
Amazon S3 OCF connector version 3.11.0
Amazon Athena OCF connector version 1.4.0
Snowflake OCF connector version 2.4.4
AWS Glue OCF connector version 1.2.0
AWS Glue OCF Connector: Version 1.2.0¶
Enhancements¶
SDK Upgrade¶
The AWS Glue OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-165682)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918. (AL-165682)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the AWS Glue OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-165682)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Docker CIS Benchmark Compliance¶
AWS Glue OCF connector versions 1.2.0 and newer are now compliant with the following Docker CIS benchmarks (AL-165682):
Docker 4.1 Ensure that a user for the container has been created
Docker 4.6 Ensure that HEALTHCHECK instructions have been added to container images
Docker 4.7 Ensure update instructions are not used alone in Dockerfiles
Fixed Issues¶
The Get List of Schemas Fails to Display Results for Restricted IAM Policy¶
If there is a restricting IAM policy over resources (databases), selecting the Get List of Schemas option did not show any results. (AL-163533)
Azure Power BI Scanner OCF Connector: Version 2.4.0¶
Enhancements¶
Improved Workspaces Metadata Extraction¶
The connector now includes the Extract all the workspaces from Azure Power BI option under the Customize additional extraction scope section of the Metadata Extraction tab.
When Extract all the workspaces from Azure Power BI toggle is turned off, only those workspaces accessible to the service principal configured, will be extracted. This is the default behavior.
When the Extract all the workspaces from Azure Power BI toggle is turned on, all the workspaces from the Azure Power BI will be extracted, irrespective of the service principal’s access. (AL-168903)
Note
If you’ve previously configured the connector to extract all workspaces, then upon upgrading to version 2.4.0, Alation will automatically enable the new setting to continue extracting all workspaces, ensuring a seamless transition.
If you’ve previously selected specific workspaces for extraction, Alation will honor your existing selections.
Support for Lineage With Redshift Native Query-Based Datasets¶
The connector now supports lineage with Redshift native query-based datasets. For details, see the Expressions Supported by Lineage section in Configure Lineage. (AL-168903)
Support for Lineage With Snowflake-Based Datasets¶
The connector now supports lineage with Snowflake-based datasets. For details, see the Expressions Supported by Lineage section in Configure Lineage. (AL-168903)
SDK Upgrade¶
The Azure Power BI Scanner OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-168903)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918. (AL-168903)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Azure Power BI Scanner OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-168903)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Denodo OCF Connector: Version 1.4.0¶
Enhancements¶
SDK Upgrade¶
The Denodo OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-169166)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918. (AL-169166)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Denodo OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-169861)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Impala on CDP OCF Connector: Version 2.2.0¶
Enhancements¶
SDK Upgrade¶
The Impala on CDP OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-161109)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025,` CVE-2021-21295`, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following CVEs: CVE-2024-20952 and CVE-2023-20918. (AL-161109)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Impala on CDP OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-161109)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
MongoDB OCF Connector: Version 23.0.9005¶
Enhancements¶
SDK Upgrade¶
The MongoDB OCF connector is now upgraded to SDK version 4.8.6. (AL-165684)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462, GHSA-xpw8-rcwv-8f8p, CVE-2022-37434
Docker CIS Benchmark Compliance¶
The MongoDB OCF connector version 23.0.9005 and newer are now Docker CIS benchmark compliant. (AL-165684)
Docker 4.1 Ensure that a user for the container has been created
Docker 4.6 Ensure that HEALTHCHECK instructions have been added to container images
Docker 4.7 Ensure update instructions are not used alone in Dockerfiles
Support for Compose¶
MongoDB OCF connector now Compose. You can configure the use of Compose with your MongoDB OCF connector (AL-156819).
Known Issues¶
Unable to Upload New Tables Using Compose¶
The Upload New Table feature using Compose isn’t working. (AL-170197).
SAP BusinessObjects OCF Connector: Version 1.3.0¶
Enhancements¶
SDK Upgrade¶
The SAP BusinessObjects OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-169861)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025,` CVE-2021-21295`, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following CVEs: CVE-2024-20952 and CVE-2023-20918 (AL-169861)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the SAP BusinessObjects OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-169861)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
August 21, 2024¶
Amazon Athena OCF Connector: Version 1.4.1¶
Fixed Issues¶
Failure to Parse the Extracted Queries¶
The query parser does not parse the queries extracted by the connector.
This issue is resolved. (AL-167009)
Amazon S3 OCF Connector: Version 3.11.0¶
Enhancements¶
SDK Upgrade¶
The Amazon S3 OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-166118)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918 (AL-166118)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Amazon S3 OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-166118)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Snowflake OCF Connector: Version 2.4.5¶
Enhancements¶
Update to Function Definition Extraction to Skip Redundant Errors in Snowflake Instance¶
Alation has now updated the function definition extraction logic to avoid redundant errors in your Snowflake instance.
There is no change or impact to the function definition extraction outcome. (AL-163439, AL-165803)
Tableau OCF Connector: Version 1.10.0¶
Enhancements¶
SDK Upgrade¶
The Tableau OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-160913)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918. (AL-160913)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Tableau OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-160913)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
August 14, 2024¶
Amazon Athena OCF Connector: Version 1.4.0¶
Enhancements¶
SDK Upgrade¶
The Amazon Athena OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-167429)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025,` CVE-2021-21295`, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following CVEs: CVE-2024-20952 and CVE-2023-20918 (AL-166113)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Amazon Athena OCF connector now supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector.
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Azure Data Factory OCF Connector Version 1.0.0¶
The Azure Data Factory (ADF) OCF Connector is now available on Connector Hub for public preview (AL-131814).
The connector is compatible with Alation version 2024.1 and higher.
Features¶
The ADF connector supports the OAuth authentication method.
Supports features inclusive of Metadata Extraction (MDE) and Lineage.
Databricks Unity Catalog OCF Connector: Version 3.0.0¶
Enhancements¶
Databricks Unity Catalog OCF Connector 3.0.0 supports the following features:
Information Schema-Based Extraction¶
The connector now extracts metadata from information_schema instead of using driver based methods.
Custom MDE¶
The following Metadata types are supported as part of Custom MDE:
Catalog
Schema
Table
View
Column
Primary Key
Foreign Key
Table Source Comments Extraction¶
The connector now supports both table and column source comments.
For more information, see Databricks Unity Catalog OCF Connector
IBM Db2 OCF Connector: Version 1.2.0¶
Enhancements¶
SDK Upgrade¶
The IBM Db2 OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-161107)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following CVEs: CVE-2024-20952 and CVE-2023-20918 (AL-166114)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the IBM Db2 OCF connector now supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-166114)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Kafka OCF Connector: Version 23.0.8991¶
Enhancements¶
SDK Upgrade¶
The Kafka OCF connector is now upgraded to SDK version 4.8.6.
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462, GHSA-xpw8-rcwv-8f8p.
Docker CIS Benchmark Compliance¶
Kafka OCF connector version 23.0.8991 and newer are now Docker CIS benchmark compliant. (AL-165684)
Fixed Issues¶
Metadata Extraction Fails¶
Metadata Extraction fails due to Java Heap Error.
The issue is now fixed. (AL-168054)
Oracle OCF Connector: Version 1.8.0¶
Enhancements¶
SDK Upgrade¶
The Oracle OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-1661108)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025,` CVE-2021-21295`, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9.
This upgrade addresses the following CVEs: CVE-2024-20952 and CVE-2023-20918
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Oracle OCF connector now supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see AWS Secrets Manager for Data Source Authentication Using OCF Connector.
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Fixed Issues¶
QLI Preflight Check Fails for Custom Queries with No Rows¶
The QLI preflight check fails if the customer query contains no rows.
The issue is now fixed. (AL-156722)
Qlik Sense OCF Connector: Version 1.2.19¶
Enhancements¶
Log4j Upgrade¶
An update to the pom.xml file has been made to ensure the use of Log4j version 2.22.1. This update further reinforces the connector’s security posture. (AL-148140)
August 08, 2024¶
Snowflake OCF Connector: Version 2.4.4¶
Enhancements¶
SDK Upgrade¶
The Snowflake OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-162276)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2021-22569 , CVE-2020-8908, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445 , CVE-20
OpenJDK Upgrade to Address CVEs¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918 (AL-162276)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the Snowflake OCF connector now supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-162276)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Fixed Issues¶
Incorrect Display of Table Row Count¶
In table sampling, when the max rows to store is set to 0, table row count was appearing to be 0 instead of the actual count.
This issue is fixed now. (AL-162276)
August 07, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.3.3¶
Fixed Issues¶
Unable to View Cross-System Lineage with Snowflake¶
Unable to view cross-system lineage with Snowflake when using a dataset query containing the following attributes:
Multiline query
Comments
Multiple spaces
Double double quotes for column alias
This issue is now fixed. (AL-153785, AL-160777)
SAS Base OCF Connector: Version 1.2.0¶
Enhancements¶
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, this connector now supports authenticating with credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-161111)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
OpenJDK Upgrade to Address CVEs¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918 (AL-162276)
SDK Upgrade¶
SAS OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-133409)
This SDK upgrade fixed the following issues:
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462, GHSA-xpw8-rcwv-8f8p.
Tableau OCF Connector: Version 1.9.5¶
Enhancements¶
View Connection Metadata for Excel Sheet-Based Data Sources From Onedrive¶
You can now view the connection metadata on Alation for data sources based on Excel sheet embedded from Onedrive. (AL-165743)
Fixed Issues¶
Project Deletion During Metadata Extraction¶
Projects get deleted from Alation during metadata extraction as Tableau fails to return the metadata due to the Tableau metadata API timeout issue. For more information on this issue, see Help Center Page.
The connector now handles the timeout errors in the Tableau Metadata API to reduce the impact and prevent deletion of the cataloged metadata.
The connector now captures the timeout issue as part of the error report (available for download in the Job Details). (AL-164024)
Important
This change will not restore the objects that may have been removed due to a timeout error in the Tableau Metadata API prior to upgrading to this version.
July 31, 2024¶
PostgreSQL OCF Connector: Version 1.3.0¶
Enhancements¶
SDK Upgrade¶
The PostgreSQL OCF connector is now upgraded to the latest SDK version 4.8.16. (AL-164544)
This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs):
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025,` CVE-2021-21295`, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
OpenJDK Upgrade¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following CVEs: CVE-2024-20952 and CVE-2023-20918 (AL-164544)
Support for Authentication Based on AWS Secret Manager Credentials¶
When installed on an Alation Agent, the PostgreSQL OCF connector supports authentication using credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-164544)
Note
Support for authentication based on AWS Secret Manager is available for all installations (on-premise and Alation Cloud Service), however, integrating with AWS Secrets Manager through an Alation Agent applies only to cloud native architecture.
Starburst Enterprise (Trino) OCF Connector: Version 1.4.1¶
Enhancements¶
SDK Upgrade¶
Starburst Enterprise (Trino) OCF connector is now upgraded to the latest SDK version 4.8.13. (AL-133409)
This SDK upgrade fixed the following issues:
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
Fixed Issues¶
QLI History Was Showing Future Execution Dates¶
The query history was showing execution dates from the future.
The issue is now fixed. (AL-132190)
SQL Server OCF Connector: Version 1.7.0¶
Enhancements¶
SDK Upgrade¶
SQL Server OCF connector is now upgraded to the latest SDK version 4.8.15. (AL-166112)
This SDK upgrade fixed the following issues:
CVE-2022-25647, CVE-2023-2976, CVE-2020-8908, CVE-2021-22569, CVE-2021-22570, CVE-2022-3509, CVE-2022-3510, CVE-2022-3171, CVE-2021-29425, CVE-2021-37136, CVE-2021-37137, CVE-2019-20444, CVE-2021-21290, CVE-2021-43797, CVE-2022-24823, CVE-2024-29025, CVE-2021-21295, CVE-2021-21409, CVE-2020-11612, CVE-2019-20445, CVE-2023-34462
Fixed Issues¶
Incorrect Length of characters/digits for the Nchar, Nvarchar, Decimal and Numerical columns¶
Incorrect length of characters/digits for the Nchar, Nvarchar, Decimal and Numerical columns.
The issue is now fixed. (AL-162572)
Informatica PowerCenter OCF Connector: Version 1.0.0¶
The Informatica PowerCenter OCF Connector is now available on Connector Hub (AL-172909). The connector is compatible with Alation version 2023.3 and higher.
The documentation for the Informatica PowerCenter OCF Connector is available at: Informatica PowerCenter OCF Connector (Public Preview).
Features¶
The Informatica PowerCenter connector supports the basic authentication method.
Supports features inclusive of Metadata Extraction (MDE) and Lineage.
July 24, 2024¶
Amazon S3 OCF Connector: Version 3.10.2¶
Enhancements¶
Support for Connection Via AWS Private Link¶
You can now connect to Amazon S3 via a private link within the same region. You can provide a private link in the General Settings tab to access buckets configured using private links. (AL-96304)
For more information, see Amazon S3 OCF Connector.
Starburst Trino OCF Connector: Version 1.4.0¶
Enhancements¶
OpenJDK Upgrade to Address CVEs¶
The JDK is now upgraded to Temurin-11.0.23+9. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2024-20952 and CVE-2023-20918. (AL-163177)
TIBCO Spotfire: Version 2.1.0¶
Enhancements¶
TIBCO Spotfire OCF Connector supports (AL-164298):
Folder Level Permissions for Extraction
Users can now grant permission to access the parent folder and its subfolders, including the root folder, for extraction.
DXP Based on MultiSource
TIBCO Spotfire now supports extraction of DXP reports based on multisource (SBDF, IL, CSV, XLS, Text, and Database) and SPDF reports as BI reports.
Filter Extraction
TIBCO Spotfire now supports selection of projects for extraction (selective extraction).
Fixed Issues¶
TIBCO Spotfire Server Accepts IP Addresses as URI¶
TIBCO Spotfire Server accepts only an IP Address in the JDBC URI field.
The issue is now fixed. The connector now accepts hostname and port as part of the JDBC URI. (AL-154341)
Unable to Use the Open with BI Server Functionality¶
The Open with Server BI button on the UI for the TIBCO Spotfire connector works only at the top-most level (BI Server); at lower levels, it maps to incorrect URLs.
The issue is now fixed. (AL-160748)
Metadata Extraction Fails After Granting Permission to New Folders¶
After granting permissions to access new folders for extraction, MDE fails with the following error: Error Fetching Data from Tibco SPOTFIRE
The issue is now resolved. (AL-162672)
July 19, 2024¶
SQL Server OCF Connector: Version 1.6.2¶
Enhancements¶
Applies only to Alation Cloud Service on the cloud native architecture
When installed on an Alation Agent, this connector now supports authenticating with credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-159572)
SDK Upgrade¶
SQL Server OCF connector is now upgraded to SDK version 4.8.5. (AL-159572)
July 17, 2024¶
Databricks Unity Catalog (UC) OCF Connector: Version 2.3.1¶
Enhancements¶
Google Cloud Platform Certification¶
Databricks UC connector is now Google Cloud Platform (GCP) certified. (AL-145462)
Hive OCF Connector: Version 1.2.2¶
Enhancements¶
OpenJDK Upgrade to Address CVEs¶
The JDK is now upgraded to OpenJDK8u412. This upgrade addresses the following Common Vulnerabilities and Exposures (CVEs): CVE-2023-22067 and CVE-2023-41993. (AL-150899)
Qlik Sense OCF Connector: Version 1.2.18¶
Enhancements¶
Log4j Upgrade¶
An update to the pom.xml file has been made to ensure the use of Log4j version 2.22.1. This change complements the previous update, which packaged the QlikSense OCF connector with OCF SDK 4.8.6 containing updated Log4j versions. This update reinforces the connector’s security posture. (AL-148140)
TIBCO Data Virtualization OCF Connector: Version 3.0¶
Enhancements¶
Support for Schema and Catalog Customization¶
TIBCO Data Virtualization OCF connector now supports customization of Catalog and Schema values appearing on the Alation Catalog pages. (AL-163561)
Ensure that you include the following parameters in the JDBC URI enable customization of Catalog and Schema:
DefaultTDVCatalog=TestTDV;
DefaultTDVSchema=TestSchema;
July 10, 2024¶
Add-On OCF Connector for dbt: Version 3.0.11¶
Fixed Issues¶
Dependency Used in the Connector Logs Sensitive Information in Plain Text¶
When the log levels are set to DEBUG, one of the dependencies used in the connector logs sensitive information in plain text.
The issue is now fixed. (AL-162861)
Amazon Redshift OCF Connector: Version 1.9.0¶
Enhancements¶
Support for Redshift Serverless Instances¶
Alation has now certified the Redshift OCF connector for Redshift serverless instances. (AL-156721)
MicroStrategy OCF Connector: 1.1.1¶
Fixed Issues¶
Out of Memory Errors Due to Incorrect Parsing of Dataset Parameter Expressions¶
Since the connector extracts object permissions in batches, Metadata Extraction results in out-of-memory errors during permission extraction.
The issue is fixed. (AL-149132)
SAP BusinessObjects OCF Connector: Version 1.2.2¶
Fixed Issues¶
Dependency Used in the Connector Logs Sensitive Information in Plain Text¶
When the log levels are set to DEBUG, one of the dependencies used in the connector logs sensitive information in plain text.
The issue is now fixed. (AL-149210)
SSRS OCF Connector: Version 1.2.3¶
Fixed Issues¶
Metadata Extraction Fails¶
Metadata Extraction fails when there are any skippable errors during extraction.
This issue is fixed. Now, the connector skips such errors and continues with the extraction to ensure maximum objects are extracted and cataloged. (AL-156584).
July 03, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.3.0¶
Enhancements¶
With Alation version 2024.1.4 and Azure Power BI Scanner OCF connector version 2.3.0. Alation has introduced an enhanced user interface for configuring the Azure Power BI Scanner OCF data source settings.
Note
The connector version is compatible with Alation versions 2023.3.2 or higher. However, you will view the old user interface with Alation versions prior to 2024.1.4
The documentation for the new Azure Power BI Scanner OCF experience is available at : Azure Power BI Scanner OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Power BI Scanner OCF user interface provides better navigation and multiple visual cues, making it easy to configure and manage Power BI Scanner OCF data source.
There is an exclusive tab to configure Metadata Extraction.
Easy to Connect¶
The Power BI ScannerOCF user interface now provides a step-by-step process to connect to your Power BI Scanner OCF data source easily and quickly.
Additional Error-Prevention Checks¶
The Power BI Scanner OCF user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Power BI Scanner OCF user interface makes troubleshooting easier for metadata extraction, as you can now have a detailed error report. The report contains a detailed error description and steps to resolve the issue. (AL-136714)
Databricks Unity Catalog OCF Connector: Version 2.3.1¶
Enhancements¶
Applies only to Alation Cloud Service on the cloud native architecture
When installed on an Alation Agent, this connector now supports authenticating with credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-160374)
Fixed Issues¶
MDE Skips Nested STRUCT Type Column Extraction¶
MDE skips extracting columns with nested STRUCT type.
This issue is fixed. (AL-140807).
Qlik Sense OCF Connector: Version 1.2.17¶
Enhancements¶
Log4j Upgrade¶
The Log4j version is now upgraded to 2.20. This upgrade addresses some of the security vulnerabilities. (AL-148140)
June 26, 2024¶
Add-On OCF Connector for dbt: Version 3.0.10¶
Fixed Issues¶
Metadata Extraction Fails When SQL Text Exceeds 5 Million Characters¶
Metadata Extraction fails if SQL text characters exceed 5 million in count.
The issue is fixed. The maximum character limit is now updated to 20 million. (AL-160970)
Snowflake OCF Connector: Version 2.4.3¶
Enhancements¶
Applies only to Alation Cloud Service on the cloud native architecture
When installed on an Alation Agent, this connector now supports authenticating with credentials the Agent has fetched from AWS Secrets Manager. For more information, see Integration with AWS Secrets Manager for Data Source Authentication Using OCF Connector. (AL-159538)
Fixed Issues¶
MDE Extracts Schemas Outside the Selected Scope for Selective Extraction¶
In Snowflake OCF connector version 2.0.0 and higher, the MDE also extracts schemas outside the inclusion scope when selective extraction is enabled.
The issue is now fixed. (AL-156145)
Salesforce OCF Connector: Version 23.0.8942¶
Enhancements¶
Support for SSL Authentication¶
Salesforce OCF connector now supports SSL authentication for secure connectivity. (AL-154473)
Support for Compose¶
Salesforce OCF connector now Compose. You can configure the use of Compose with your Salesforce OCF connector. (AL-156819)
SDK Upgrade¶
Salesforce OCF connector is now upgraded to the latest SDK version 4.8.6. (AL-161059)
June 19, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.2.4¶
Enhancements¶
Support for Extraction By Service Principal¶
The connector will now extract the metadata only from the workspaces to which the Azure Service Principal configured in the Connector Settings tab has access.
Refer to the community post to learn how this change could potentially impact your cataloged objects and what actions you could take to keep them cataloged in Alation.
The Enable Extraction For Service Principal option is no longer available in the Connector Settings section of General Settings tab as Metadata Extraction, by default, is supported only for Service Principal. (AL-154041)
Fixed Issues¶
Connector Fails to Populate the Cross-System Lineage When Using Parameter and Query-Based PowerBI Datasets¶
The connector fails to display the cross-system lineage due to the following issues:
Improper parsing of double quotes in queries: The connector fails to extract connection information from dataset expressions that contain double quotes in the table, schema, or database name.(AL-157978)
Unable to display the database name in the Connections tab of the PowerBI dataset: The connector fails to extract connection information when using M Query expressions in datasets and dataflows with blank spaces before the parameters.
For example:
let Source = Sql.Database(SourceServerName, SourceDBName)(AL-160724)
June 12, 2024¶
Amazon S3 OCF Connector: Version 3.9.3¶
Enhancements¶
Support for Custom Inventory Folder Name During Inventory Configuration¶
You can now provide a custom inventory folder name while configuring the inventory. Earlier, the connector didn’t allow metadata extraction in an existing bucket without the folder named inventory within the destination bucket.
You can provide the inventory bucket name or path in the Provide inventory bucket or path section of the Metadata Extraction tab. (AL-156991)
Impala on CDP OCF Connector: Version 2.1.3¶
Fixed Issues¶
Connector Uses Incorrect URL for Dynamic Sampling & Profiling¶
The connector uses the MDE JDBC connection URL provided in the General Settings tab instead of the URL configured in the Connection Settings section under the Column Profiling and Sampling tab or the connection URL specified in Compose.
The issue is fixed. (AL-156451)
MDE Fails for Multiple Data Sources with Kerberos-Based Metastore Authentication¶
If there are multiple data sources with Kerberos-based Metastore authentication running on the connector, MDE fails.
Note
This is applicable only for Alation on-premise.
This issue is fixed. (AL-152665)
SAP BusinessObjects OCF Connector: Version 1.2.1¶
Enhancements¶
Support for Cross System Table-Level Lineage for Reports Based on Universe with Default Context¶
You can now view the cross-system table-level lineage for reports created using data providers based on Universe with context that has default values. (AL-99876, AL-144443)
June 05, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.2.3¶
Enhancements¶
Support for Enabling and Disabling Report Field Extraction¶
The Azure PowerBI Scanner OCF connector now includes the Enable Report Fields Extraction option under the General Settings tab. This configuration allows data source admins to enable or disable the report field extraction. (AL-159408)
Note
The report field extraction could increase the overall MDE time depending on Azure Power BI API performance.
Fixed Issues¶
Metadata Extraction Fails Even for A Valid Token¶
MDE fails when the Power BI API incorrectly returns a 403 HTTP status code in the error response, even if the token has not expired.
Now, the MDE proceeds for a valid token. The connector will now rely upon the error code in the response body along with the HTTP status code in the Power BI API response. (AL-156098).
Fivetran OCF Connector: Version 2.0.7¶
Enhancements¶
Support for SQL Server¶
If the Fivetran API doesn’t return the host and port for a destination, the Fivetran OCF connector reads the agent_host and agent_port. For example, the SQL Server is configured on the High-Volume Agent. (AL-157861)
Tableau OCF Connector: Version 1.9.2¶
Fixed Issues¶
Metadata Extraction Fails for Site ID Provided in Upper Case¶
While connecting to the Tableau cloud, if the Site ID provided in the Connector Settings section of the General Settings tab is not in lower case, then MDE fails for the Tableau OCF connector version 1.9.0 and higher.
Now, the connector ignores case sensitivity for Site ID and proceeds with MDE. (AL-159423)
May 29, 2024¶
Google BigQuery OCF Connector: Version 1.3.4¶
Fixed Issues¶
Connector Displays a NullPointerException for Policy Violation Exception¶
When extracting error messages due to a policy violation, the connector displays a NullPointerException instead of a proper error message.
Now, a proper error message with description and hint is displayed in the connector user interface. (AL-157243)
May 22, 2024¶
Amazon S3 OCF Connector: Version 3.9.2¶
Enhancements¶
Important
The following features are available from the upcoming Alation version 2024.1.3.
Support for Volume Check¶
The volume check feature enables users to make informed decisions by providing insights into the volume of files within each Amazon S3 (Simple Storage Service) bucket before ingestion into the data catalog. (AL-144291)
Column Extraction Redesign¶
Alation has introduced a separate tab to run column extraction under the Metadata Extraction tab. This allows file extraction and column extraction to be separated, providing a complete focus on each. (AL-144291)
Looker OCF Connector: Version 2.0.2¶
Enhancements¶
Update to Looker API¶
As per of the notice from Looker, Alation has updated the query_id in the GET /queries/<query_id> API now uses a slug value instead of a numeric value. (AL-147590)
Note
There are no impacts to any of the features supported by the Looker OCF Connector.
Tableau OCF Connector: Version 1.9.1¶
Fixed Issues¶
Metadata Extraction Performance Issues¶
Metadata Extraction of Datasource, Reports, and Dashboard fields takes a long time to complete.
The issue is now fixed. (AL-156359, AL-156150)
May 15, 2024¶
Add-On OCF Connector for dbt: Version 3.0.9¶
Fixed Issues¶
Test Connection Error Message and Warnings Update¶
Updated the test connection error message and warnings to use raw GitHub URL when using Github for dbt Core.
The issue is fixed now. (AL-156563)
Talend OCF Connector: Version 1.0.0¶
The Talend DB OCF Connector is now available on Connector Hub (AL-143292). The connector is compatible with Talend database version 8.0.1 and Alation version 2023.3 and higher.
The documentation for the Talend OCF Connector is available at: Talend OCF Connector.
Features¶
The Talend connector supports the OAuth authentication method.
Supports features inclusive of Metadata Extraction (MDE) and Lineage.
May 08, 2024¶
Azure Power BI Scanner OCF Connector: Version 2.2.1¶
Fixed Issues¶
Lineage Gaps Between Power BI and Snowflake¶
Lineage gaps between Power BI and Snowflake due the following issues has now been fixed (AL-148070, AL-147313):
Table names containing a period (“.”).
Reserved keywords used as parameters. For example,
ServerandDatabase.
Lineage Gaps Between Power BI and SQL Server¶
There are lineage gaps in Power BI connector and SQL Server due to issues related to reserved keywords used as parameters, for example, Database.
The issue is fixed now. (AL-124119)
Out of Memory Errors Due to Incorrect Parsing of Dataset Parameter Expressions¶
Metadata Extraction resulted in out-of-memory errors due to incorrect replacement of integers in dataset expressions when integers are used as parameters.
This issue is now fixed. (AL-143205)
April 29, 2024¶
Google BigQuery OCF Connector: Version 1.3.3¶
Fixed Issues¶
Connector Fails to Extract BigQuery Source Comments for Struct and Record Column Types¶
Google BigQuery OCF connector fails to extract BigQuery parent source comments for Struct and Record Column Types.
The issue is fixed. You can now view the BigQuery parent source comments along with child source comments. (AL-152786)
Snowflake OCF Connector: Version 2.3.4¶
Fixed Issues¶
Tag Sync Feature Fails to Use OAuth Authentication¶
The Snowflake OCF connector doesn’t use OAuth authentication to sync the tags with Snowflake. Instead, it uses the service account to connect.
The issue is fixed. Now, the Tag Sync and Policy Sync features use an OAuth connection. (AL-152797, AL-153738)
Important
This fix will be available with Alation version 2024.1.2 onwards.
SQL Server OCF Connector: Version 1.5.1¶
Fixed Issues¶
Deleted Objects Appear During Metadata Extraction¶
Deleted objects such as Tables appear on the catalog page when you re-run Metadata Extraction.
This issue is fixed. Now, the deleted objects do not appear on the Catalog page. (AL-155084)
April 24, 2024¶
Azure Cosmos DB OCF Connector: Version 23.0.8878¶
The Azure Cosmos DB OCF Connector is now available on Connector Hub. (AL-144006)
The documentation for the Azure Cosmos DB OCF Connector is available at : Azure Cosmos DB OCF Connector.
Features¶
The Azure Cosmos DB connector supports various authentication methods including Account Key and Azure Service Principal.
The connector is compatible with Azure Cosmos DB database version 23.0.0.8866 and Alation version 2023.3 and newer.
Supports features inclusive of Metadata Extraction (MDE), sampling and profiling.
Databricks Unity Catalog OCF Connector: Version 2.2.2¶
Fixed Issues¶
Databricks Lineage Extraction Issues¶
Databricks lineage extraction fails when the column names are empty.
Databricks lineage extraction results in cyclic lineage.
Databricks lineage extraction job completes successfully even with empty Dataflow content.
Now, the issues are fixed. The Lineage extraction query is now updated to filter cyclic lineage, null entity types, empty and null table and column names. (AL-141050, AL-140061, AL-135348)
Microsoft SQL Server Analysis Services OCF Connector: Version 23.0.8866¶
SQL Server Analysis Service from Microsoft provides semantic data models for business reports and client applications such as PowerBI, Excel and data visualization tools. Within Alation we catalog SQL Server Analysis Service (SSAS) metadata as an RDBMS Datasource.
The SSAS OCF Connector is now available on Connector Hub. (AL-146586)
The documentation for the SQL Server Analysis Services OCF Connector is available at : SQL Server Analysis Services OCF Connector.
Features¶
The SSAS connector supports various authentication methods including Basic, NTLM, Digest, Kerberos, and SSL.
The connector is compatible with SSAS database version 23.0.0.8866 and Alation version 2023.3 and newer.
Supports features inclusive of Metadata Extraction (MDE), sampling and profiling.
ServiceNow OCF Connector: Version 23.0.8866¶
The ServiceNow OCF Connector is now available on Connector Hub. (AL-144006)
The documentation for the ServiceNow OCF Connector is available at : ServiceNow OCF Connector.
Features¶
The ServiceNow connector supports various authentication methods including Basic, OAuth with password and SSL.
The connector is compatible with ServiceNow database version 23.0.0.8866 and Alation version 2023.3 and newer.
Supports features inclusive of Metadata Extraction (MDE), sampling and profiling.
Tableau OCF Connector: Version 1.9.0¶
Enhancements¶
With Alation version 2024.1.2 and Tableau OCF connector version 1.9.0, Alation has introduced an enhanced user interface for configuring the Tableau OCF data source settings.
Note
The connector version is compatible with Alation versions prior to 2024.1.2. However, you will view the old user interface with Alation versions prior to 2024.1.2
The documentation for the new Tableau OCF experience is available at : Tableau OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Tableau user interface provides better navigation and multiple visual cues, making it easy to configure and manage Tableau data source.
Easy to Connect¶
The Tableau user interface now provides a step-by-step process to connect to your Tableau data source easily and quickly.
Additional Error-Prevention Checks¶
The Tableau user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Tableau user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue. (AL-139399)
Improved NODE_LIMIT_EXCEEDED Error Handling¶
The improved Tableau OCF connector reduces the possibility of encountering the NODE_LIMIT_EXCEEDED error.
Note
If you continue to encounter the NODE_LIMIT_EXCEEDED error, Alation recommends that you increase the Node limit on Tableau.
April 17, 2024¶
Add-On OCF Connector for dbt: Version 3.0.8¶
Fixed Issues¶
Metadata Extraction Fails When dbt Fails to Return the Compiled Code¶
Metadata Extraction on a Snowflake data source with add-on connector for dbt enabled results in the following error when the compiled SQL is empty:
Error while streaming direct lineage : content is required to build a dataflow.
If the compiled SQL is empty for a job, the connector now logs a warning and marks the node as invalid and allows the Metadata Extraction to continue. (AL-147412)
Azure Power BI Scanner OCF Connector: Version 2.2.0¶
Enhancements¶
Support for Power BI Column-Level Lineage¶
Column-level lineage is available for reports created from table-based datasets and dataflows starting in Alation version 2024.1.2.
Fixed Issues¶
Lineage Not Visible for Datasets Created from Dataflows in Different Workspace¶
Lineage fails for datasets created from a dataflow present in a different workspace. (AL-149160, AL-141424)
MongoDB OCF Connector: Version 23.0.8867¶
Enhancements¶
Support for SSL Authentication¶
MongoDB OCF connector now supports SSL authentication for secure connectivity. (AL-149342)
SQL Server OCF Connector: Version 1.5.0¶
Enhancements¶
With Alation version 2024.1 and SQL Server OCF connector version 1.5.0, Alation has introduced an enhanced user interface for configuring the SQL Server data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.4. However, you will view the old user interface with Alation versions prior to 2024.1.
The documentation for the new SQL Server experience is available at : SQL Server OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced SQL Server user interface provides better navigation and multiple visual cues, making it easy to configure and manage SQL Server data source.
Easy to Connect¶
The SQL Server user interface now provides a step-by-step process to connect to your SQL Server data source easily and quickly.
Additional Error-Prevention Checks¶
The SQL Server user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved SQL Server user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue. (AL-139399).
April 10, 2024¶
Azure Synapse Analytics OCF Connector: Version 1.2.7¶
Fixed Issues¶
Unable to Generate the Column Level Lineage for CREATE VIEW Queries When Newline Character Is Present¶
The connector fails to generate the column level lineage for CREATE VIEW SQL query statements due to a newline character at the start and/or end of the query.
The newline character is now trimmed when the connector processes the queries to help generate column-level lineage for Azure Synapse. (AL-150115)
PostgreSQL OCF Connector: Version 1.2.1¶
Enhancements¶
With Alation version 2023.3.4 and PostgreSQL OCF connector version 1.2.0, Alation has introduced an enhanced user interface for configuring the PostgreSQL data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.4. However, you will view the old user interface with Alation versions prior to 2023.3.4.
The documentation for the new PostgreSQL experience is available at : PostgreSQL OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced PostgreSQL user interface provides better navigation and multiple visual cues, making it easy to configure and manage PostgreSQL data source.
Easy to Connect¶
The PostgreSQL user interface now provides a step-by-step process to connect to your PostgreSQL data source easily and quickly.
Additional Error-Prevention Checks¶
The PostgreSQL user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved PostgreSQL user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue. (AL-139424)
Snowflake OCF Connector: Version 2.3.3¶
Fixed Issues¶
Catalog Page Displays Incorrect Row Count for Tables¶
The catalog page displays the number of rows profiled by Alation instead of actual row count.
Now, the catalog page displays the row count based on the value set in the Max rows to Scan column under the Per-Object Parameters tab. If the row count in a table is less than the configured value in Max rows to Scan column, the actual row count is displayed. If it is more, Alation would display the row count value as 10000+, provided the Max rows to Scan is set to 10000. (AL-152558)
SSRS OCF Connector: Version 1.2.2¶
Fixed Issues¶
Metadata Extraction Fails with Errors¶
Metadata Extraction (MDE) for SSRS OCF connector fails with various errors.
Alation has improved the error handling for SSRS OCF connector to address some of the errors that appear while running MDE for SSRS data source. The connector now logs the errors causing the failures an allows the Metadata Extraction to continue. (AL-144685 & AL-146517)
April 05, 2024¶
Salesforce OCF Connector: Version 1.0.0¶
Fixed Issues¶
Unable to Connect Using OAuth¶
The Salesforce OCF connector is unable to connect using OAuth. This issue is caused due to a check being enabled for AuthType as a client. (AL-148513)
March 27, 2024¶
Azure Databricks OCF Connector: Version 2.0.6¶
Fixed Issues¶
Bulk Sampling Fails for Column Data Types timestamp_NTZ, Void, and Interval¶
For example, for Azure Databricks data source, sampling fails with the following error for column data type timestamp_NTZ:
The connector was provided with a list of columns to profile from a table, however the schema of the returned result set did not match those columns.
Now, the connector allows bulk sampling to proceed by skipping tables with timestamp_ntz, void, and interval issues. (AL-146049)
Azure Synapse Analytics OCF Connector: Version 1.2.6¶
Fixed Issues¶
QLI for Serverless Pool Works Only When Connected to Master Database¶
QLI in Azure Synapse Analytics OCF connector fails to extract queries when connected to any database other than the master database as the queries executed in Azure Synapse are logged only to the master database.
Now, when you execute serverless pool QLI, a new connection is established to the master database to extract queries.(AL-145689)
Databricks on Google Cloud OCF Connector: Version 2.0.3¶
Fixed Issues¶
Bulk Sampling Fails for Column Data Types timestamp_NTZ, Void, and Interval¶
For example, for Databricks on Google Cloud data source, sampling fails with the following error for column data type timestamp_NTZ:
The connector was provided with a list of columns to profile from a table, however the schema of the returned result set did not match those columns.
Now, connector allows bulk sampling to proceed by skipping tables with timestamp_ntz, void, and interval issues. (AL-146052)
Databricks Unity Catalog OCF Connector: Version 2.2.1¶
Fixed Issues¶
Bulk Sampling Fails for Column Data Types timestamp_NTZ, Void, and Interval¶
For example, for Databricks Unity Catalog data source, sampling fails with the following error for column data type timestamp_NTZ:
The connector was provided with a list of columns to profile from a table, however the schema of the returned result set did not match those columns.
Now, connector allows bulk sampling to proceed by skipping tables with timestamp_ntz, void, and interval issues. (AL-150864)
Google BigQuery OCF Connector: Version 1.3.2¶
Enhancements¶
Help Text Update in the Test Access and Fetch Datasets Section¶
In the new Admin User Interface for Google BigQuery OCF connector, the help text for Test access and fetch datasets step in the General Settings tab has been updated to inform that the permission checks are only performed at the Project level and at not any other resource levels. (AL-144371)
Fixed Issues¶
QLI Volume Check Displays Warning Even for Unsupported Regions During Access Check¶
The QLI volume check displays a warning message even when the User or Service Account configured in the data source configuration has all the required permissions. For example, this can happen when Google BigQuery users select non-GBQ regions from other cloud providers such as AWS or Azure.
Now, the QLI volume check skips all errors except for missing permission issues from regions supported in Google BigQuery.(AL-145878)
Properties Section of Catalog Page Fails to Display the External Table URL¶
The Properties section of the connector Catalog page doesn’t display the external table URL.
Now, the Properties section displays the external table URL. (AL-143448)
Data Sampling Results Display Incorrect Result Set for Struct Column Types¶
Data sampling displays incorrect column values in the result set on the tables.
Now, accurate result sets are displayed for Struct column types. (AL-87719)
Hive OCF Connector: Version 1.2.1¶
Enhancements¶
Library Package Log Level Update¶
The log level of the library package in the Hive OCF connector is now updated to ERROR to avoid multiple warning messages in the log file. (AL-126452)
IBM Db2 Database OCF Connector: Version 2.0.3¶
Enhancements¶
Removal of ORDER BY Clause in Default Metadata Extraction Queries¶
The ORDER BY clause has now been removed from the default Metadata extraction queries.
Processes subsequent to MDE ensure the extracted objects (Schema, Table, and Column) are mapped to the correct hierarchy. Therefore, it is redundant for the connector to fetch ordered items from the data sources. (AL-149896)
Fixed Issues¶
Metadata Extraction Fails¶
Metadata extraction fails with the following redundant error message:
MissingFormatArgumentException: Format specifier ‘%s
The connector has now modified the error handling to display appropriate error messages during MDE failure. (AL-147543)
Impala on CDP OCF Connector: Version 2.1.1¶
Fixed Issues¶
Partition Keys Missing in OCF Connector¶
The Impala CDP OCF Connector does not extract the Partition Keys.
Partition keys will now be extracted for partitioned tables in the Impala CDP OCF Connector and will be displayed under the Properties section of the Partitioned Table view in the catalog. (AL-147592)
Oracle OCF Connector: Version 1.6.2¶
Enhancements¶
Synonyms Extraction Disabled by Default¶
The Extract synonyms option is disabled by default in the Customize Extraction Scope section under the Metadata Extraction tab for new data sources added to Alation.
Additionally, when an administrator enables the Extract synonyms option in UI, a message is displayed warning users about the possible performance degradation with their MDE.
For existing data sources, the Extract Synonyms configuration set by the admin will continue to be valid. (AL-144160)
Help Text Update to Display A Warning in the Run QLI Section¶
The Run QLI section of Query Log Ingestion tab now includes a warning for users to check their daily average volume queries.(AL-146884)
March 20, 2024¶
TIBCO Data Virtualization OCF Connector: Version 1.0¶
Enhancements¶
Support for SSL Authentication¶
TIBCO Data Virtualization (TDV) OCF Connector supports SSL authentication for secure communication between Alation and TDV.
March 13, 2024¶
Key Highlights¶
Data Source Version EOL¶
The following data source versions have moved to end-of-life (EOL):
MySQL (EC2) - 5.7 (See MySQL)
MySQL (RDS) - 5.7 (See MySQL)
PostgreSQL (EC2) - 11.4 & 11.5 (See PostgreSQL)
PostgreSQL (RDS) - 11.4 & 11.5 (See PostgreSQL)
PostgreSQL (Enterprise) - 11 (See PostgreSQL)
Greenplum - 5, 6.3 & 6.9 (See VMware Greenplum)
Starburst Trino - 380-e LTS (See Starburst Version and Starbust Release Notes)
Denodo OCF Connector: Version 1.3.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Denodo OCF connector versions 1.3.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 Ensure that a user for the container has been created
Docker 4.6 Ensure that HEALTHCHECK instructions have been added to container images
Docker 4.7 Ensure update instructions are not used alone in Dockerfiles (AL-148260)
Snowflake OCF Connector: Version 2.3.2¶
Enhancements¶
Improved Error Message for Incorrect Warehouse¶
In case of an incorrect warehouse name or inaccessible warehouse, the error message now provides cues to check the validity of the warehouse along with required user permissions. (AL-149456)
Improved Experience for Volume Check Threshold UI Message¶
As part of the QLI volume check, the following redundant message was displayed for daily average query volume less than 500K.
“Your daily average query volume <average query volume> is less than 500k.
Now, the message is displayed only when the daily average query volume exceeds the 500K threshold. (AL-141936)
Fixed Issues¶
Upload Data Fails for Column Data Type timestamp_NTZ¶
For Snowflake data source, the Upload Data action fails with the following error for the column data type timestamp_NTZ:
The uploaded data does not seem to match the selected table
Now, you must ensure that you run MDE before you try the Upload Data action again. (AL-138612)
Custom QLI Query Validation Fails If the ENDTIME Keyword Appears Before the STARTTIME¶
Including the STARTTIME and ENDTIME keywords in the Custom QLI queries is mandatory. However, the connector restricts users from using the ENDTIME keyword before the STARTTIME keyword within a custom query. This results in a validation error for the custom QLI queries that require the ENDTIME keyword to appear before the STARTTIME keyword and the user cannot save it.
Now, the connector allows the users to successfully save the custom QLI query irrespective of the STARTTIME or ENDTIME keyword order. (AL-149456)
March 06, 2024¶
Amazon Redshift OCF Connector: Version 1.8.1¶
Fixed Issues¶
Custom QLI Query Validation Fails If the ENDTIME Keyword Appears Before the STARTTIME¶
Including the STARTTIME and ENDTIME keywords in the Custom QLI queries is mandatory. However, the connector restricts users from using the ENDTIME keyword before the STARTTIME keyword within a custom query. This results in a validation error for the custom QLI queries that require the ENDTIME keyword to appear before the STARTTIME keyword, preventing users from saving such custom queries.
Now, the connector allows the users to successfully save the custom QLI query irrespective of the STARTTIME or ENDTIME keyword order.
Impala on CDH OCF Connector: Version 1.2.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Impala CDH OCF connector versions 1.2.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Impala on CDP OCF Connector: Version 2.1.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Impala CDP OCF connector versions 2.1.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Oracle OCF Connector: Version 1.6.1¶
Fixed Issues¶
Custom QLI Query Validation Fails If the ENDTIME Keyword Appears Before the STARTTIME¶
Including the STARTTIME and ENDTIME keywords in the Custom QLI queries is mandatory. However, the connector restricts users from using the ENDTIME keyword before the STARTTIME keyword within a custom query. This results in a validation error for the custom QLI queries that require the ENDTIME keyword to appear before the STARTTIME keyword, preventing users from saving such custom queries.
Now, the connector allows the users to successfully save the custom QLI query irrespective of the STARTTIME or ENDTIME keyword order.
Teradata OCF Connector: Version 1.2.0¶
Enhancements¶
Teradata Driver Upgrade¶
The Teradata driver for the OCF connector is upgraded to the latest version 20.00.00.16.
February 28, 2024¶
Amazon Redshift OCF Connector: Version 1.8.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Amazon Redshift OCF connector versions 1.8.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Databricks on AWS OCF Connector: Version 2.1.10¶
Fixed Issues¶
Data Sampling Fails Due to Void Data Type¶
Bulk data sampling fails when the Databricks on AWS OCF connector encounters a column with void data type.
Now, the connector skips the column with void data type and continues with bulk data sampling and does not error out.
Note
The root cause for this issue is in the Databricks driver that the Databricks on AWS OCF connector uses. Once Databricks on AWS resolves the issue in the driver, you will start viewing the column values in profiling or sampling.
Hive OCF ConnectorL Version 1.2.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Hive OCF connector versions 1.2.0 or newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Oracle OCF Connector: Version 1.6.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Oracle OCF connector versions 1.6.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Snowflake OCF Connector: Version 2.3.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Snowflake OCF connector versions 2.3.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Additional Checks for QLI¶
Snowflake OCF connector now checks the inclusion of queryString, startTime, or sessionID column in the view or custom query used for QLI. If the queryString, startTime, or sessionID column is missing, the connector displays an error message and a hint in the Job summary. This check prevents log flooding.
SQL OCF Connector: Version 1.4.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
SQL OCF connector versions 2.3.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Tableau OCF Connector: Version 1.8.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Tableau OCF connector versions 1.8.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Teradata OCF Connector: Version 1.1.0¶
Enhancements¶
Docker CIS Benchmark Compliance¶
Teradata OCF connector versions 1.1.0 and newer are now compliant with the following Docker CIS benchmarks:
Docker 4.1 - Ensures that a user for the container is created
Docker 4.6 - Ensures that HEALTHCHECK instructions are added to container images
Docker 4.7 - Ensures that docker files do not include update instructions as a standalone or single-line instruction
Fixed Issues¶
Connector Displays Incomplete View Definition¶
The connector truncates the view definition for Views with large view_sql in the user interface. Now, the default MDE view query extracts the complete view definition. Additionally, the connector now joins the view definition split over multiple rows.
TIBCO Spotfire OCF Connector: Version 2.0¶
The TIBCO Spotfire OCF Connector version 2.0 is now available on the Alation Connector Hub.
The connector catalogs TIBCO Spotfire as a BI source within Alation on-premise and Cloud instances.
Features¶
Works with both Tibco Spotfire version 12 and 14
Catalogs Report fields and connection information for TIBCO Spotfire version 14 sources
Provides SSL support for TLS connectivity between Alation and Tibco Spotfire
Supports BI lineage between TIBCO cataloged Reports and Datasource objects
Provides report previews
For more information, see TIBCO Spotfire OCF Connector.
February 14, 2024¶
Amazon Redshift OCF Connector: Version 1.7.1¶
Fixed Issues¶
NULL Values Displayed As Zero In Compose Query Results for Cloud Service Instances¶
When you execute a query in Compose, NULL values are displayed as zero.
Amazon S3 OCF Connector: Version 3.9.0¶
Compatible Alation Version - 2023.1.6 or higher
Enhancements¶
With Alation version 2023.3.5 and Amazon S3 OCF connector version 3.9.0, Alation has introduced an enhanced user interface for configuring the Amazon S3 data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.5. However, you will view the old user interface with Alation versions prior to 2023.3.5.
The documentation for the new Amazon S3 OCF Connector experience is available at: Amazon S3 OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Amazon S3 user interface provides better navigation and multiple visual cues, making it easy to configure and manage Amazon S3 data source.
Easy to Connect¶
The Amazon S3 user interface now provides a step-by-step process to connect to your Amazon S3 data source easily and quickly.
Additional Error-Prevention Checks¶
The Amazon S3 user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Amazon S3 user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue.
February 07, 2024¶
Denodo OCF Connector: Version 1.2.4¶
Enhancements¶
Performance Enhancement of Sampling and Profiling¶
Alation has enhanced the performance of Sampling and Profiling queries.
DynamoDB OCF Connector: Version 1.0.0¶
The DynamoDB OCF Connector is now available on Connector Hub for public preview.
Features¶
Extracts and Catalogs database objects such as schemas, tables, views and columns.
Leverages full catalog functionality to search for and find the extracted metadata, curate the corresponding catalog pages, create documentation about the data source, and exchange information about it.
Supports high-performance Open Connector Framework (OCF) ingestion for faster extraction.
Supports following authentication methods: Basic and AWS Root Keys
For more information see Amazon DynamoDB OCF Connector
ElasticSearch: Version 1.0.0¶
` The ElasticSearch OCF Connector is now available on Connector Hub for public preview.
Features¶
Extracts and Catalogs database objects such as schemas, tables, views and columns.
Leverages full catalog functionality to search for and find the extracted metadata, curate the corresponding catalog pages, create documentation about the data source, and exchange information about it.
Supports high-performance Open Connector Framework (OCF) ingestion for faster extraction.
For more information, see ElasticSearch OCF Connector.
Salesforce OCF Connector: Version 2.0.0¶
The Salesforce OCF Connector is now GA and is available on Connector Hub.
Features¶
Support for OAuth authentication.
For more information, see Salesforce OCF Connector.
TIBCO Data Virtualization OCF Connector: Version 1.0.0¶
The TIBCO Data Virtualization (TDV) OCF Connector is now available on Connector Hub for public preview.
Features¶
Combines disparate data sources on demand providing the ability to create logical unified data views.
Extracts and catalogs TDV data source objects such as schemas, tables, and columns within Alation.
Supports cataloging of table column data and sampling.
Provides Compose functionality for cataloged data sources.
For more information, see TIBCO Data Virtualization OCF Connector.
January 31, 2024¶
Amazon Redshift OCF Connector: Version 1.7.0¶
Compatible Alation Version - 2023.1.6, 2023.3 or higher
Enhancements¶
With Alation version 2023.3.4 and higher and Amazon Redshift OCF connector version 1.7.0 and higher, Alation has introduced an enhanced user interface for configuring the Amazon Redshift data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.4. However, you will view the old user interface with Alation versions prior to 2023.3.4.
The documentation for the new Amazon Redshift experience is available at : Amazon Redshift OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Redshift user interface provides better navigation and multiple visual cues, making it easy to configure and manage Redshift data source.
Easy to Connect¶
The Redshift user interface now provides a step-by-step process to connect to your Redshift data source easily and quickly.
Additional Error-Prevention Checks¶
The Redshift user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Redshift user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue.
Databricks on AWS OCF Connector: Version 2.1.9¶
Enhancements¶
Databricks Driver Upgrade¶
The Databricks driver for the OCF connector is upgraded to the latest version 2.6.34.
Databricks on GCP OCF Connector: Version 2.0.2¶
Enhancements¶
Databricks Driver Upgrade¶
The Databricks driver for the OCF connector is upgraded to the latest version 2.6.34.
MicroStrategy OCF Connector: 1.1.0¶
Enhancements¶
Support for Table Level Lineage¶
From Alation version 2023.3.5 or newer, you can now view Table Level Lineage for in-memory cubes using cross system lineage API using the MicroStrategy OCF connector.
Oracle OCF Connector: Version 1.5.0¶
Compatible Alation Version - 2023.1 or higher
Enhancements¶
With Alation version 2023.3.4 and higher and Oracle OCF connector version 1.5.0 and higher, Alation has introduced an enhanced user interface for configuring the Oracle data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.4. However, you will view the old user interface with Alation versions prior to 2023.3.4.
The documentation for the new Oracle experience is available at : Oracle OCF Connector.
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Oracle user interface provides better navigation and multiple visual cues, making it easy to configure and manage Oracle data source.
Easy to Connect¶
The Oracle user interface now provides a step-by-step process to connect to your Oracle data source easily and quickly.
Additional Error-Prevention Checks¶
The Oracle user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Oracle user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue.
Snowflake OCF Connector: Version 2.2.15¶
Fixed Issue¶
Alation Prevents Completion of Test Connection and Test Access and Fetch Actions Without System Views Access¶
You can now complete the Test Connection and Test Access and Fetch Schema actions on the General Settings and Metadata Extraction tabs, respectively, even when your configured service account cannot access system views but would like to use custom views instead.
In such cases, Alation now displays a warning message allowing you to proceed if you intend to use Custom MDE Queries to configure and run extraction. This functionality was blocked in connector version 2.2.13 and has now been re-introduced.
January 24, 2024¶
Azure Synapse Analytics OCF Connector: Version 1.2.5¶
Fixed Issues¶
Metadata Extraction Fails With Generic Error¶
Metadata Extraction fails with the following generic error instead of a specific error message informing the exact issue:
java.util.MissingFormatArgumentException: Format specifier ‘%s’
Google BigQuery OCF Connector: Version 1.3.0¶
Compatible Alation Version - 2023.1 or higher
Enhancements¶
With Alation version 2023.3.4 and Google BigQuery OCF connector version 1.3.0, Alation has introduced an enhanced user interface for configuring the Google BigQuery data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.4. However, you will view the old user interface with Alation versions prior to 2023.3.4.
The documentation for the new Google BigQuery experience is available at : Google BigQuery OCF Connector
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Google BigQuery user interface provides better navigation and multiple visual cues, making it easy to configure and manage Google BigQuery data source.
Easy to Connect¶
The Google BigQuery user interface now provides a step-by-step process to connect to your Google BigQuery data source easily and quickly.
Additional Error-Prevention Checks¶
The Google BigQuery user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Google BigQuery user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue.
January 17, 2024¶
Add-On OCF Connector for Fivetran: Version 2.0.6¶
The Add-0n OCF Connector for Fivetran is now available on Connector Hub.
Use this connector to create cross-system lineage in Alation for cataloged sources and destination data warehouses, which are being Extracted and Loaded respectively by Fivetran.
Features¶
Better User Experience¶
This add-on utility allows extraction of metadata for Schemas, Tables and Columns as a part of existing Data Warehouse offering.
High Performance¶
This Open Connector Framework (OCF) ingestion operates with high performance to complete extraction quickly.
For more information, see Add-on OCF Connector for Fivetran
Databricks on AWS OCF Connector: Version 2.1.8¶
Fixed Issues¶
Longer Execution Time for Sampling and Profiling Queries
In AWS Databricks, row count takes longer to execute for custom Sampling queries for views with large tables.
Databricks Unity Catalog OCF Connector: Version 2.2.0¶
Compatible Alation Version - 2023.1.7 or higher
Enhancements¶
With Alation version 2023.3.4 and Databricks Unity Catalog OCF connector version 2.2.0, Alation has introduced an enhanced user interface for configuring the Databricks Unity Catalog data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.4. However, you will view the old user interface with Alation versions prior to 2023.3.4.
The documentation for the new Databricks Unity Catalog experience is available at: Databricks Unity Catalog OCF Connector
The enhanced user interface provides the following features:
Better User Experience¶
The enhanced Databricks Unity Catalog user interface provides better navigation and multiple visual cues, making it easy to configure and manage Databricks Unity Catalog data source.
Easy to Connect¶
The Databricks Unity Catalog user interface now provides a step-by-step process to connect to your Databricks Unity Catalog data source easily and quickly.
Additional ErrorPrevention Checks¶
The Databricks Unity Catalog user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Detailed Error Reports and Troubleshooting Support¶
The improved Databricks Unity Catalog user interface makes troubleshooting easier for metadata extraction and query log ingestion, as you can now have a detailed error report for both processes. The report contains a detailed error description and steps to resolve the issue.
Hive OCF Connector: Version 1.1.5¶
Fixed Issues¶
Metadata Extraction Fails for Objects with Whitespace Characters¶
Metadata Extraction (MDE) fails when encountering a whitespace character in MDE object names.
Now, if the connector encounters a whitespace object name, it logs the object and skips cataloging the object with the whitespace character. Therefore, the Hive OCF Connector is now tolerant and helps catalog all the objects that can be cataloged without issues in Alation.
Kafka OCF Connector: Version 1.0.0¶
The Kafka OCF Connector is now available on Connector Hub.
Features¶
Extracts and Catalogs database objects such as schemas, tables and columns.
Kafka OCF connector supports multiple authentication methods like Azure MSI, Azure Service Principal, SCRAM-SHA-512, SCRAM, Kerberos and Plain.
Leverage full catalog functionality to search for and find the extracted metadata, curate the corresponding catalog pages, create documentation about the data source, and exchange information about it.
High-performance Open Connector Framework (OCF) ingestion for faster extraction.
For more information, see Kafka
January 10, 2024¶
SQL Server OCF Connector: Version 1.3.10¶
Fixed Issues¶
VIEW Columns Fail to Display the Column Length¶
VIEW columns in SQL OCF connector do not display the column length or limit along with the data type name.
Tableau OCF Connector: Version 1.7.1¶
Enhancements¶
Tableau OCF Displays SQL Queries¶
Tableau OCF connector now displays SQL queries for custom SQL-based Tableau datasources. For detail, see Tableau OCF Connector.
Fixed Issues¶
Extraction for Multiple Sites Results in Missing Metadata¶
When extracting from multiple sites, the metadata extraction results in Tableau API failures, NullPointerException, and missing metadata.
Connections to Tableau Remain Open¶
The Tableau OCF connector fails to close the connections to Tableau.
Connector Initiates Duplicate API Calls¶
The Tableau OCF connector initiates duplicate API calls to fetch metadata.
Connector Fails to Stop Upon Encountering a Fatal Error¶
When the Tableau server is under maintenance, the MDE becomes unresponsive.
Permission Mirroring Issues¶
Permission mirroring issues related to site administrator and non-administrator Tableau users are now fixed.
January 03, 2024¶
Databricks on AWS OCF Connector: Version 2.1.7¶
Fixed Issues¶
QLI Fails with Partial Success Status¶
QLI for AWS Databricks OCF connector fails with a Partial Success status and the following status message: No queries were found to ingest, making the QLI feature unusable.
MongoDB OCF Connector: Version 1.0.0¶
The MongoDB OCF Connector is now available on Connector Hub.
Features¶
The MongoDB connector supports various authentication methods including Basic, Kerberos, and LDAP.
The connector is compatible with MongoDB database version 23.0.0.8692 and Alation version 2023.3.
Supports features inclusive of Metadata Extraction (MDE), sampling and profiling.
For more information, see MongoDB.
Snowflake OCF Connector: Version 2.2.13¶
Fixed Issues¶
Compose Uses Incorrect Version of the JDBC Driver¶
Snowflake OCF connector supports the latest JDBC driver version (version 3.14.1). However, Compose is unable to use the latest version of the JDBC driver and falls back to the native version.
SQL Server OCF Connector: Version 1.3.9¶
Fixed Issues¶
QLI Jobs Display Incorrect Job Status for Errors¶
A QLI is completed with Partial Success status even when there are errors and the error message is displayed only in the connector logs.
December 27, 2023¶
Azure Databricks OCF Connector: Version 2.0.5¶
Fixed Issues¶
Azure Databricks OCF Connector Misses Processing the Last Query¶
Azure Databricks runs queries on different threads. These queries are logged into log files that are processed by the OCF connector. Howevetr, while processing, the connector misses processing the last query. This results in missing lineage from the catalog.
With this fix, the missing lineage from the last query is now generated for the Azure Databricks OCF connector.
December 20, 2023¶
Azure Databricks OCF Connector: Version 2.0.4¶
Fixed Issues¶
QLI Extraction Fails to Ingest Queries¶
QLI extraction for Azure Databricks OCF connector fails with NA_LOCATION_INFO error and does not return any query statement to ingest.
You can now successfully run the QLI extraction.
Databricks Unity Catalog OCF Connector: Version 2.1.1¶
Fixed Issues¶
QLI Execution Fails for Databricks Unity Catalog OCF Connector¶
The issue related to QLI execution for Databricks Unity Catalog data source with ANSI Mode enabled that resulted in the CAST_INVALID_INPUT error is now fixed.
SQL Server OCF Connector: Version 1.3.8¶
Fixed Issues¶
SQL Server Connection Error Soft Deletes Cataloged Objects¶
In SQL Server OCF Connector, an error in the SQL server connection caused an empty stream of data, which was treated as a successful MDE and resulted in the soft deletion of all the extracted metadata.
Alation now ensures that such configuration and connection errors result in metadata extraction failure instead of an empty data stream.
December 18, 2023¶
Snowflake OCF Connector: Version 2.2.12¶
Fixed Issues¶
Unable to Complete Test Connection and Test Access and Fetch Actions Without System Views Access¶
You can now complete the Test Connection and Test Access and Fetch Schema actions on the General Settings and Metadata Extraction tabs, respectively, even when your configured service account cannot access system views but would like to use custom views instead.
In such cases, Alation now displays a warning message allowing you to proceed if you intend to use Custom MDE Queries to configure and run extraction.
December 13, 2023¶
Add-On OCF Connector for dbt: Version 3.0.7¶
Compatible Alation Version - 2023.1 or higher
Enhancements¶
Improved User Experience¶
The enhanced Add-On OCF connector for dbt Admin user interface provides better navigation and multiple visual cues, making it easy to configure and manage dbt connector.
Important
Add-On OCF connector for dbt version 3.0.7 is supported with the Alation version 2023.1 and higher, however, the enhanced user experience is available only from the Alation version 2023.3.2.1.
Databricks on AWS OCF Connector: Version 2.1.6¶
Compatible Alation Version - 2023.1 or higher
Enhancements¶
Dynamic Profiling and Dynamic Sampling Uses Respective Database Credentials¶
Dynamic profiling and sampling for Databricks on AWS OCF connector now use the credentials the user provides for their respective databases when retrieving table samples and column profiles for specific tables and columns.
Greenplum OCF Connector: Version 1.0.7¶
Compatible Alation Version - 2022.3 (Patch version: 13.4.7) and higher
Fixed Issues¶
Popularity and Top User Calculations Differ Between OCF and Native Connectors¶
There are discrepancies in the Popularity and Top Users values displayed on catalog pages of schema, table, and column objects between the Greenplum OCF and native connectors.
Impala CDP OCF Connector: Version 2.0.1¶
Compatible Alation Version - 2022.4 or later
Fixed Issues¶
Test Connection Fails on the Impala CDP Connector¶
Test Connection is successful for Kerberos-enabled Impala CDP connector.
SAP BO OCF Connector: Version 1.2.0¶
Compatible Alation Version - 2022.4 or later
Enhancements¶
Enhancements to Performance and Memory Utilization¶
Alation has now improved the SAP BO OCF connector to reduce the MDE time and memory utilization. This enhancement addresses all the existing or potential performance issues (longer MDE runs).
SingleStore OCF Connector (MemSQL): Version 1.1.3¶
Compatible Alation Version - 2022.3 or higher
Fixed Issues¶
Data Upload Fails¶
When you try to upload data for a table, upload and table creation, fail with an error.
The SingleStore OCF connector code is now updated that fixes the issue.
Snowflake OCF Connector: Version 2.2.11¶
Compatible Alation Version - 2022.4 or higher
Enhancements¶
The allowUnderscoresInHost Parameter is Automatically Set in the JDBC URI¶
If you miss setting the allowunderscore parameter in the JDBC URI field on the General Settings tab of the Snowflake data source, the Snowflake OCF connector automatically sets the allowunderscore parameter to true (allowunderscore=true).
With this enhancement, Snowflake OCF connector supports underscores in the account names included in the Privatelink JDBC URLs.
Fixed Issues¶
Metadata Extraction Fails In the Absence of ALLOWED_VALUES Column¶
In Snowflake OCF connector version 2.2.9 and earlier, Alation introduced a new column called ALLOWED_VALUES in the Tag extraction query to extract all the available values associated with the ALLOWED_VALUES parameter from the Snowflake data source. If this column is absent in the custom query for the tag, MDE fails.
This column has now been made optional to ensure that MDE runs successfully for users who have installed the latest Snowflake OCF Connector version (2.2.9 and higher) on an earlier Alation version.
Starburst Trino OCF Connector: Version 1.3.1¶
Compatible Alation Version - 2022.4 or higher
Enhancements¶
JDBC Driver Upgrade¶
The JDBC driver for Starburst OCF connector is upgraded from trino-jdbc-380.jar to trino-jdbc-430.jar.
Support for New Starburst Enterprise Version¶
Starburst OCF connector now supports the new Starburst Enterprise version 413-e LTS.
Note
Alation will continue to support the Starburst Enterprise (Trino) version 380-e LTS (EOL version).
December 06, 2023¶
Azure Power BI Scanner OCF Connector: Version 2.1.3¶
Compatible Alation Version - 2023.3.2 or higher
Enhancements¶
Support for Plus Character (+) in Ingested SQL Queries¶
Azure Power BI Scanner OCF Connector supports a plus sign (+) in the ingested SQL queries for dataset expressions. This enables the extraction of connection information from dataset expressions with queries having ‘+’ (plus character) to generate lineage.
Fixed Issues¶
Metadata Extraction Fails for Parameters with Same Name As Table Name in Datasets¶
In Azure Power BI Scanner OCF Connector, MDE fails if a dataset expression has a parameter with the same name as the table name and value as an expression. This is because the length of the object identifier exceeds the limit set by Alation.
Google BigQuery OCF Connector: Version 1.2.3¶
Compatible Alation Version - 2022.3 (Patch version: 13.4.7) or higher
Enhancements¶
Google BigQuery Connector Uses Service Account During Sampling¶
Google BigQuery Connector now uses a service account while performing dynamic sampling with OAuth setup using the Compose tab.
Impala CDP OCF Connector: Version 2.0.0¶
Compatible Alation Version - 2022.4 or later
Enhancements¶
Support for Public Cloud CDP Distribution¶
The Impala on CDP OCF connector now supports Public Cloud CDP Distribution and earlier support for Private Cloud CDP Distribution (Base and CDW).
Support for New and Combination of Multiple Authentication Types¶
The Impala on CDP OCF connector now supports the following authentication types:
Datasource (Impala)
No Auth
Username
Username Password (LDAP)
Kerberos (Password or Keytab)
SSL over any of the above methods
Metastore (For MDE)
No Auth
Username Password
Kerberos (Password or Keytab)
HDFS (For QLI)
Username
Username Password
Kerberos (Password or Keytab)
SSL over any of the above methods
Additionally, you can use multiple combinations of these authentication types for the data source and metastore connections. For details, see Impala on CDP OCF Connector.
Change of JDBC Driver¶
The Impala on CDP OCF connector now uses the Impala JDBC driver over the Hive JDBC driver. This allows support for public cloud CDP distribution and leverages the JDBC’s request pool parameter feature.
Limitations¶
Support for Compose¶
Impala OCF Connector version 2.0.0 supports Compose only from Alation version 2023.3.3.2 or later.
Microstrategy OCF Connector: Version 1.0.2¶
Compatible Alation Version - 2023.1 or higher
Fixed Issues¶
Unable to Access the Microstrategy Server Using External Source Links on Alation¶
When navigating to the Microstrategy OCF connector from a link on a report or dashboard, the MicroStrategy Web Server displays an error if the user is not already logged in to the Microstrategy Server. Alation now allows you to configure a new optional setting (I-Server) that redirects users to the corresponding object page without an error.
Redshift OCF Connector: Version 1.6.0¶
Compatible Alation Version - 2022.4.11 or higher
Enhancements¶
JDBC Driver Upgrade¶
The custom JDBC driver for the Redshift OCF connector is upgraded to version 2.1.0.21. This upgrade addresses associated potential issues with the Redshift OCF connector. It will also help prevent problems that may arise when handling large volumes of metadata for a Redshift data source.
November 29, 2023¶
Databricks Unity Catalog OCF Connector: Version 2.1.0¶
Compatible Alation Version - 2023.1.7.1 or higher
Enhancements¶
Support for OAuth Authentication with Azure Active Directory¶
The Databricks Unity Catalog OCF connector now supports OAuth authentication for Compose, enabling you to securely access and utilize data assets within the Databricks environment.
November 22, 2023¶
Databricks on AWS OCF Connector: Version 2.1.4¶
Compatible Alation version: 2023.1 or higher
Fixed Issues¶
Query Log Ingestion Fails for AWS OCF Connector¶
The Query Log Ingestion (QLI) Preview and ingestion fails due to the Log4j library upgrade after successful datasource connection and metadata extraction.
Preview Error:
QLI Preview failed: The connector responded with the following error message: NA_LOCATION_INFO.
QLI Error:
No queries were found to Ingest.
This issue is resolved.
Azure Power BI Scanner OCF Connector: Version 2.1.0¶
Compatible Alation version: 2023.3.2 or higher
Enhancements¶
Support for Cross-System Lineage Between PowerBI and Databricks Unity Catalog, Azure SQL, and Azure Synapse¶
Alation now supports cross-system lineage between PowerBI and the following data sources:
Databricks Unity Catalog
Azure SQL
Azure Synapse
To start using this feature, perform the following:
Upgrade to Alation version 2023.3.2 or later.
Set the following flag to True using alation_conf:
alation_conf alation.resolution.DEV_bi_connector_returns_db_for_two_part_schema -s TrueInstall the latest Azure Power BI Scanner OCF Connector.
For details, see Azure Power BI Scanner OCF Connector.
PostgreSQL OCF Connector: Version 1.1.10¶
Compatible Alation version: 2023.1 or higher
Fixed Issues¶
Query Log Ingestion Fails If the Custom Query Does Not Include a transactionid Column¶
From PostgreSQL OCF Connector versions 1.1.9 and 1.1.10 onwards, QLI fails if the Custom QLI Query does not include a transactionid column.
This issue is fixed. Now, in PostgreSQL OCF Connector versions 1.1.9 and 1.1.10 or higher, QLI completes successfully even if the Custom QLI Query does not include a transactionid column. However, Alation recommends that you include the transactionid column in your query to obtain accurate durations for the query.
SAP BW OCF Connector: Version 1.2.0¶
Compatible Alation version: 2022.4 or higher
Enhancements¶
Improved Performance and Memory Utilization¶
Alation has now improved the metadata extraction logic for the SAP BW OCF connector to enhance performance and memory utilization.
This enhancement will address the existing or potential performance issues (longer MDE runs) or MDE failures due to out-of-memory errors in the Connector.
SAP ECC OCF Connector: Version 1.2.0¶
Compatible Alation version: 2022.4 or higher
Enhancements¶
Improved Performance and Memory Utilization¶
Alation has now improved the metadata extraction logic for the SAP ECC OCF connector to enhance performance and memory utilization.
This enhancement will address the existing or potential performance issues (longer MDE runs) or MDE failures due to out-of-memory errors in the Connector.
November 16, 2023¶
Snowflake OCF Connector Version 2.2.9¶
Compatible Alation version: 2022.4 or higher
Enhancements¶
With Alation version 2023.3.2.1 and Snowflake OCF connector version 2.2.9, Alation has introduced an enhanced user interface for configuring the Snowflake data source settings.
Note
The connector version is compatible with Alation versions prior to 2023.3.2.1. However, you will view the old user interface with Alation versions prior to 2023.3.2.1.
The documentation for the new Snowflake experience is available at Snowflake OCF Connector.
The enhanced user interface provides the following features:
Improved User Experience¶
The enhanced Snowflake Admin user interface provides better navigation and multiple visual cues, making it easy to configure and manage Snowflake data source.
Easy to Connect¶
The Snowflake Admin user interface now provides a step-by-step process to connect to your Snowflake data source easily and quickly.
Extra Error-Prevention Checks¶
The Snowflake Admin user interface now includes added checks to avoid obvious configuration mistakes. The user interface also includes text to assist and provide cues while configuring.
Actionable Error Messages and Detailed Error Reports¶
The Snowflake Admin user interface has made troubleshooting easier for metadata extraction and query log ingestion, as you can now have actionable error messages. We also support a detailed error report for Metadata Extraction, which contains a detailed error description and steps to resolve the issue.
November 8, 2023¶
SQL Server OCF Connector Version 1.3.7¶
Compatible Alation version: 2022.2 or higher
Fixed Issues¶
Connection Test Fails When Using SSL with NTLM Authentication¶
Fixed an issue when the connection test failed when SSL was enabled with NTLM authentication. The test resulted in the following error:
Caused by: sun.security.validator.ValidatorException: PKIX path building failed:
sun.security.provider.certpath.SunCertPathBuilderException:
unable to find valid certification path to requested target
To use SSL with NTLM, basic, or Kerberos authentication, use the following JDBC URL format:
sqlserver://<Host_Name>:<Port_Number>;encrypt=true;hostNameInCertificate=<certificate_name>;
This JDBC URI includes the following additional SSL related parameters:
encrypt=true
hostNameInCertificate=<certificate_name>
You can run the command below to verify your certificate name. In the result, check for the value after CN=. That’s the certificate name.
openssl x509 -noout -subject -in <certificate_name>.crt;
Example:
sqlserver://10.13.82.165:1433;encrypt=true;hostNameInCertificate=abc.corp.net;