You configure monitoring for an Azure Synapse Analytics implementation.
The implementation uses PolyBase to load data from comma-separated value (CSV) files stored in Azure Data Lake Gen 2 using an external table.
Files with an invalid schema cause errors to occur.
You need to monitor for an invalid schema error.
For which error should you monitor?
A . EXTERNAL TABLE access failed due to internal error: ‘Java exception raisedon call to HdfsBridge_Connect: Error[com.microsoft.polybase.client.KerberosSecureLogin] occurred while accessingexternal file.’
B . EXTERNAL TABLE access failed due to internal error: ‘Java exception raisedon call to HdfsBridge_Connect: Error [No FileSystem for scheme: wasbs]occurred while accessing external file.’
C . Cannot execute the query "Remote Query" against OLE DB provider "SQLNCLI11"for linked server "(null)", Query aborted- the maximum reject threshold (0rows) was reached while reading from an external source: 1 rows rejected outof total 1 rows processed.
D . EXTERNAL TABLE access failed due to internal error: ‘Java exception raisedon call to HdfsBridge_Connect: Error [Unable to instantiate LoginClass]occurred while accessing external file.’
Answer: C
Explanation:
Customer Scenario:
SQL Server 2016 or SQL DW connected to Azure blob storage. The CREATE EXTERNAL TABLE DDL points to a directory (and not a specific file) and the directory contains files with different schemas.
SSMS Error:
Select query on the external table gives the following error:
Msg 7320, Level 16, State 110, Line 14
Cannot execute the query "Remote Query" against OLE DB provider "SQLNCLI11" for linked server "(null)". Query aborted– the maximum reject threshold (0 rows) was reached while reading from an external source: 1 rows rejected out of total 1 rows processed.
Possible Reason:
The reason this error happens is because each file has different schema. The PolyBase external table DDL when pointed to a directory recursively reads all the files in that directory. When a column or data type mismatch happens, this error could be seen in SSMS.
Possible Solution:
If the data for each table consists of one file, then use the filename in the LOCATION section prepended by the directory of the external files. If there are multiple files per table, put each set of files into different directories in Azure Blob Storage and then you can point LOCATION to the directory instead of a particular file. The latter suggestion is the best practices recommended by SQLCAT even if you have one file per table.
Incorrect Answers:
A: Possible Reason: Kerberos is not enabled in Hadoop Cluster.
References: https://techcommunity.microsoft.com/t5/DataCAT/PolyBase-Setup-Errors-and-Possible-Solutions/bap/305297
Leave a Reply