Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion amazon-redshift-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Amazon Redshift plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion aurora-mysql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Aurora DB MySQL plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion aurora-postgresql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Aurora DB PostgreSQL plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion cloudsql-mysql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>CloudSQL MySQL plugin</name>
Expand Down
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
errorMessageInvalidSourceDatabase=SQL error while getting query schema
errorMessageInvalidSourceDatabase=SQL Error occurred, sqlState: '42000', errorCode: '1049'
errorMessageInvalidImportQuery=Import Query select must contain the string '$CONDITIONS'. if Number of Splits is not set\
\ to 1. Include '$CONDITIONS' in the Import Query
errorMessageCloudMySqlInvalidReferenceName=Invalid reference name
errorMessageBlankUsername=Username is required when password is given.
errorMessageBlankPassword=SQL error while getting query schema
errorMessageBlankPassword=SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user '
errorMessageInvalidFetchSize=Invalid fetch size. Fetch size must be a positive integer.
errorMessageBlankSplitBy=Split-By Field Name must be specified if Number of Splits is not set to 1. Specify the Split-by Field Name.
errorMessageInvalidNumberOfSplits=Invalid value for Number of Splits '0'. Must be at least 1. Specify a Number of Splits no less than 1.
Expand All @@ -12,10 +12,14 @@ errorMessageNumberOfSplits=Split-By Field Name must be specified if Number of Sp
errorMessageBoundingQuery=Bounding Query must be specified if Number of Splits is not set to 1. Specify the Bounding Query.
errorMessageInvalidSinkDatabase=Error encountered while configuring the stage: 'URLDecoder: Illegal hex characters in escape (%) pattern - For input string: "$^"'
errorMessageInvalidTableName=Table 'Invalidtable' does not exist. Ensure table 'Invalidtable' is set correctly and
errorMessageConnectionName=Connection Name must be in the format <PROJECT_ID>:<REGION>:<INSTANCE_NAME> to connect to a public CloudSQL PostgreSQL instance.
errorMessageConnectionName=Connection Name must be in the format <PROJECT_ID>:<REGION>:<INSTANCE_NAME> to connect to a public CloudSQL MySQL instance.
validationSuccessMessage=No errors found.
validationErrorMessage=COUNT ERROR found
errorLogsMessageInvalidTableName=Spark program 'phase-1' failed with error: Errors were encountered during validation. \
Table
errorLogsMessageInvalidCredentials =Spark program 'phase-1' failed with error: Errors were encountered during validation.
errorLogsMessageInvalidBoundingQuery=Spark program 'phase-1' failed with error: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'table' at line 1. Please check the system logs for more details.
errorLogsMessageInvalidTableName=Spark program 'phase-1' failed with error: Stage 'CloudSQL MySQL' encountered : io.cdap.cdap.etl.api.validation.ValidationException: Errors were encountered during validation. \
Table 'Table123' does not exist.. Please check the system logs for more details.
errorLogsMessageInvalidCredentials=Spark program 'phase-1' failed with error: Stage 'CloudSQL MySQL' encountered : io.cdap.cdap.api.exception.ProgramFailureException: SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user 'testUser'
errorLogsMessageInvalidBoundingQuery=Spark program 'phase-1' failed with error: Stage 'CloudSQL MySQL' encountered : java.io.IOException: You have an error in your SQL syntax; \
check the manual that corresponds to your MySQL server version for the right syntax to use near 'table' at line 1. Please check the system logs for more details.
errorMessageInvalidPassword=SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user '
errorMessagePrivateConnectionName=Enter the internal IP address of the Compute Engine VM cloudsql proxy is running on, to connect to a private
errorMessageWithBlankPassword=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user '
2 changes: 1 addition & 1 deletion cloudsql-postgresql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>CloudSQL PostgreSQL plugin</name>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -188,7 +188,8 @@ Feature: CloudSQL-PostGreSQL Source - Run Time scenarios
Then Close the Plugin Properties page
Then Save the pipeline
Then Preview and run the pipeline
Then Wait till pipeline preview is in running state
Then Wait till pipeline preview is in running state and check if any error occurs
Then Open and capture pipeline preview logs
Then Verify the preview run status of pipeline in the logs is "failed"

@CLOUDSQLPOSTGRESQL_SOURCE_TEST @CLOUDSQLPOSTGRESQL_TARGET_TEST
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,16 +7,19 @@ errorMessageInvalidNumberOfSplits=Invalid value for Number of Splits '0'. Must b
errorMessageNumberOfSplitNotNumber=Unable to create config for batchsource CloudSQLPostgreSQL 'numSplits' is invalid: Value of \
field class io.cdap.plugin.db.config.AbstractDBSpecificSourceConfig.numSplits is expected to be a number.
errorMessageInvalidFetchSize=Invalid fetch size. Fetch size must be a positive integer.
errorMessageInvalidSourceDatabase=SQL error while getting query schema: FATAL: database "invalidDatabase" does not exist
errorMessageInvalidSourceDatabase=SQL Error occurred, sqlState: '3D000', errorCode: '0', errorMessage: SQL Exception occurred: [Message='FATAL: database "invalidDatabase" does not exist', SQLState='3D000', ErrorCode='0'].
errorMessageInvalidImportQuery=Import Query select must contain the string '$CONDITIONS'. if Number of Splits is not set\
\ to 1. Include '$CONDITIONS' in the Import Query
errorMessageBlankUsername=Username is required when password is given.
errorMessageBlankPassword=SQL error while getting query schema:
errorMessageInvalidPassword=SQL error while getting query schema: FATAL: password authentication failed for user
errorMessageBlankPassword=SQL Error occurred, sqlState: '99999', errorCode: '0', errorMessage: SQL Exception occurred: [Message='Something unusual has occurred to cause the driver to fail. Please report this exception.', SQLState='99999', ErrorCode='0'].
errorMessageInvalidPassword=SQL Error occurred, sqlState: '28P01', errorCode: '0', errorMessage: SQL Exception occurred: [Message='FATAL: password authentication failed for user
errorMessageInvalidSourceHost=SQL error while getting query schema: The connection attempt failed.
errorMessageInvalidTableName=Table 'table' does not exist. Ensure table '"table"' is set correctly and that the
errorMessageInvalidSinkDatabase=Exception while trying to validate schema of database table
errorLogsMessageInvalidBoundingQuery=Spark program 'phase-1' failed with error: The column index is out of range: 1, \
number of columns: 0.. Please check the system logs for more details.
errorMessageInvalidSinkDatabase=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '3D000', errorCode: '0', errorMessage: SQL Exception occurred: [Message='FATAL: database "invalidDB" does not exist', SQLState='3D000', ErrorCode='0'].'
errorLogsMessageInvalidBoundingQuery=The column index is out of range: 1, number of columns: 0..
errorMessageConnectionName=Connection Name must be in the format <PROJECT_ID>:<REGION>:<INSTANCE_NAME> to connect to \
a public CloudSQL PostgreSQL instance.
errorMessagePrivateConnectionName=Enter the internal IP address of the Compute Engine VM cloudsql proxy is running on, \
to connect to a private CloudSQL PostgreSQL instance.
errorMessageWithBlankPassword=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '99999', errorCode: '0', errorMessage: SQL Exception occurred: [Message='Something unusual has occurred to cause the driver to fail. Please report this exception.', SQLState='99999', ErrorCode='0'].'
errorMessageUpdateUpsertOperationName=Table key must be set if the operation is 'Update' or 'Upsert'.
2 changes: 1 addition & 1 deletion database-commons/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Database Commons</name>
Expand Down
2 changes: 1 addition & 1 deletion db2-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>IBM DB2 plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion generic-database-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Generic database plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion generic-db-argument-setter/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Generic database argument setter plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion mariadb-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Maria DB plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion memsql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Memsql plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion mssql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Microsoft SQL Server plugin</name>
Expand Down
24 changes: 14 additions & 10 deletions mssql-plugin/src/e2e-test/resources/errorMessage.properties
Original file line number Diff line number Diff line change
@@ -1,23 +1,27 @@
validationSuccessMessage=No errors found.
errorMessageInvalidSourceDatabase=SQL error while getting query schema
errorMessageInvalidSourceDatabase=SQL Error occurred, sqlState: 'S0001', errorCode: '4060', errorMessage: SQL Exception occurred: [Message='Cannot open database "test123" requested by the login. The login failed.
errorMessageInvalidImportQuery=Import Query select must contain the string '$CONDITIONS'.
errorMessageMssqlInvalidReferenceName=Invalid reference name 'invalidRef&^*&&*'.
errorMessageBlankUsername=Username is required when password is given.
errorMessageBlankPassword=SQL error while getting query schema
errorMessageBlankPassword=SQL Error occurred, sqlState: 'S0001', errorCode: '18456', errorMessage: SQL Exception occurred: [Message='Login failed for user '
errorMessageInvalidFetchSize=Invalid fetch size. Fetch size must be a positive integer.
errorMessageBlankSplitBy=Split-By Field Name must be specified if Number of Splits is not set to 1.
errorMessageInvalidNumberOfSplits=Invalid value for Number of Splits '0'. Must be at least 1.
errorMessageNumberOfSplitNotNumber=Unable to create config for batchsource
errorMessageBoundingQuery=Bounding Query must be specified if Number of Splits is not set to 1.
errorMessagenumofSplit=Split-By Field Name must be specified if Number of Splits is not set to 1.
errorMessageInvalidSinkDatabase=Exception while trying to validate schema of database table
errorMessageInvalidSinkDatabase=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: 'S0001', errorCode: '4060', errorMessage: SQL Exception occurred: [Message='Cannot open database "test123" requested by the login. The login failed.
errorMessageInvalidSinkTableName=Table 'Table123@' does not exist.
errormessageBlankHost=Exception while trying to validate schema of database table
errorMessageInvalidTableName=Spark program 'phase-1' failed with error: Errors were encountered during validation. \
Table 'Table123@' does not exist.. Please check the system logs for more details.
errormessageBlankHost=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '08S01', errorCode: '0', errorMessage: SQL Exception occurred: [Message='The TCP/IP connection to the host localhost, port 1433 has failed. \
Error: "Connection refused (Connection refused). Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.".', SQLState='08S01', ErrorCode='0'].'
errorMessageInvalidTableName=Spark program 'phase-1' failed with error: Stage 'SQL Server2' encountered : io.cdap.cdap.etl.api.validation.ValidationException: \
Errors were encountered during validation. Table 'Table123@' does not exist.. Please check the system logs for more details.
errorMessageInvalidCredentials=Spark program 'phase-1' failed with error: Unable to create config for batchsink SqlServer \
'connection' is invalid: Failed to assign value
errorMessageInvalidsourcetable=Spark program 'phase-1' failed with error: Incorrect syntax near the keyword 'table'.. \
Please check the system logs for more details.
errorMessageInvalidCredentialSource=Spark program 'phase-1' failed with error: Plugin with id SQL \
Server:source.jdbc.sqlserver does not exist in program phase-1 of application
errorMessageInvalidsourcetable=Spark program 'phase-1' failed with error: Stage 'SQL Server' encountered : io.cdap.cdap.api.exception.ProgramFailureException: SQL Error occurred, sqlState: 'S0001', errorCode: '156', \
errorMessage: SQL Exception occurred: [Message='Incorrect syntax near the keyword 'table'.', SQLState='S0001', ErrorCode='156'].. Please check the system logs for more details.
errorMessageInvalidCredentialSource=Spark program 'phase-1' failed with error: Stage 'SQL Server' encountered : java.lang.IllegalArgumentException: \
Plugin with id SQL Server:source.jdbc.sqlserver does not exist in program phase-1 of application
errorLogsMessageInvalidBoundingQuery=Spark program 'phase-1' failed with error: Stage 'SQL Server' encountered : java.io.IOException: Could not find stored procedure
blank.jdbcPluginName.message=Required property 'jdbcPluginName' has no value.
blank.connection.message=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: 'S0001', errorCode: '18456', errorMessage: SQL Exception occurred: [Message='Login failed for user '
2 changes: 1 addition & 1 deletion mysql-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Mysql plugin</name>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,8 @@ Feature: MySQL Source - Run time scenarios
Then Close the Plugin Properties page
Then Save the pipeline
Then Preview and run the pipeline
Then Wait till pipeline preview is in running state
Then Wait till pipeline preview is in running state and check if any error occurs
Then Open and capture pipeline preview logs
Then Verify the preview run status of pipeline in the logs is "failed"

@MYSQL_SOURCE_TEST @MYSQL_TARGET_TEST @Mysql_Required
Expand Down
18 changes: 12 additions & 6 deletions mysql-plugin/src/e2e-test/resources/errorMessage.properties
Original file line number Diff line number Diff line change
@@ -1,13 +1,19 @@
validationSuccessMessage=No errors found.
invalid.username.message=SQL error while getting query schema:
invalid.username.message=SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user '
invalidtableName.error.message=Table '123#' does not exist. Ensure table '123#' is set correctly
invalidreferenceName.error.message=Invalid reference name
invalid.host.message=Exception while trying to validate schema of database table
invalid.password.message=SQL error while getting query schema:
invalid.databasename.message=SQL error while getting query schema:
invalid.query.message=SQL error while getting query schema:
invalid.host.message=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '08S01', errorCode: '0', errorMessage: SQL Exception occurred: [Message='Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.', SQLState='08S01', ErrorCode='0'].'
invalid.password.message=SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user '
invalid.databasename.message=SQL Error occurred, sqlState: '42000', errorCode: '1049', errorMessage: SQL Exception occurred: [Message='Unknown database 'test123'', SQLState='42000', ErrorCode='1049'].
invalid.query.message=SQL Error occurred, sqlState: 'HY000', errorCode: '1096', errorMessage: SQL Exception occurred: [Message='No tables used', SQLState='HY000', ErrorCode='1096'].
numberofsplits.error.message=Unable to create config for batchsource Mysql 'numSplits' is invalid
boundingQuery.error.message=Bounding Query must be specified if Number of Splits is not set to 1.
splitfield.error.message=Split-By Field Name must be specified if Number of Splits is not set to 1
invalid.sink.database.message=Exception while trying to validate schema
invalid.sink.database.message=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '42000', errorCode: '1049', errorMessage: SQL Exception occurred: [Message='Unknown database 'test123'', SQLState='42000', ErrorCode='1049'].'
blank.username.message=Username is required when password is given.
errorMessageInvalidFetchSize=Invalid fetch size. Fetch size must be a positive integer.
errorMessageInvalidNumberOfSplits=Invalid value for Number of Splits '0'. Must be at least 1.
errorMessageInvalidImportQuery=Import Query select must contain the string '$CONDITIONS'.
blank.connection.message=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '28000', errorCode: '1045', errorMessage: SQL Exception occurred: [Message='Access denied for user '
blank.HostConnection.message=Error encountered while configuring the stage: 'SQL Error occurred, sqlState: '08S01', errorCode: '0', errorMessage: SQL Exception occurred: [Message='Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.', SQLState='08S01', ErrorCode='0'].'
blank.jdbcPluginName.message=Required property 'jdbcPluginName' has no value.
2 changes: 1 addition & 1 deletion netezza-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Netezza plugin</name>
Expand Down
2 changes: 1 addition & 1 deletion oracle-plugin/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@
<parent>
<artifactId>database-plugins-parent</artifactId>
<groupId>io.cdap.plugin</groupId>
<version>1.11.13-SNAPSHOT</version>
<version>1.11.13</version>
</parent>

<name>Oracle plugin</name>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -296,7 +296,7 @@ Feature: Oracle - Verify data transfer from Oracle source to BigQuery sink
Then Close the Plugin Properties page
Then Save the pipeline
Then Preview and run the pipeline
Then Wait till pipeline preview is in running state
Then Wait till pipeline preview is in running state and check if any error occurs
Then Verify the preview run status of pipeline in the logs is "failed"

@ORACLE_SOURCE_TEST @BQ_SINK_TEST
Expand Down
Loading
Loading