Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Features for control center phase2 #15456

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from
Open

Features for control center phase2 #15456

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
94 changes: 94 additions & 0 deletions cdap-e2e-tests/src/e2e-test/features/controlcenter/DesignTime.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,94 @@
# Copyright © 2023 Cask Data, Inc.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may not
# use this file except in compliance with the License. You may obtain a copy of
# the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations under
# the License.

@Controlcenter

Feature: Controlcenter - Validate control center page flow design time features.

Scenario: Verify user is able to click the control center tab and successfully navigates to control center page
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify that the user is navigated to control center page successfully

Scenario: Verify the Display message should be updated on the basis of filter selection as per the user
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Select dropdown : "Filter" with option value: "Artifacts" in control center
Then Verify the all entities message is displayed with the filter selection: "allEntitiesDisplayedMessage"

Scenario: Verify User is able to switch between Schema and programs of the dataset.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to click dataset entity icon to navigate to details page
Then Verify user is navigated to the details page of the dataset entity icon successfully
Then Click on the schema link of the dataset entity details page
Then Verify user is navigated to the schema details page of the dataset entity page
Then Click on the programs link of the dataset entity details page
Then Verify user is navigated to the programs details page of the dataset entity page

Scenario: Verify User is able to sort the entities with all the available filter types in control center.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Select the sort by dropdown with option value: "Newest"
Then Verify the entities are sorted by the newest option: "newFilterMessage"
Then Select the sort by dropdown with option value: "Oldest"
Then Verify the entities are sorted by the oldest option: "oldestFilterMessage"
Then Select the sort by dropdown with option value: "A - Z"
Then Verify the entities are sorted by the Z to A option: "aToZFilterMessage"
Then Select the sort by dropdown with option value: "Z - A"
Then Verify the entities are sorted by the A to Z option: "zToAFilterMessage"

Scenario: Verify the user is able to navigate to and from details page of a dataset inside control center
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to click dataset entity icon to navigate to details page
Then Click on view details tab of dataset entity
Then Verify user is successfully navigated to details page of the dataset entity
Then Click on the back link of the view details page of dataset entity
Then Click on close link to close the details page of dataset entity
Then Verify that the user is navigated to control center page successfully

Scenario: Verify user should be able to search the dataset using the added tags.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to click dataset entity icon to navigate to details page
Then Click on the plus button to add the tag for a dataset entity
Then Verify user is able to enter the values in tag input field: "testingTag"
Then Enter the text in search tab "testingTag" in control center
Then Verify the searched tag is displayed successfully on control center page: "searchedTagDisplayedMessage"

Scenario: Verify that User is able to click on the dataset entity and is navigated to the details page of the dataset successfully
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to click dataset entity icon to navigate to details page
Then Verify user is navigated to the details page of the dataset entity icon successfully

Scenario: Verify that tags counts should be increased and decreased in case User perform Add or Remove actions on dataset entity.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to click dataset entity icon to navigate to details page
Then Click on the plus button to add the tag for a dataset entity
Then Verify user is able to enter the values in tag input field: "testingTag"
Then Verify the tag count of dataset entity when user adds the tag
Then Click on the close icon of tag added
Then Verify the tag count of dataset entity decreases message: "tagCountDecreaseMessage"
Then Click on close link to close the details page of dataset entity
223 changes: 223 additions & 0 deletions cdap-e2e-tests/src/e2e-test/features/controlcenter/RunTime.feature
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,223 @@
# Copyright © 2023 Cask Data, Inc.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may not
# use this file except in compliance with the License. You may obtain a copy of
# the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations under
# the License.

@Controlcenter

Feature: Controlcenter - Validate control center page flow run time features.

@BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
Scenario: Verify that user is able to create a pipeline and then validate the presence of created pipeline in control center.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click on the Plus Green Button to import the pipelines
Then Click on create button to create a pipeline
When Expand Plugin group in the LHS plugins list: "Source"
When Select plugin: "BigQuery" from the plugins list as: "Source"
When Expand Plugin group in the LHS plugins list: "Sink"
When Select plugin: "BigQuery" from the plugins list as: "Sink"
Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
Then Navigate to the properties page of plugin: "BigQuery"
And Enter input plugin property: "referenceName" with value: "Reference"
And Replace input plugin property: "project" with value: "projectId"
And Enter input plugin property: "datasetProject" with value: "projectId"
And Replace input plugin property: "dataset" with value: "dataset"
Then Override Service account details if set in environment variables
And Enter input plugin property: "table" with value: "bqSourceTable"
Then Click on the Get Schema button
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Navigate to the properties page of plugin: "BigQuery2"
Then Replace input plugin property: "project" with value: "projectId"
Then Override Service account details if set in environment variables
Then Enter input plugin property: "datasetProject" with value: "projectId"
Then Enter input plugin property: "referenceName" with value: "BQReferenceName"
Then Enter input plugin property: "dataset" with value: "dataset"
Then Enter input plugin property: "table" with value: "bqTargetTable"
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Wait till pipeline is in running state
Then Verify the pipeline status is "Succeeded"
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the pipeline created successfully is present in control center page

@BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
Scenario: Verify the user is able to set preferences for a deployed pipeline and use the same while running the pipeline.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click on the Plus Green Button to import the pipelines
Then Click on create button to create a pipeline
When Expand Plugin group in the LHS plugins list: "Source"
When Select plugin: "BigQuery" from the plugins list as: "Source"
When Expand Plugin group in the LHS plugins list: "Sink"
When Select plugin: "BigQuery" from the plugins list as: "Sink"
Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
Then Navigate to the properties page of plugin: "BigQuery"
And Enter input plugin property: "referenceName" with value: "Reference"
Then Click on the Macro button of Property: "project" and set the value to: "projectId"
And Enter input plugin property: "datasetProject" with value: "projectId"
And Replace input plugin property: "dataset" with value: "dataset"
Then Override Service account details if set in environment variables
And Enter input plugin property: "table" with value: "bqSourceTable"
Then Click on the Get Schema button
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Navigate to the properties page of plugin: "BigQuery2"
Then Click on the Macro button of Property: "project" and set the value to: "projectId"
Then Override Service account details if set in environment variables
Then Enter input plugin property: "datasetProject" with value: "projectId"
Then Enter input plugin property: "referenceName" with value: "BQReferenceName"
Then Enter input plugin property: "dataset" with value: "dataset"
Then Enter input plugin property: "table" with value: "bqTargetTable"
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to set the preferences for the created pipeline in the control center page
Then Verify the user is able to enter the value in the key input field "keyValue"
Then Verify the user is able to enter the value of the key in the value input field "value"
Then Verify user is able to click on save and close button of set preferences
Then Verify user is able to click on the data pipeline added in the control center page
Then Run the Pipeline in Runtime
Then Wait till pipeline is in running state
Then Verify the pipeline status is "Succeeded"

@BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
Scenario: Verify User is able to delete the preferences by clicking on the delete icon button
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click on the Plus Green Button to import the pipelines
Then Click on create button to create a pipeline
When Expand Plugin group in the LHS plugins list: "Source"
When Select plugin: "BigQuery" from the plugins list as: "Source"
When Expand Plugin group in the LHS plugins list: "Sink"
When Select plugin: "BigQuery" from the plugins list as: "Sink"
Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
Then Navigate to the properties page of plugin: "BigQuery"
And Enter input plugin property: "referenceName" with value: "Reference"
Then Click on the Macro button of Property: "project" and set the value to: "projectId"
And Enter input plugin property: "datasetProject" with value: "projectId"
And Replace input plugin property: "dataset" with value: "dataset"
Then Override Service account details if set in environment variables
And Enter input plugin property: "table" with value: "bqSourceTable"
Then Click on the Get Schema button
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Navigate to the properties page of plugin: "BigQuery2"
Then Click on the Macro button of Property: "project" and set the value to: "projectId"
Then Override Service account details if set in environment variables
Then Enter input plugin property: "datasetProject" with value: "projectId"
Then Enter input plugin property: "referenceName" with value: "BQReferenceName"
Then Enter input plugin property: "dataset" with value: "dataset"
Then Enter input plugin property: "table" with value: "bqTargetTable"
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Verify the user is able to set the preferences for the created pipeline in the control center page
Then Verify the user is able to enter the value in the key input field "keyValue"
Then Verify the user is able to enter the value of the key in the value input field "value"
Then Verify user is able to click on save and close button of set preferences
Then Verify the user is able to set the preferences for the created pipeline in the control center page
Then Verify user is able to click on the delete icon of preferences to delete the added preferences successfully

@BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
Scenario: Verify that User is able to perform Delete and Truncate operation on dataset entity successfully.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click on the Plus Green Button to import the pipelines
Then Click on create button to create a pipeline
When Expand Plugin group in the LHS plugins list: "Source"
When Select plugin: "BigQuery" from the plugins list as: "Source"
When Expand Plugin group in the LHS plugins list: "Sink"
When Select plugin: "BigQuery" from the plugins list as: "Sink"
Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
Then Navigate to the properties page of plugin: "BigQuery"
And Enter input plugin property: "referenceName" with value: "ReferenceDatasetDelete"
And Replace input plugin property: "project" with value: "projectId"
And Enter input plugin property: "datasetProject" with value: "projectId"
And Replace input plugin property: "dataset" with value: "dataset"
Then Override Service account details if set in environment variables
And Enter input plugin property: "table" with value: "bqSourceTable"
Then Click on the Get Schema button
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Navigate to the properties page of plugin: "BigQuery2"
Then Replace input plugin property: "project" with value: "projectId"
Then Override Service account details if set in environment variables
Then Enter input plugin property: "datasetProject" with value: "projectId"
Then Enter input plugin property: "referenceName" with value: "BQReferenceNameDatasetTruncate"
Then Enter input plugin property: "dataset" with value: "dataset"
Then Enter input plugin property: "table" with value: "bqTargetTable"
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Run the Pipeline in Runtime
Then Wait till pipeline is in running state
Then Verify the pipeline status is "Succeeded"
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click truncate and verify the successful truncate of dataset entity
Then Click delete and verify the dataset is deleted successfully
Then Verify the deleted dataset "BQReferenceNameDatasetDelete" entity is not present in control center page

@BQ_INSERT_INT_SOURCE_TEST @BQ_SINK_TEST
Scenario: Verify that user is able to delete the created pipeline in control center successfully.
Given Open Datafusion Project to configure pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click on the Plus Green Button to import the pipelines
Then Click on create button to create a pipeline
When Expand Plugin group in the LHS plugins list: "Source"
When Select plugin: "BigQuery" from the plugins list as: "Source"
When Expand Plugin group in the LHS plugins list: "Sink"
When Select plugin: "BigQuery" from the plugins list as: "Sink"
Then Connect plugins: "BigQuery" and "BigQuery2" to establish connection
Then Navigate to the properties page of plugin: "BigQuery"
And Enter input plugin property: "referenceName" with value: "Reference"
And Replace input plugin property: "project" with value: "projectId"
And Enter input plugin property: "datasetProject" with value: "projectId"
And Replace input plugin property: "dataset" with value: "dataset"
Then Override Service account details if set in environment variables
And Enter input plugin property: "table" with value: "bqSourceTable"
Then Click on the Get Schema button
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Navigate to the properties page of plugin: "BigQuery2"
Then Replace input plugin property: "project" with value: "projectId"
Then Override Service account details if set in environment variables
Then Enter input plugin property: "datasetProject" with value: "projectId"
Then Enter input plugin property: "referenceName" with value: "BQReferenceName"
Then Enter input plugin property: "dataset" with value: "dataset"
Then Enter input plugin property: "table" with value: "bqTargetTable"
Then Validate "BigQuery" plugin properties
And Close the Plugin Properties page
Then Save the pipeline
Then Deploy the pipeline
Then Click on the Hamburger bar on the left panel
Then Click on Control Center link from the hamburger menu
Then Click on the delete icon of the created pipeline and pipeline should get deleted successfully
Then Verify the deleted pipeline is not present in the control center page
Loading