Skip to content

Commit

Permalink
test: disable retry-request for streaming tests (#1127)
Browse files Browse the repository at this point in the history
* fix: fix typings for IAM methods
docs: fixed links in the generated Markdown documentation

PiperOrigin-RevId: 551610576

Source-Link: googleapis/googleapis@73b1313

Source-Link: googleapis/googleapis-gen@8bec066
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiOGJlYzA2NjQ5MmE2ZGEyODU1YjFiOGNlNTYyNjY0YzBhNmIzMGIwMSJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* docs: Specify limit for `properties` in `Index` message in Datastore Admin API
docs: Minor formatting in Datastore Admin API

PiperOrigin-RevId: 551819875

Source-Link: googleapis/googleapis@3db8b01

Source-Link: googleapis/googleapis-gen@7ebf113
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiN2ViZjExMzc2MzliOTM2MTNlNmE2MjA2NjU0YTViYThmMjFlOTMyMSJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* feat: publish proto definitions for SUM/AVG in Datastore

PiperOrigin-RevId: 552847139

Source-Link: googleapis/googleapis@6148e5b

Source-Link: googleapis/googleapis-gen@96be51b
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiOTZiZTUxYjk5NTA0N2JmZGVmNDgyNTE3ODUzOWUyMzg1ODMxMDFhOSJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

* test: disable retry-request for streaming tests

PiperOrigin-RevId: 554648220

Source-Link: googleapis/googleapis@53cd9ad

Source-Link: googleapis/googleapis-gen@7e8867e
Copy-Tag: eyJwIjoiLmdpdGh1Yi8uT3dsQm90LnlhbWwiLCJoIjoiN2U4ODY3ZWZiZWQ3ZGJmZTVlZjZlYzNjMmM5MmE0YmNlNDI4MGY3YSJ9

* 🦉 Updates from OwlBot post-processor

See https://github.com/googleapis/repo-automation-bots/blob/main/packages/owl-bot/README.md

---------

Co-authored-by: Owl Bot <gcf-owl-bot[bot]@users.noreply.github.com>
Co-authored-by: sofisl <[email protected]>
  • Loading branch information
3 people authored Aug 15, 2023
1 parent 4caf162 commit b13ecfc
Show file tree
Hide file tree
Showing 19 changed files with 1,665 additions and 179 deletions.
91 changes: 43 additions & 48 deletions protos/google/datastore/admin/v1/datastore_admin.proto
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
// Copyright 2022 Google LLC
// Copyright 2023 Google LLC
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -34,65 +34,51 @@ option ruby_package = "Google::Cloud::Datastore::Admin::V1";

// Google Cloud Datastore Admin API
//
//
// The Datastore Admin API provides several admin services for Cloud Datastore.
//
// -----------------------------------------------------------------------------
// ## Concepts
//
// Project, namespace, kind, and entity as defined in the Google Cloud Datastore
// API.
// Concepts: Project, namespace, kind, and entity as defined in the Google Cloud
// Datastore API.
//
// Operation: An Operation represents work being performed in the background.
//
// EntityFilter: Allows specifying a subset of entities in a project. This is
// specified as a combination of kinds and namespaces (either or both of which
// may be all).
//
// -----------------------------------------------------------------------------
// ## Services
//
// # Export/Import
// Export/Import Service:
//
// The Export/Import service provides the ability to copy all or a subset of
// - The Export/Import service provides the ability to copy all or a subset of
// entities to/from Google Cloud Storage.
//
// Exported data may be imported into Cloud Datastore for any Google Cloud
// - Exported data may be imported into Cloud Datastore for any Google Cloud
// Platform project. It is not restricted to the export source project. It is
// possible to export from one project and then import into another.
//
// Exported data can also be loaded into Google BigQuery for analysis.
//
// Exports and imports are performed asynchronously. An Operation resource is
// - Exported data can also be loaded into Google BigQuery for analysis.
// - Exports and imports are performed asynchronously. An Operation resource is
// created for each export/import. The state (including any errors encountered)
// of the export/import may be queried via the Operation resource.
//
// # Index
// Index Service:
//
// The index service manages Cloud Datastore composite indexes.
//
// Index creation and deletion are performed asynchronously.
// - The index service manages Cloud Datastore composite indexes.
// - Index creation and deletion are performed asynchronously.
// An Operation resource is created for each such asynchronous operation.
// The state of the operation (including any errors encountered)
// may be queried via the Operation resource.
//
// # Operation
// Operation Service:
//
// The Operations collection provides a record of actions performed for the
// - The Operations collection provides a record of actions performed for the
// specified project (including any operations in progress). Operations are not
// created directly but through calls on other collections or resources.
//
// An operation that is not yet done may be cancelled. The request to cancel is
// asynchronous and the operation may continue to run for some time after the
// - An operation that is not yet done may be cancelled. The request to cancel
// is asynchronous and the operation may continue to run for some time after the
// request to cancel is made.
//
// An operation that is done may be deleted so that it is no longer listed as
// - An operation that is done may be deleted so that it is no longer listed as
// part of the Operation collection.
//
// ListOperations returns all pending operations, but not completed operations.
//
// Operations are created by service DatastoreAdmin,
// but are accessed via service google.longrunning.Operations.
// - ListOperations returns all pending operations, but not completed
// operations.
// - Operations are created by service DatastoreAdmin, but are accessed via
// service google.longrunning.Operations.
service DatastoreAdmin {
option (google.api.default_host) = "datastore.googleapis.com";
option (google.api.oauth_scopes) =
Expand All @@ -107,12 +93,14 @@ service DatastoreAdmin {
// used once the associated operation is done. If an export operation is
// cancelled before completion it may leave partial data behind in Google
// Cloud Storage.
rpc ExportEntities(ExportEntitiesRequest) returns (google.longrunning.Operation) {
rpc ExportEntities(ExportEntitiesRequest)
returns (google.longrunning.Operation) {
option (google.api.http) = {
post: "/v1/projects/{project_id}:export"
body: "*"
};
option (google.api.method_signature) = "project_id,labels,entity_filter,output_url_prefix";
option (google.api.method_signature) =
"project_id,labels,entity_filter,output_url_prefix";
option (google.longrunning.operation_info) = {
response_type: "ExportEntitiesResponse"
metadata_type: "ExportEntitiesMetadata"
Expand All @@ -124,12 +112,14 @@ service DatastoreAdmin {
// progress can be monitored and managed via the Operation resource that is
// created. If an ImportEntities operation is cancelled, it is possible
// that a subset of the data has already been imported to Cloud Datastore.
rpc ImportEntities(ImportEntitiesRequest) returns (google.longrunning.Operation) {
rpc ImportEntities(ImportEntitiesRequest)
returns (google.longrunning.Operation) {
option (google.api.http) = {
post: "/v1/projects/{project_id}:import"
body: "*"
};
option (google.api.method_signature) = "project_id,labels,input_url,entity_filter";
option (google.api.method_signature) =
"project_id,labels,input_url,entity_filter";
option (google.longrunning.operation_info) = {
response_type: "google.protobuf.Empty"
metadata_type: "ImportEntitiesMetadata"
Expand All @@ -138,9 +128,9 @@ service DatastoreAdmin {

// Creates the specified index.
// A newly created index's initial state is `CREATING`. On completion of the
// returned [google.longrunning.Operation][google.longrunning.Operation], the state will be `READY`.
// If the index already exists, the call will return an `ALREADY_EXISTS`
// status.
// returned [google.longrunning.Operation][google.longrunning.Operation], the
// state will be `READY`. If the index already exists, the call will return an
// `ALREADY_EXISTS` status.
//
// During index creation, the process could result in an error, in which
// case the index will move to the `ERROR` state. The process can be recovered
Expand All @@ -165,7 +155,8 @@ service DatastoreAdmin {
// An index can only be deleted if it is in a `READY` or `ERROR` state. On
// successful execution of the request, the index will be in a `DELETING`
// [state][google.datastore.admin.v1.Index.State]. And on completion of the
// returned [google.longrunning.Operation][google.longrunning.Operation], the index will be removed.
// returned [google.longrunning.Operation][google.longrunning.Operation], the
// index will be removed.
//
// During index deletion, the process could result in an error, in which
// case the index will move to the `ERROR` state. The process can be recovered
Expand Down Expand Up @@ -283,8 +274,8 @@ message ExportEntitiesRequest {
//
// The resulting files will be nested deeper than the specified URL prefix.
// The final output URL will be provided in the
// [google.datastore.admin.v1.ExportEntitiesResponse.output_url][google.datastore.admin.v1.ExportEntitiesResponse.output_url] field. That
// value should be used for subsequent ImportEntities operations.
// [google.datastore.admin.v1.ExportEntitiesResponse.output_url][google.datastore.admin.v1.ExportEntitiesResponse.output_url]
// field. That value should be used for subsequent ImportEntities operations.
//
// By nesting the data files deeper, the same Cloud Storage bucket can be used
// in multiple ExportEntities operations without conflict.
Expand All @@ -300,8 +291,9 @@ message ImportEntitiesRequest {
// Client-assigned labels.
map<string, string> labels = 2;

// Required. The full resource URL of the external storage location. Currently, only
// Google Cloud Storage is supported. So input_url should be of the form:
// Required. The full resource URL of the external storage location.
// Currently, only Google Cloud Storage is supported. So input_url should be
// of the form:
// `gs://BUCKET_NAME[/NAMESPACE_PATH]/OVERALL_EXPORT_METADATA_FILE`, where
// `BUCKET_NAME` is the name of the Cloud Storage bucket, `NAMESPACE_PATH` is
// an optional Cloud Storage namespace path (this is not a Cloud Datastore
Expand Down Expand Up @@ -369,7 +361,9 @@ message ImportEntitiesMetadata {
EntityFilter entity_filter = 4;

// The location of the import metadata file. This will be the same value as
// the [google.datastore.admin.v1.ExportEntitiesResponse.output_url][google.datastore.admin.v1.ExportEntitiesResponse.output_url] field.
// the
// [google.datastore.admin.v1.ExportEntitiesResponse.output_url][google.datastore.admin.v1.ExportEntitiesResponse.output_url]
// field.
string input_url = 5;
}

Expand Down Expand Up @@ -427,7 +421,8 @@ message DeleteIndexRequest {
string index_id = 3;
}

// The request for [google.datastore.admin.v1.DatastoreAdmin.GetIndex][google.datastore.admin.v1.DatastoreAdmin.GetIndex].
// The request for
// [google.datastore.admin.v1.DatastoreAdmin.GetIndex][google.datastore.admin.v1.DatastoreAdmin.GetIndex].
message GetIndexRequest {
// Project ID against which to make the request.
string project_id = 1;
Expand Down
15 changes: 11 additions & 4 deletions protos/google/datastore/admin/v1/index.proto
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
// Copyright 2022 Google LLC
// Copyright 2023 Google LLC
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -60,7 +60,8 @@ message Index {
// Required. The property name to index.
string name = 1 [(google.api.field_behavior) = REQUIRED];

// Required. The indexed property's direction. Must not be DIRECTION_UNSPECIFIED.
// Required. The indexed property's direction. Must not be
// DIRECTION_UNSPECIFIED.
Direction direction = 2 [(google.api.field_behavior) = REQUIRED];
}

Expand Down Expand Up @@ -104,11 +105,17 @@ message Index {
// Required. The entity kind to which this index applies.
string kind = 4 [(google.api.field_behavior) = REQUIRED];

// Required. The index's ancestor mode. Must not be ANCESTOR_MODE_UNSPECIFIED.
// Required. The index's ancestor mode. Must not be
// ANCESTOR_MODE_UNSPECIFIED.
AncestorMode ancestor = 5 [(google.api.field_behavior) = REQUIRED];

// Required. An ordered sequence of property names and their index attributes.
repeated IndexedProperty properties = 6 [(google.api.field_behavior) = REQUIRED];
//
// Requires:
//
// * A maximum of 100 properties.
repeated IndexedProperty properties = 6
[(google.api.field_behavior) = REQUIRED];

// Output only. The state of the index.
State state = 7 [(google.api.field_behavior) = OUTPUT_ONLY];
Expand Down
2 changes: 1 addition & 1 deletion protos/google/datastore/admin/v1/migration.proto
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
// Copyright 2022 Google LLC
// Copyright 2023 Google LLC
//
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
Expand Down
14 changes: 10 additions & 4 deletions protos/google/datastore/v1/datastore.proto
Original file line number Diff line number Diff line change
Expand Up @@ -578,9 +578,12 @@ message ReadOptions {
// [RunQueryResponse.transaction][google.datastore.v1.RunQueryResponse.transaction].
TransactionOptions new_transaction = 3;

// Reads entities as they were at the given time. This may not be older
// than 270 seconds. This value is only supported for Cloud Firestore in
// Datastore mode.
// Reads entities as they were at the given time. This value is only
// supported for Cloud Firestore in Datastore mode.
//
// This must be a microsecond precision timestamp within the past one hour,
// or if Point-in-Time Recovery is enabled, can additionally be a whole
// minute timestamp within the past 7 days.
google.protobuf.Timestamp read_time = 4;
}
}
Expand All @@ -602,7 +605,10 @@ message TransactionOptions {
// Options specific to read-only transactions.
message ReadOnly {
// Reads entities at the given time.
// This may not be older than 60 seconds.
//
// This must be a microsecond precision timestamp within the past one hour,
// or if Point-in-Time Recovery is enabled, can additionally be a whole
// minute timestamp within the past 7 days.
google.protobuf.Timestamp read_time = 1;
}

Expand Down
57 changes: 53 additions & 4 deletions protos/google/datastore/v1/query.proto
Original file line number Diff line number Diff line change
Expand Up @@ -163,10 +163,58 @@ message AggregationQuery {
[(google.api.field_behavior) = OPTIONAL];
}

// Sum of the values of the requested property.
//
// * Only numeric values will be aggregated. All non-numeric values
// including `NULL` are skipped.
//
// * If the aggregated values contain `NaN`, returns `NaN`. Infinity math
// follows IEEE-754 standards.
//
// * If the aggregated value set is empty, returns 0.
//
// * Returns a 64-bit integer if all aggregated numbers are integers and the
// sum result does not overflow. Otherwise, the result is returned as a
// double. Note that even if all the aggregated values are integers, the
// result is returned as a double if it cannot fit within a 64-bit signed
// integer. When this occurs, the returned value will lose precision.
//
// * When underflow occurs, floating-point aggregation is non-deterministic.
// This means that running the same query repeatedly without any changes to
// the underlying values could produce slightly different results each
// time. In those cases, values should be stored as integers over
// floating-point numbers.
message Sum {
// The property to aggregate on.
PropertyReference property = 1;
}

// Average of the values of the requested property.
//
// * Only numeric values will be aggregated. All non-numeric values
// including `NULL` are skipped.
//
// * If the aggregated values contain `NaN`, returns `NaN`. Infinity math
// follows IEEE-754 standards.
//
// * If the aggregated value set is empty, returns `NULL`.
//
// * Always returns the result as a double.
message Avg {
// The property to aggregate on.
PropertyReference property = 1;
}

// The type of aggregation to perform, required.
oneof operator {
// Count aggregator.
Count count = 1;

// Sum aggregator.
Sum sum = 2;

// Average aggregator.
Avg avg = 3;
}

// Optional. Optional name of the property to store the result of the
Expand Down Expand Up @@ -342,8 +390,9 @@ message PropertyFilter {
//
// Requires:
//
// * That `value` is a non-empty `ArrayValue` with at most 10 values.
// * No other `IN` or `NOT_IN` is in the same query.
// * That `value` is a non-empty `ArrayValue`, subject to disjunction
// limits.
// * No `NOT_IN` is in the same query.
IN = 6;

// The given `property` is not equal to the given `value`.
Expand All @@ -359,15 +408,15 @@ message PropertyFilter {
// Requires:
//
// * That `value` is an entity key.
// * No other `HAS_ANCESTOR` is in the same query.
// * All evaluated disjunctions must have the same `HAS_ANCESTOR` filter.
HAS_ANCESTOR = 11;

// The value of the `property` is not in the given array.
//
// Requires:
//
// * That `value` is a non-empty `ArrayValue` with at most 10 values.
// * No other `IN`, `NOT_IN`, `NOT_EQUAL` is in the same query.
// * No other `OR`, `IN`, `NOT_IN`, `NOT_EQUAL` is in the same query.
// * That `field` comes first in the `order_by`.
NOT_IN = 13;
}
Expand Down
Loading

0 comments on commit b13ecfc

Please sign in to comment.