Skip to content

Issues: GoogleCloudDataproc/spark-bigquery-connector

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 500 Closed
30 Open 500 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Internal Error when writing Pyspark df to partitioned Bigquery table (Dataproc)
#1300 opened Oct 1, 2024 by lorenh516
4
[Glue 4.0 integration]
#1299 opened Sep 26, 2024 by Repomano
What determines the Query API vs. Storage API to be used?
#1298 opened Sep 26, 2024 by whittid4
Support for spark version 3.5.0 - support required for UNTYPED_SCALA_UDF version
#1297 opened Sep 24, 2024 by VIKCT001
@davidrabinowitz
2
Setting a different client api endpoiint for Bigquery
#1296 opened Sep 23, 2024 by EmilioIppoliti
@davidrabinowitz
1
org.apache.spark.sql.AnalysisException: [UNSUPPORTED_DESERIALIZER.DATA_TYPE_MISMATCH] The deserializer is not supported: need a(n) "ARRAY" field but got "MAP<STRING, STRING>".
#1295 opened Sep 20, 2024 by VIKCT001
@isha97
6
BigQuery RANGE (and INTERVAL) support enhancement New feature or request
#1292 opened Sep 12, 2024 by 0rnella
1
Issue with BigQuery counts in Spark after writing to table
#1290 opened Sep 5, 2024 by rchynoweth
@vishalkarve15
2
Unable to write to BigQuery table with require_partition_filter = true when spark.sql.sources.partitionOverwriteMode is set to DYNAMIC
#1285 opened Sep 3, 2024 by ktchana
@isha97
1
bigquery.tables.create Permission required on appending data to a BigQuery Table
#1277 opened Aug 6, 2024 by smic-datalabs-jdcastro
@vishalkarve15
2
cloud cost when using spark bq connector
#1274 opened Aug 2, 2024 by kaiseu
@isha97
Empty array filtering issue
#1268 opened Jul 23, 2024 by vokuk-walkme
@vishalkarve15
1
Reading a view results in a empty data frame
#1266 opened Jul 23, 2024 by tom-s-powell
7
Configuring DataProc Cluster to Publish BigQuery Metrics on GCP enhancement New feature or request
#1233 opened May 24, 2024 by gmiano
1
Add createTable(TableInfo) method to BigQueryClient enhancement New feature or request
#1213 opened Apr 15, 2024 by jphalip
java.lang.NoSuchMethodError: 'org.apache.spark.sql.catalyst.encoders.ExpressionEncoder org.apache.spark.sql.catalyst.encoders.RowEncoder.apply(org.apache.spark.sql.types.StructType)'
#1209 opened Apr 9, 2024 by CatalinMihaiIonescu
@isha97
6
BigQuery Pushdown filtering on Spark 3.4.2 enhancement New feature or request
#1207 opened Apr 3, 2024 by sid-habu
11
Automatically read JSON types enhancement New feature or request
#1203 opened Mar 25, 2024 by Guilherme-B
Idempotent write support in BQ enhancement New feature or request
#1199 opened Mar 14, 2024 by SubhamSinghal
Table expiration with write() operation enhancement New feature or request
#1189 opened Feb 23, 2024 by mikeperello-scopely
2
Clarification on Billing and Improved README.md Explanation
#1172 opened Jan 17, 2024 by LakshmanKishore
@isha97
1
Support use of bigquery-emulator for integration testing enhancement New feature or request
#1169 opened Jan 16, 2024 by JosefNagelschmidt
2
Support spark 3.5 enhancement New feature or request
#1142 opened Dec 11, 2023 by melin
2
BigQuery Write API cannot use BigQuery CDC feature enhancement New feature or request
#1086 opened Oct 11, 2023 by jster1357
HTTP PROXY Support NTCredentials blocked Waiting for another issue to be fixed
#1071 opened Sep 27, 2023 by dfercode
3
ProTip! Follow long discussions with comments:>50.