Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

V1.8.3 release #521

Merged
merged 160 commits into from
Dec 23, 2022
Merged
Changes from all commits
Commits
Show all changes
160 commits
Select commit Hold shift + click to select a range
9c7b659
temp save
sfc-gh-zefan Jul 21, 2022
f9efe2e
recover tests
sfc-gh-zefan Jul 21, 2022
d299ad5
recover connection files
sfc-gh-zefan Jul 21, 2022
24a5ab2
recover sink file
sfc-gh-zefan Jul 21, 2022
77454a3
fix test
sfc-gh-zefan Jul 21, 2022
b34ddff
update name; add doc
sfc-gh-zefan Jul 22, 2022
4577d77
cosmetic changes; update tests
sfc-gh-zefan Jul 22, 2022
e87cc39
temp save
sfc-gh-zefan Jul 25, 2022
c9e774a
add failed buffer logic
sfc-gh-zefan Jul 25, 2022
937f302
update function
sfc-gh-zefan Jul 25, 2022
a3e65ee
Update src/main/java/com/snowflake/kafka/connector/Utils.java
sfc-gh-zefan Jul 27, 2022
8e83cb3
temp save
sfc-gh-zefan Jul 27, 2022
afa12f7
manual test pass; avro not implemented
sfc-gh-zefan Jul 27, 2022
f33e52c
minor change
sfc-gh-zefan Jul 28, 2022
79d92b7
Merge branch 'schema-mapping-new' of https://github.com/snowflakedb/s…
sfc-gh-zefan Jul 28, 2022
ef44b9a
random change
sfc-gh-zefan Jul 28, 2022
3c4d24f
add case-insensitive duplicate column name check
sfc-gh-zefan Jul 28, 2022
9234a34
temp save
sfc-gh-zefan Jul 29, 2022
6480ad0
add getSchema function; update pom.xml
sfc-gh-zefan Jul 29, 2022
f05dfa1
add getSchema function; update pom.xml
sfc-gh-zefan Jul 29, 2022
950e603
add createTableWithSchema function
sfc-gh-zefan Jul 29, 2022
7882eff
temp save
sfc-gh-zefan Jul 29, 2022
e591379
add column name formatting
sfc-gh-zefan Aug 1, 2022
33f69fc
temp save
sfc-gh-zefan Aug 1, 2022
6ffd5d5
bug detected; temp fix 5s sleep
sfc-gh-zefan Aug 4, 2022
5536236
temp save
sfc-gh-zefan Aug 4, 2022
5b86541
bug located; solution pending
sfc-gh-zefan Aug 4, 2022
1f1b211
update tests
sfc-gh-zefan Aug 4, 2022
0e1be38
roll back unit tests
sfc-gh-zefan Aug 5, 2022
752393f
test updated to disable auto adding of RECORD_METADATA column
sfc-gh-zefan Aug 7, 2022
b7e3571
to observe error log
sfc-gh-zefan Aug 7, 2022
b791d6c
create pr
sfc-gh-zefan Aug 8, 2022
bbb2b23
fix test
sfc-gh-zefan Aug 8, 2022
8dc65dd
update RecordService to allow array processing introduced in Ingest S…
sfc-gh-zefan Aug 8, 2022
cb542ed
another update to catch up to Ingest SDK
sfc-gh-zefan Aug 8, 2022
84cde4c
Merge branch 'master' into schema-mapping-new
sfc-gh-zefan Aug 8, 2022
9916bad
update test
sfc-gh-zefan Aug 8, 2022
a0bb6e5
catch up master
sfc-gh-zefan Aug 8, 2022
b0e98b2
Merge branch 'schema-mapping-new' of https://github.com/snowflakedb/s…
sfc-gh-zefan Aug 8, 2022
ba92ba9
update tests
sfc-gh-zefan Aug 8, 2022
b40eee4
update tests
sfc-gh-zefan Aug 8, 2022
2aa9f1c
disable schema-mapping test
sfc-gh-zefan Aug 8, 2022
aad7cb8
temp save
sfc-gh-zefan Aug 8, 2022
4f5c3d2
update test
sfc-gh-zefan Aug 8, 2022
cf9f1bc
bug located
sfc-gh-zefan Aug 8, 2022
85842b4
update tests
sfc-gh-zefan Aug 9, 2022
d4e134b
update tests
sfc-gh-zefan Aug 9, 2022
b18cee0
update test
sfc-gh-zefan Aug 9, 2022
dbcc7a1
temp save
sfc-gh-zefan Aug 9, 2022
1e9fe00
wipe array related from test temporarily
sfc-gh-zefan Aug 9, 2022
219a98e
update test
sfc-gh-zefan Aug 9, 2022
4275adf
update test
sfc-gh-zefan Aug 9, 2022
9972257
update test
sfc-gh-zefan Aug 9, 2022
cbf9596
temp save
sfc-gh-zefan Aug 9, 2022
4d24121
update log
sfc-gh-zefan Aug 9, 2022
e87ba10
fix bug in test
sfc-gh-zefan Aug 9, 2022
3939777
Merge branch 'schema-mapping-new' into auto-table-creation-new
sfc-gh-zefan Aug 9, 2022
3ff921e
update tests
sfc-gh-zefan Aug 10, 2022
2f7f9f4
?
sfc-gh-zefan Aug 10, 2022
f32e439
temp save
sfc-gh-zefan Aug 10, 2022
ac8d086
Merge branch 'schema-evolution-implementation' of https://github.com/…
sfc-gh-zefan Aug 10, 2022
890db82
update code
sfc-gh-zefan Aug 10, 2022
04c3710
code reorganized
sfc-gh-zefan Aug 10, 2022
71265cf
Merge branch 'schema-mapping-new' into schema-evolution-2
sfc-gh-zefan Aug 10, 2022
19f2630
minor change
sfc-gh-zefan Aug 10, 2022
c802d72
fix bug related to channel offset reset
sfc-gh-zefan Aug 10, 2022
3e94a3a
reading type from schema registry
sfc-gh-zefan Aug 11, 2022
452f263
recovery
sfc-gh-zefan Aug 11, 2022
834ac51
recovery
sfc-gh-zefan Aug 12, 2022
89859d9
recovery
sfc-gh-zefan Aug 12, 2022
ff99ce7
ITtest added
sfc-gh-zefan Aug 12, 2022
b03b628
fix bug when schema registry contains no schema
sfc-gh-zefan Aug 12, 2022
27b3d5a
fix IT test
sfc-gh-zefan Aug 12, 2022
ec4379d
fix format
sfc-gh-zefan Aug 12, 2022
205616c
add waiting between channel reopen
sfc-gh-zefan Aug 12, 2022
ea9ad52
minor change
sfc-gh-zefan Aug 12, 2022
25af874
doc added
sfc-gh-zefan Aug 12, 2022
8c7c73d
update IT test
sfc-gh-zefan Aug 12, 2022
ed55c94
add tests
sfc-gh-zefan Aug 13, 2022
3e6de2a
merge master
sfc-gh-zefan Aug 15, 2022
38cf718
merge auto-table-creation
sfc-gh-zefan Aug 15, 2022
d38f14e
merge auto-table-creation
sfc-gh-zefan Aug 15, 2022
2a64fb1
add tests; fix offset bug
sfc-gh-zefan Aug 15, 2022
bf42598
add tests
sfc-gh-zefan Aug 15, 2022
8b69243
update test
sfc-gh-zefan Aug 15, 2022
eb03ce1
update tests
sfc-gh-zefan Aug 15, 2022
17c01ac
fix tests; add permission check
sfc-gh-zefan Aug 15, 2022
f2af103
add config default
sfc-gh-zefan Aug 15, 2022
33b76a4
fix test; fix role name bug
sfc-gh-zefan Aug 15, 2022
d1e0ef5
fix DLQ handling
sfc-gh-zefan Aug 15, 2022
0c1551f
minor change
sfc-gh-zefan Aug 16, 2022
e53b0b2
cosmetic change
sfc-gh-zefan Aug 16, 2022
817301c
minor changes
sfc-gh-zefan Aug 16, 2022
e5450eb
Update src/main/java/com/snowflake/kafka/connector/Utils.java
sfc-gh-zefan Aug 16, 2022
53887f8
add tests; fix create table with only RECORD_METADATA
sfc-gh-zefan Aug 16, 2022
d73c0f0
add tests
sfc-gh-zefan Aug 16, 2022
a5eec91
minor change
sfc-gh-zefan Aug 16, 2022
38a914f
Merge branch 'auto-table-creation-new' of github.com:snowflakedb/snow…
sfc-gh-zefan Aug 16, 2022
1cc4ee7
fix test
sfc-gh-zefan Aug 16, 2022
efdaa23
fix tests config; code reorganization
sfc-gh-zefan Aug 17, 2022
795344e
add test
sfc-gh-zefan Aug 17, 2022
54fad2d
add tests
sfc-gh-zefan Aug 17, 2022
557c72e
update loggin
sfc-gh-zefan Aug 17, 2022
96fcd1c
merge master
sfc-gh-zefan Aug 17, 2022
690e5de
fix auto table creation
sfc-gh-zefan Aug 17, 2022
4c0e638
Merge branch 'master' into schema-evolution-implementation
sfc-gh-zefan Aug 17, 2022
5a03dbf
minor change
sfc-gh-zefan Aug 17, 2022
6552d6d
add alter nun-nullable column; code refactored; tests fixed
sfc-gh-zefan Aug 18, 2022
a470841
fix avro record bug
sfc-gh-zefan Aug 18, 2022
612835c
true fix for avro; add tests
sfc-gh-zefan Aug 18, 2022
48d0d7b
add util tests
sfc-gh-zefan Aug 18, 2022
ac8ebb4
test deduplication
sfc-gh-zefan Aug 18, 2022
81986d0
add object to schema-mapping test
sfc-gh-zefan Aug 19, 2022
0aafa14
update according to review
sfc-gh-zefan Aug 22, 2022
a0c007a
cosmetic change
sfc-gh-zefan Aug 24, 2022
b9997bc
refactor unit tests
sfc-gh-zefan Aug 24, 2022
65e9e59
minor change
sfc-gh-zefan Aug 24, 2022
5472783
update SDK response related logic
sfc-gh-zefan Aug 25, 2022
57bda63
update schema mapping case sensitive test
sfc-gh-zefan Aug 25, 2022
c0bd773
restore schema mapping array check
sfc-gh-zefan Aug 25, 2022
fe34630
update to the latest sdk
sfc-gh-zefan Aug 25, 2022
9a7a4c8
cosmetic change; update schema evolution tests to include case sensit…
sfc-gh-zefan Aug 26, 2022
a021c3c
update schematization config in tests
sfc-gh-zefan Aug 26, 2022
7b410bd
minor change
sfc-gh-zefan Aug 26, 2022
c0cd19e
minor change
sfc-gh-zefan Aug 26, 2022
99c3914
minor change
sfc-gh-zefan Aug 27, 2022
ed5d4de
various fixes
sfc-gh-tzhang Sep 14, 2022
7ea081a
java format
sfc-gh-tzhang Sep 14, 2022
82e19b1
fix test
sfc-gh-tzhang Sep 14, 2022
7ac5b42
merge master
sfc-gh-tzhang Sep 14, 2022
eed59f2
Merge branch 'master' into tzhang-si-auto
sfc-gh-tzhang Sep 14, 2022
bde761e
merge master
sfc-gh-tzhang Sep 15, 2022
95299d1
use schema info in sinkrecord
sfc-gh-tzhang Sep 21, 2022
a4f8802
merge master
sfc-gh-tzhang Sep 21, 2022
b69e504
minor change
sfc-gh-tzhang Sep 21, 2022
5534387
merge master
sfc-gh-tzhang Sep 30, 2022
38d0277
support alter table
sfc-gh-tzhang Oct 4, 2022
c2aab86
add some unit tests
sfc-gh-tzhang Oct 5, 2022
5f3d38c
save progress
sfc-gh-tzhang Oct 8, 2022
e3a8d5c
save progress
sfc-gh-tzhang Oct 10, 2022
25766f4
add tests
sfc-gh-tzhang Oct 12, 2022
cbc6e23
format
sfc-gh-tzhang Oct 12, 2022
7a005e0
Merge branch 'master' into schema-evolution-implementation
sfc-gh-tzhang Oct 12, 2022
325692e
add more tests
sfc-gh-tzhang Oct 13, 2022
18acfd3
fix tests
sfc-gh-tzhang Oct 14, 2022
5a12051
address comments
sfc-gh-tzhang Oct 25, 2022
32ffdcd
address comment
sfc-gh-tzhang Oct 25, 2022
12e22c8
Merge branch 'master' into schema-evolution-implementation
sfc-gh-tzhang Oct 25, 2022
236e408
check schema evolution option
sfc-gh-tzhang Nov 2, 2022
2fb2776
merge master
sfc-gh-tzhang Nov 2, 2022
8c1c849
format
sfc-gh-tzhang Nov 2, 2022
4484a7a
update tests
sfc-gh-tzhang Nov 4, 2022
50a2e28
Merge branch 'master' into schema-evolution-implementation
sfc-gh-tzhang Nov 23, 2022
0324878
check converters
sfc-gh-tzhang Dec 21, 2022
1907ef3
format
sfc-gh-tzhang Dec 21, 2022
5e4c70a
add tests
sfc-gh-tzhang Dec 21, 2022
8c2d5b4
fix test failure
sfc-gh-tzhang Dec 22, 2022
2c6982b
1.8.3 release
sfc-gh-tzhang Dec 22, 2022
babb5ea
Merge branch 'master' into schema-evolution-implementation
sfc-gh-tzhang Dec 22, 2022
2437b17
fix format
sfc-gh-tzhang Dec 22, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion pom.xml
Original file line number Diff line number Diff line change
@@ -12,7 +12,7 @@

<groupId>com.snowflake</groupId>
<artifactId>snowflake-kafka-connector</artifactId>
<version>1.8.2</version>
<version>1.8.3</version>
<packaging>jar</packaging>
<name>Snowflake Kafka Connector</name>
<description>Snowflake Kafka Connect Sink Connector</description>
4 changes: 2 additions & 2 deletions pom_confluent.xml
Original file line number Diff line number Diff line change
@@ -13,7 +13,7 @@

<groupId>com.snowflake</groupId>
<artifactId>snowflake-kafka-connector</artifactId>
<version>1.8.2</version>
<version>1.8.3</version>
<packaging>jar</packaging>
<name>Snowflake Kafka Connector</name>
<description>Snowflake Kafka Connect Sink Connector</description>
@@ -368,7 +368,7 @@
<dependency>
<groupId>net.snowflake</groupId>
<artifactId>snowflake-ingest-sdk</artifactId>
<version>1.0.2-beta.4</version>
<version>1.0.2-beta.7</version>
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was there some perf regression in 1.0.2-beta.5? I saw some jira from @sfc-gh-lsembera

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, there was a perf regression relating to timestamps.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, but beta.5-beta.7 also contain a bunch of corruption/wrong result fixes, so I think it would be good to upgrade since correctness is more important than performance (for example: https://snowflakecomputing.atlassian.net/browse/SNOW-718273 shows we're hitting it in SFCTEST0)

</dependency>

<dependency>
2 changes: 1 addition & 1 deletion src/main/java/com/snowflake/kafka/connector/Utils.java
Original file line number Diff line number Diff line change
@@ -50,7 +50,7 @@
public class Utils {

// Connector version, change every release
public static final String VERSION = "1.8.2";
public static final String VERSION = "1.8.3";

// connector parameter list
public static final String NAME = "name";