Releases: snowflakedb/snowflake-ingest-java
v3.1.2
What's Changed
- SNOW-1798694: Improve SDK local setup documentation to enable logging by @sfc-gh-tzhang in #934
- SNOW-1950183 Resolve Iceberg ingestion filename mismatch between upload and registration by @sfc-gh-alhuang in #958
- Release 3.1.2 by @sfc-gh-alhuang in #959
Full Changelog: v3.1.1...v3.1.2
v3.1.2-beta
What's Changed
- Pulling in snowflake-jdbc-thin dependency
Full Changelog: v3.1.1...v3.1.2-beta.unshaded
v3.1.1
What's Changed
- SNOW-1881734 Silence uploadWithoutConnection exception log by @sfc-gh-lsembera in #942
- SNOW-1948462: Fix Jenkins job to push artifacts to Maven by @sfc-gh-anavalos in #949
- SNOW-1947905 Fix proxy setting for OAuth http client by @sfc-gh-alhuang in #948
- Updates Java formatter script and dependency by @sfc-gh-tjones in #951
- Adds richer docstring information to key classes by @sfc-gh-tjones in #955
- Release 3.1.1 by @sfc-gh-alhuang in #954
New Contributors
- @sfc-gh-anavalos made their first contribution in #949
Full Changelog: v3.1.0...v3.1.1
v3.1.0
Behavior Change
Duplicate keys in variant columns are now handled gracefully client-side with error: INVALID_VALUE_ROW
- [SNOW-1882616] Error out for duplicate keys in variant by @sfc-gh-ggeng in #929
What's Changed
- Clean up proxy after unit tests by @sfc-gh-alhuang in #932
- SNOW-1878090 - Upgrade JDBC by @sfc-gh-xhuang in #935
- Allow passing custom metadata to for testing by @sfc-gh-skurella in #937
- Release 3.1.0 by @sfc-gh-xhuang in #936
- NO-SNOW Upgrade netty to 4.1.118 by @sfc-gh-xhuang in #938
New Contributors
- @sfc-gh-skurella made their first contribution in #937
Full Changelog: v3.0.1...v3.1.0
v3.0.1
What's Changed
- Added new tests and merge gates
- SNOW-1806157 Fix field id mismatch during schema evolution for structured data type by @sfc-gh-alhuang in #906
- [Snyk] Security upgrade io.netty:netty-common from 4.1.113.Final to 4.1.115.Final by @sfc-gh-snowflakedb-snyk-sa in #902
- SNOW-1808626 Fix struct type statistic for missing fields by @sfc-gh-alhuang in #908
- Make Channel.getIcebergSchema() API public + Stop NDV tracking by @sfc-gh-hmadan in #912
- NO-SNOW Fix logging by @sfc-gh-mbobowski in #909
- SNOW-1814204 Use fair lock to ensure granting sequence by @sfc-gh-ggeng in #911
- Wire up the ETag from S3's upload response back to the BlobDTO's MD5 field, to handle multipart upload correctly by @sfc-gh-hmadan in #915
- Send clientname and clientkey with every registerblobs request for metering views by @sfc-gh-hmadan in #922
Full Changelog: v3.0.0...3.0.1
v3.0.0
This release contains a few improvements, bug fixes, and introduces GA support for Snowpipe Streaming to Snowflake managed Apache Iceberg™ tables
Please use 3.0.1+ patch release for production workloads
What's Changed
- SNOW-1708577 Parquet V2 support for new table format by @sfc-gh-alhuang in #851
- SNOW-1727532 Set number of values for repeated fields by @sfc-gh-alhuang in #861
- SNOW-1754295 - Prep for upcoming subscoped tokens PR by @sfc-gh-hmadan in #867
- SNOW-1748333 Fix Iceberg decimal type schema parser by @sfc-gh-alhuang in #864
- Fix empty map & list ingestion by @sfc-gh-alhuang in #873
- SNOW-1754295 - Start using subscoped tokens for iceberg ingestion by @sfc-gh-hmadan in #868
- SNOW-1768252 Ignore getStringForLogging in the requests by @sfc-gh-ggeng in #875
- SNOW-1760732 Enable Iceberg mode from properties by @sfc-gh-alhuang in #871
- SNOW-1764301 Iceberg parquet file configuration by @sfc-gh-alhuang in #874
- SNOW-1774276 Update fileId key in metadata for Iceberg mode by @sfc-gh-alhuang in #880
- Add enableIcebergStreaming to telemetry calls by @sfc-gh-hmadan in #878
- Re-merge "Add chunk offset to file id key to make each chunk have a unique key" from pull 825 by @sfc-gh-psaha in #865
- Enhance error messages in the SDK by @sfc-gh-hmadan in #883
- SNOW-1778664 Update snowflake-jdbc to 3.20.0 by @sfc-gh-lsembera in #887
- SNOW-1757554 Support quoted object fields name by @sfc-gh-alhuang in #869
- Fix quoted column name for Iceberg primitive type by @sfc-gh-alhuang in #891
- SNOW-1492090 Snowpipe streaming file master key id rotation by @sfc-gh-bmikaili in #786
- [SNOW-1711460] Upgrade to iceberg version 1.6.1 by @sfc-gh-xhuang in #894
- SNOW-1787322 Fix InsertError for structured data type by @sfc-gh-alhuang in #888
] - Introduce Iceberg streaming merge gate by @sfc-gh-alhuang in #896
- NO_SNOW release new sdk version by @sfc-gh-xhuang in #893
- Explicitly specify avro dependency to override apache iceberg version by @sfc-gh-xhuang in #900
Full Changelog: v2.3.0...v3.0.0
v2.3.0
[Behavior Change Release]
This release changes how variant values represented as json strings are ingested into semi-structured columns (variant, object, array) if they contain numeric values. Starting with release 2.3.0, numeric values preserve their format, no conversion to and from scientific notation is happening anymore.
What's Changed
- Iceberg Ingestion in CloudStorage mode - Carve out IStorage and ExternalVolume from InternalStage by @sfc-gh-hmadan in #828
- SNOW-1659373 cleanup serializeFromParquetBuffers by @sfc-gh-gdoci in #829
- SNOW-1507007 Support schema for new table format by @sfc-gh-alhuang in #814
- Carve out MockSnowflakeServiceClient to allow ExternalVolume tests in next PR to use it properly by @sfc-gh-hmadan in #833
- SNOW-1673203 EP info generation for new table format by @sfc-gh-alhuang in #836
- SNOW-1674752 Fix vulnerable dependencies by @sfc-gh-alhuang in #838
- Get test coverage for telemetry reporting (was missing) + Fix SnowflakeServiceClient test code to allow per-API overrides by @sfc-gh-hmadan in #839
- SNOW-1675591 Fill in ExternalVolume and ExternalVolumeManager to do presigned url retrieval + blobname population by @sfc-gh-hmadan in #837
- Set createdon in BlobMetadata and is_iceberg in Drop Channel request by @sfc-gh-hmadan in #845
- SNOW-1666189 Structured data type support by @sfc-gh-alhuang in #841
- SNOW-1707031 hadoop upgrade for vulnerability fix by @sfc-gh-japatel in #849
- NO_SNOW Release 2.3.0 BCR by @sfc-gh-xhuang in #842
- NO-SNOW Remove unnecessary dependencies to reduce jar size by @sfc-gh-japatel in #852
- Fix concurrent null-ref in External Volume Blob path Generation + track URL timeout by @sfc-gh-hmadan in #854
- Fix testUtils to not repeatedly do keypair generation by @sfc-gh-hmadan in #855
- Add (non-public) method to expose iceberg schema for each column of a channel by @sfc-gh-hmadan in #856
- SNOW-1566045 Preserve numeric format for variants by @sfc-gh-lsembera in #817
Full Changelog: v2.2.2...v2.3.0
v2.2.2
What's Changed
- SNOW-1619347: upgrade bc-fips by @sfc-gh-tzhang in #810
- SNOW-1483230 Parameter support & disable blob encryption for new table format by @sfc-gh-alhuang in #801
- NO_SNOW Upgrade dependency versions by @sfc-gh-xhuang in #800
- SNOW-1497358 Support multiple stage for new table format by @sfc-gh-alhuang in #812
- SNOW-1654124: Write file name to metadata at the place when we create the file by @sfc-gh-tzhang in #824
- V2.2.2 Release by @sfc-gh-tzhang in #826
Full Changelog: v2.2.0...v2.2.2
v2.2.1
[Improvement] This release fixes a performance regression in upload
What's Changed
- SNOW-1619347: upgrade bc-fips by @sfc-gh-tzhang in #810
- SNOW-1483230 Parameter support & disable blob encryption for new table format by @sfc-gh-alhuang in #801
- NO_SNOW Upgrade dependency versions by @sfc-gh-xhuang in #800
- SNOW-1497358 Support multiple stage for new table format by @sfc-gh-alhuang in #812
Full Changelog: v2.2.0...v2.2.1
v2.2.0
[Bug Fix] Fix a critical bug that could potentially cause corruption with change_tracking enabled.
It is strongly recommend to upgrade to 2.2.0+ as the minimum version for all Snowpipe Streaming usage
[Improvement] Refactor some of the code logic to support different storage volume
What's Changed
- Code refactor for different storage volume support by @sfc-gh-alhuang in #792
- SNOW-1512047 Introduce independent per-table flushes when interleaving is disabled by @sfc-gh-alhuang in #788
- SNOW-1618257 Fix PRIMARY_FILE_ID_KEY by @sfc-gh-kkloudas in #807
- V2.2.0 Release by @sfc-gh-tzhang in #808
Full Changelog: v2.1.2...v2.2.0