Neo4j Connector for Apache Spark 4.1.5

Hello Community!
We are pleased to announce the 4.1.5 of the Spark Connector with this version we added the support for Neo4j Java Driver URL resolvers.

There are three files:

• neo4j-connector-apache-spark_2.11-4.1.5_for_spark_2.4.jar, md5 118dce27b54f16f304880df9c7280615
• neo4j-connector-apache-spark_2.12-4.1.5_for_spark_2.4.jar, md5 705196b006434b659ea6c1601ec0c00a
• neo4j-connector-apache-spark_2.12-4.1.5_for_spark_3.jar, md5 2ed1f9a89bd900b1aac1950fcbc85ee5
• neo4j-connector-apache-spark_2.13-4.1.5_for_spark_3.jar, md5 caed49e951e9b8d4db12345799795481

What's Changed

• fixes #442: Support Neo4j Java Driver URL resolvers by @conker84 in #443

Full Changelog: 4.1.4...4.1.5

Neo4j Connector for Apache Spark 4.1.4

Hello Community!
We are pleased to announce the 4.1.4 of the Spark Connector with this version we added the support for the logging with the Neo4j Java driver.

There are three files:

• neo4j-connector-apache-spark_2.11-4.1.4_for_spark_2.4.jar, md5 cf9baef98e7d9214ef77f8b4bccbd87a
• neo4j-connector-apache-spark_2.12-4.1.4_for_spark_2.4.jar, md5 9a56ec8a7d87c6683e4356063714f37f
• neo4j-connector-apache-spark_2.12-4.1.4_for_spark_3.jar, md5 48f03d73b6df80f3bea254266b327f2f
• neo4j-connector-apache-spark_2.13-4.1.4_for_spark_3.jar, md5 a9c9a01198d7e9f820ae9d120d32472c

What's Changed

• Update antora.yml by @NataliaIvakina in #439
• Update graph projection example by @nvitucci in #441
• Enable driver logging by @conker84 in #440

New Contributors

• @nvitucci made their first contribution in #441 🎉

Full Changelog: 4.1.3...4.1.4

Neo4j Connector for Apache Spark 4.1.3

Hello Community!
We are pleased to announce the 4.1.3 of the Spark Connector with this version we fixed several bugs and introduce the support for Scala 2.13!

There are three files:

• neo4j-connector-apache-spark_2.11-4.1.3_for_spark_2.4.jar, md5 3746283be881449b712be5144d01fbf1
• neo4j-connector-apache-spark_2.12-4.1.3_for_spark_2.4.jar, md5 c60b21b2af94383699cc30bb77da07b1
• neo4j-connector-apache-spark_2.12-4.1.3_for_spark_3.jar, md5 c58749f75e5f052f447589dc594b1b1c
• neo4j-connector-apache-spark_2.13-4.1.3_for_spark_3.jar, md5 fcf7e7b4a489aaa902f47a31fed25ba8

What's Changed

• fix tiny mistake in asciidoc syntax by @NataliaIvakina in #428
• Update preview.yml by @NataliaIvakina in #432
• Update the copyright year by @NataliaIvakina in #433
• removing mention to authored by labs by @lidiazuin in #436
• fixes #389: Check Support For Spark 3.2 by @conker84 in #407
• fixes #434: Column with list of maps is not correctly handled by @conker84 in #435
• fixes #437: Retrieving the schema for a custom query extracts the whole database by @conker84 in #438
• fixes #412: Add section about interacting with DHWs by @conker84 in #420

New Contributors

• @lidiazuin made their first contribution in #436

Full Changelog: 4.1.2...4.1.3

Neo4j Connector for Apache Spark 4.1.2

Hello Community!
We are pleased to announce the 4.1.2 of the Spark Connector where we fixed several bugs.

There are three files:

• neo4j-connector-apache-spark_2.11-4.1.2_for_spark_2.4.jar, md5 ab32bdcc08d9fcedca845c8e4f92091f
• neo4j-connector-apache-spark_2.12-4.1.2_for_spark_2.4.jar, md5 b763ddc4b63ebf5471a2eedf86e89a98
• neo4j-connector-apache-spark_2.12-4.1.2_for_spark_3.jar, md5 c29c9b7ba6f3532c4db14836cf95ba6c

What's Changed

• Fix Maven Central Release Issues by @conker84 in #427

Full Changelog: 4.1.1...4.1.2

Neo4j Connector for Apache Spark 4.1.1

Hello Community!
We are pleased to announce the 4.1.1 of the Spark Connector where we fixed several bugs.

There are three files:

• neo4j-connector-apache-spark_2.11-4.1.1_for_spark_2.4.jar, md5 2accb30aa039ddabc298bd7c8206e234
• neo4j-connector-apache-spark_2.12-4.1.1_for_spark_2.4.jar, md5 9dd2022da450fa14a4da90bda1cbdbe2
• neo4j-connector-apache-spark_2.12-4.1.1_for_spark_3.jar, md5 6bfe16d65f57e1469dabf47d963a62e3

What's Changed

• Read JAR version from pom.xml in Python CI by @utnaf in #390
• Add Neo4j 4.4 test to CI by @utnaf in #393
• Add playbooks for docs build processes by @recrwplay in #394
• Fix scheme naming by @NataliaIvakina in #397
• 4.1 renaming aura by @NataliaIvakina in #398
• fixed broken links by @NataliaIvakina in #402
• 4.1 fix navigation bar by @NataliaIvakina in #403
• edit the overview chapter by @NataliaIvakina in #404
• Update quickstart section by @NataliaIvakina in #405
• Update the reading chapter by @NataliaIvakina in #408
• Update configuration.adoc by @NataliaIvakina in #406
• Update-the-writing-chapter by @NataliaIvakina in #409
• Update-the-section-on-using-spark-streaming by @NataliaIvakina in #410
• Update-the-first-page by @NataliaIvakina in #411
• Update-chapters-on-using-with-Python-GDS-Causal-Cluster by @NataliaIvakina in #413
• update the chapter on architecture guidance by @NataliaIvakina in #416
• Update chapter on types mapping by @NataliaIvakina in #417
• update faq section by @NataliaIvakina in #419
• Upgrade docs to Antora 3 by @recrwplay in #418
• Update docs.yml by @conker84 in #425
• fixes #423: NullPointerException when writing relationships by @conker84 in #424
• Fix broken links and mistakes by @NataliaIvakina in #426

New Contributors

• @recrwplay made their first contribution in #394
• @NataliaIvakina made their first contribution in #397

Full Changelog: 4.1.0...4.1.1

Neo4j Connector for Apache Spark 4.1.0

Hello Community!
We are pleased to announce the 4.1.0 of the Spark Connector where we fixed several bugs and introduced the official support for Spark's Structured Streaming APIs with Source and Sink!

This release officially enables Spark Structured Streaming API and lets you connect Neo4j (via Spark) to systems such as Kinesis, Kafka, Google Dataproc, Azure Service Bus, and any other which support Spark Structured Streaming.

There are three files:

• neo4j-connector-apache-spark_2.11-4.1.0_for_spark_2.4.jar, md5 2cde396181f79950a541ca2e6e218909
• neo4j-connector-apache-spark_2.12-4.1.0_for_spark_2.4.jar, md5 982292aeb829d06fc6571cb21e850dfd
• neo4j-connector-apache-spark_2.12-4.1.0_for_spark_3.jar, md5 76016cdd45cb0ca929172cb723dfa3b6

List of resolved issues

• Fixes #343: add Streaming docs (#346)
• fixes #386: Streaming Source dups record in Databricks env (#387)
• fix python failing tests (#385)
• fixes #370: Sort Partitions by internal ID (#382)
• fixes #348: repartition(1) - Makes loading very slow (#356)
• Fixes #369: add parameters to filters (#377)
• fix to clean up python in an example program (#380)
• Bump driver version to 4.3.2 (#379)
• fixes #262: spark 3 source (#374)
• fixes #262: part 3/4: Spark 2.4 Source (#371)
• Fixes #358: Ensure the same timezone is used across JVM and Neo4j (#359)
• Fixes #364: add tests for Neo4j 4.3 (#365)
• Fixes #361: Change constraint naming convention (#363)
• fixes #357: transformed isValidQuery severity from ERROR to DEBUG (#360)
• added javadoc generation
• Update quickstart.adoc

Pre Release of Neo4j Connector for Apache Spark 4.0.3

Hello Community we are pleased to announce the 4.0.3 pre-release (not meant to be used in production and with no enterprise support guaranteed) of the Spark Connector where we fixed several bugs and introduced the support for Spark's Structured Streaming Preview with Source and Sink!

This pre-release enables the spark streaming API and lets you connect Neo4j (via Spark) to systems such as Kinesis, Kafka, Google Dataproc, Azure Service Bus, and any other which support spark streaming

There are three files:

• neo4j-connector-apache-spark_2.11-4.0.2_for_spark_2.4.jar for Spark 2.4 and Scala 2.11 with md5 3d56400faf10d6c0a3544cb69ed0056a
• neo4j-connector-apache-spark_2.12-4.0.2_for_spark_2.4.jar for Spark 2.4 and Scala 2.12 with md5 67b4d9a9fcf3d4b484e8d4a67fc33dea
• neo4j-connector-apache-spark_2.12-4.0.2_for_spark_3.jar for Spark 3.x and Scala 2.12 with md5 aee927b3f1eedccfbed434c61fe2a839

For the Structured Streaming support -- documentation has not yet been published, but there is a PR where we're collecting feedback, please look at it and add ideas about how to improving it!

Please fill an issue if you have a problem!

Following the full list of changes:

Bug Fixes

fixes #315: wrong recursive call in type conversion (#321)
fixes #357: transformed isValidQuery severity from ERROR to DEBUG (#360)
fixes #348: repartition(1) - Makes loading very slow (#356)

Enhancements

fixes #333: Remove Transaction code LockClientStopped (#336)
test improvements (#319)
#262 part 1/4: Spark 24 Sink (#322)
Fixes #349: Create issue templates (#352)
Fixes #262: add Structured Streaming write support for Spark 3 (#344)
fixes #354: Change org of package to org.neo4j for maven central publishing
update docs for maven central release (#355)
Fixes #361: Change constraint naming convention (#363)
Fixes #358: Ensure the same timezone is used across JVM and Neo4j (#359)
fixes #262: part 3/4: Spark 2.4 Source (#371)
fixes #262: spark 3 source (#374)
Bump driver version to 4.3.2 (#379)
Fixes #369: add parameters to filters (#377)

Other/Infrastructure Enhancements

fix to clean up python in an example program (#380)
Only run docs workflow when something changed in doc folder (#367)
Disable lint:links task for now (#368)

Neo4j Connector for Apache Spark 4.0.2

Hello Community we are pleased to announce the 4.0.2 release of the Spark Connector where we fixed several bugs!

There are three files:

• neo4j-connector-apache-spark_2.11-4.0.2_for_spark_2.4.jar for Spark 2.4 and Scala 2.11 with md5 3d56400faf10d6c0a3544cb69ed0056a
• neo4j-connector-apache-spark_2.12-4.0.2_for_spark_2.4.jar for Spark 2.4 and Scala 2.12 with md5 67b4d9a9fcf3d4b484e8d4a67fc33dea
• neo4j-connector-apache-spark_2.12-4.0.2_for_spark_3.jar for Spark 3.x and Scala 2.12 with md5 aee927b3f1eedccfbed434c61fe2a839

Please fill an issue if you have a problem!

For any question please refer to the Neo4j Community Forum

Following the full list of changes:

Bug Fixes

• Fixes #350: added ‘six’ python dependency (#351)
• fixes #323: Node keys are ignored when the field is a map (#330)
• Fixes #337: Implemented user defined schema on Spark 2.4 and Spark 3
• fixes #333: Remove Transaction code LockClientStopped (#336)
• fixes #326: Schema retrieving by APOC doesn’t seem to work when node maps is true
• fixes #315: wrong recursive call in type conversion (#321)

Enhancements

• implemented BasePartitioReader in Spark 2.4 (#335)
• Update java driver to 4.2.5 (#332)

Other/Infrastructure Enhancements

• Fixed version typo on README.md
• Update lint-links.js (#340)

Neo4j Connector for Apache Spark 4.0.1

Hello Community we are pleased to announce the 4.0.1 release of the Spark Connector, we fixed several bugs and now we have the first iteration with the Support of Spark 3.x!

There are three files:

• neo4j-connector-apache-spark_2.11-4.0.1_for_spark_2.4.jar for Spark 2.4 and Scala 2.11
• neo4j-connector-apache-spark_2.12-4.0.1_for_spark_2.4.jar for Spark 2.4 and Scala 2.12
• neo4j-connector-apache-spark_2.12-4.0.1_for_spark_3.jar for Spark 3.x and Scala 2.12

Please fill an issue if you have a problem!

For any question please refer to the Neo4j Community Forum

Following the full list of changes:

• added spark packages zip generation script (#249)
• Taskless: update README with correct package name (#248) …
• fixes #193: Add testing against Neo4j 4.2 (#251)
• updated 4.2 profile to official docker image (#258)
• fixes #256: Improve quoting function (#257)
• fixes #254: Returning a function from a query breaks in 3.5 (#255)
• Fixes #261: Incorrect pushdown query for relationship (#268) …
• Fixes #265: handle conversion to Neo4j map (#267) …
• Update quick-java-example.adoc (#270) …
• Update quick-java-example.adoc (#275)
• Update aura.adoc (#287)
• #206: Split current code into common and spark-2.4 modules (#282) …
• #206 Add Spark 3.0 support (#283) …
• fixes #286: improved relationship doc (#288)
• Fixes #266: added test to ensure arrives to the Neo4j Driver (#290) …
• Fix and check links with hyperlink (#271) …
• Fix italic formatting of database option default (#294)
• Fixes #281: Add Aura integration tests (#293) …
• Fixes #291: remove build warnings (#292)
• fixes #260: Move CI system to GitHub Actions (#301)
• Fixes #213: Add Python tests (#296)
• Fixes #299: Add docs for installing the connector (#305) …
• Fixes #302: Test for Spark 3.1 (#304)
• Fixes #284: leverage Spark Config as default configuration values (#306)
• Add details on using Databricks with Aura (#303)
• fixes #259: Neo4j 4.2.1 drivers (#307)
• Fixes #285: Add version check for Spark (#308)
• Taskless - Bump version (#311)
• Fix JAR naming across docs and README (#312)
• Update python-ci.yml (#317)

[PRE-RELEASE][4.0.1-pre1] Neo4j Connector for Apache Spark

Hello Community we are pleased to announce the 4.0.1-pre1 release of the spark connector, we fixed several bugs and now we have the first iteration with the Support of Spark 3.0!

Please note that this is not meant to be used in a production env

There are three files:

• neo4j-connector-apache-spark_2.11_2.4-4.0.1-pre1.jar for Spark 2.4 and Scala 2.11
• neo4j-connector-apache-spark_2.12_2.4-4.0.1-pre1.jar for Spark 2.4 and Scala 2.12
• neo4j-connector-apache-spark_2.12_3.0-4.0.1-pre1.jar for Spark 3.0 and Scala 2.12

Please test it and fill an issue if you have a problem!

See you soon with the official release!