Skip to content

Commit

Permalink
Make text about much data ready for review
Browse files Browse the repository at this point in the history
  • Loading branch information
Martijn Dirkse committed Jul 2, 2024
1 parent 0f56862 commit 0eda6d6
Show file tree
Hide file tree
Showing 3 changed files with 9 additions and 15 deletions.
3 changes: 1 addition & 2 deletions docs/source/advancedDevelopment/advancedDevelopment.rst
Original file line number Diff line number Diff line change
Expand Up @@ -13,5 +13,4 @@ Chapter :ref:`gettingStarted` provides the basics of Frank development. This cha
dockerDevel/dockerDevel
narayana/narayana
deployment/maven
streaming/streaming

muchData/muchData
8 changes: 8 additions & 0 deletions docs/source/advancedDevelopment/muchData/muchData.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
*Work in progress*

About large messages
====================

The Frank!Framework treats large messages in a special way to save memory. Frank developers sometimes need some knowledge about this to fix issues with their Frank applications. There is a property ``message.max.memory.size`` to configure the threshold: messages larger than this size are treated specially. Large messages are written to a temporary file before they are processed. Under Linux, they are typically stored in the ``/tmp`` folder. If this folder is on a small disk partition, an OutOfMemory Java exception may result. As an exception, messages that are already in a file are not copied to a temp file before they are processed. This exception typically applies to the contents of a file handled by a ``LocalFileSystemPipe``. This exception is more general: the Frank!Framework has intelligence to determine whether a file has been stored already - it is only written to a temp file if it is not available otherwise.

TODO: What is different before 7.9 from the behavior from 7.9 and later?
13 changes: 0 additions & 13 deletions docs/source/advancedDevelopment/streaming/streaming.rst

This file was deleted.

0 comments on commit 0eda6d6

Please sign in to comment.