Configuring import batch size
This information is only valid for ≥ 2.0.0-beta5.
Summary: how to configure application data import batch size to improve import performance when dealing with large amounts of data.
Introduction
During the application data import process (see Export and import the Application data), CAST Imaging is configured to import data in a batch of 1000 rows and then perform a commit. If you have allocated additional memory to Neo4j (see Optimize Neo4j memory allocation) it is possible to increase the default import batch size so that data commits are performed less, therefore increasing overall import performance.
You can read more about this process in the Neo4j documentation.
Update process
Open and edit the following file:
Microsoft Windows traditional installer:
%APPDATA%\CAST\ImagingSystem\imagingservice\imagingetl.bat
Docker Installer extension (located in the folder created when unzipping the extension):
etl\app.config
Microsoft Windows via traditional installer
This file is located in the protected %APPDATA% location, therefore you must open the file with elevated permission (this is usually achieved by right clicking your text editor in the Windows start menu and selecting Run as administrator):
Linux
You may need to use elevated permissions to edit this file (for example use sudo).
Alter the following line and increase the batch size as necessary:
NEO4J_IMPORT_BATCH_SIZE
Restart the Neo4j Windows service / Linux container to ensure the changes are taken into account.