When fetching 10.000 files from a database using the database connector, I am trying to commit files in batches of 10 files (1 MB per 10 files). Even if I end and start the transaction each 100 files, the heap space increases (see attached graph). Probably objects remain in memory after each cycle. Does someone have a solution for this except increasing node memory.
↧