Error message
Thursday, 31 October 2013 · 2 messages
LJ
Lars Johnsen31 Oct 2013 12:30 #
When trying to create a database from a folder of approximately 5000 collections (each containing between 200 and 500 files) the processed stopped after two hours with an error something like this:
Line too long for a single database {filename} and {line number}.
The file itself looks ok, with a single tag in the referenced position. What is the recommended procedure from here?
All the best
Lars G Johnsen
National Library of Norway
CG
Christian Grün31 Oct 2013 12:38 #
Hi Lars,
Quoted text · Lars Johnsen · 1 line
> Line too long for a single database {filename} and {line number}.
I guess it was "Input is too large for a single database"?
In this case, the recommended procedure is to create multiple databases for your collections, which can then be queried by a single XQuery expression. You could even think about creating an own database for each collection, but the optimal trade off in your scenario is probably 5-10 databases. It could also be up to 100, depending on the size of your input data. – How big (gb/tb) is your total XML input?
Best,
Christian
Quoted text · Lars Johnsen · 13 lines
> The file itself looks ok, with a single tag in the referenced position. > What is the recommended procedure from here? > > All the best > Lars G Johnsen > National Library of Norway > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >
Written for BaseX 7.7. BaseX may have changed since: please check the current documentation.
⚡Generated with XQuery