Optimize broke my database(s)
Monday, 3 September 2018 · 2 messages · last reply 24 Sep 2018
FW
Florian Wagner3 Sep 2018 08:59 #
Hey everone,
we're close to going live with a project built upon BaseX with largish Databases (the biggest one being about 6 GB unoptimized).
We have a regular nightly full-optimize job. One run this weekend seems to have broken two of our databases. There's single error message per broken database in our logs:
java.io.FileNotFoundException: /var/db/basex/[...]_1151592207/inf.basex (No such file or directory)
at java.io.FileOutputStream.open0(Native Method)
at java.io.FileOutputStream.open(FileOutputStream.java:270)
at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
at java.io.FileOutputStream.<init>(FileOutputStream.java:162)
at org.basex.io.IOFile.outputStream(IOFile.java:158)
at org.basex.io.out.DataOutput.<init>(DataOutput.java:47)
at org.basex.io.out.DataOutput.<init>(DataOutput.java:36)
at org.basex.data.DiskData.write(DiskData.java:137)
at org.basex.data.DiskData.close(DiskData.java:160)
at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:145)
at org.basex.query.up.primitives.db.DBOptimize.apply(DBOptimize.java:124)
at org.basex.query.up.DataUpdates.apply(DataUpdates.java:175)
at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120)
at org.basex.query.up.Updates.apply(Updates.java:157)
at org.basex.query.QueryContext.iter(QueryContext.java:346)
at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90)
at org.basex.core.jobs.QueryJob.run(QueryJob.java:165)
at java.lang.Thread.run(Thread.java:748)The DBAs "Databases" page still lists the broken dbs including the size and a last-modified date of the Job time. But clicking them gets you a detail page with no details, documents, no Add... / Delete / Copy.. buttons and the backup buttons being disable.
Ideas how to go from here are greatly appreciated? Any chance getting our database contents back?
Grüße
Florian Wagner
---
Universitaetsbibliothek Tuebingen
Wilhelmstr. 32, 72074 Tuebingen
IT-Abteilung, Raum B102
+49(0)7071/29-77860
http://www.ub.uni-tuebingen.de
CG
Christian Grün24 Sep 2018 15:52 #
Hi Florian,
It’s been a while ago; feel free to give us an update on the latest status quo: Did you find out more about possible causes for the failed optimization step (too little memory, ...)? Did you create backups of your databases in the past?
Best,
Christian
Quoted text · Florian Wagner · 49 lines
On Mon, Sep 3, 2018 at 8:59 AM Florian Wagner <fl.wagner at uni-tuebingen.de> wrote: > > Hey everone, > > we're close to going live with a project built upon BaseX with largish > Databases (the biggest one being about 6 GB unoptimized). > > We have a regular nightly full-optimize job. One run this weekend seems > to have broken two of our databases. There's single error message per > broken database in our logs: > > java.io.FileNotFoundException: /var/db/basex/[...]_1151592207/inf.basex (No such file or directory) > at java.io.FileOutputStream.open0(Native Method) > at java.io.FileOutputStream.open(FileOutputStream.java:270) > at java.io.FileOutputStream.<init>(FileOutputStream.java:213) > at java.io.FileOutputStream.<init>(FileOutputStream.java:162) > at org.basex.io.IOFile.outputStream(IOFile.java:158) > at org.basex.io.out.DataOutput.<init>(DataOutput.java:47) > at org.basex.io.out.DataOutput.<init>(DataOutput.java:36) > at org.basex.data.DiskData.write(DiskData.java:137) > at org.basex.data.DiskData.close(DiskData.java:160) > at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:145) > at org.basex.query.up.primitives.db.DBOptimize.apply(DBOptimize.java:124) > at org.basex.query.up.DataUpdates.apply(DataUpdates.java:175) > at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) > at org.basex.query.up.Updates.apply(Updates.java:157) > at org.basex.query.QueryContext.iter(QueryContext.java:346) > at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) > at org.basex.core.jobs.QueryJob.run(QueryJob.java:165) > at java.lang.Thread.run(Thread.java:748) > > The DBAs "Databases" page still lists the broken dbs including the size > and a last-modified date of the Job time. But clicking them gets you a > detail page with no details, documents, no Add... / Delete / Copy.. > buttons and the backup buttons being disable. > > Ideas how to go from here are greatly appreciated? Any chance getting > our database contents back? > > > Grüße > Florian Wagner > --- > Universitaetsbibliothek Tuebingen > Wilhelmstr. 32, 72074 Tuebingen > IT-Abteilung, Raum B102 > +49(0)7071/29-77860 > http://www.ub.uni-tuebingen.de
Written for BaseX 9.0. BaseX may have changed since: please check the current documentation.
⚡Generated with XQuery