Disk full caused by huge index

> > > > > On 23 déc. 2014, at 10:32, Ludovic Kuty <mailing at kuty.be> wrote: > Dear users, > > Can I remove the file txtl.basex and still get an access to my data ? BaseX of course will be stopped. My HDD is full and I can't optimize all because BaseX times out. Then I would like to deactivate the UPDINDEX option on my already existing DB. I already read the thread https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-July/006942.html ( UPDINDEX and ever growing index size ) and was well aware of the problem but I didn't know that it would grow so fast. > > total 214335012 > -rw-r--r-- 1 root root 1620720 Dec 23 02:54 atv.basex > -rw-r--r-- 1 root root 2300192644 Dec 23 02:54 atvl.basex > -rw-r--r-- 1 root root 337605 Dec 23 02:54 atvr.basex > -rw-r--r-- 1 root root 15 Dec 23 02:54 idp.basex > -rw-r--r-- 1 root root 137256 Dec 23 02:54 inf.basex > -rw-r--r-- 1 root root 631959552 Dec 23 02:54 tbl.basex > -rw-r--r-- 1 root root 1220641 Dec 23 02:54 tbli.basex > -rw-r--r-- 1 root root 146626967 Dec 23 02:54 txt.basex > -rw-r--r-- 1 root root 216396026742 Dec 23 02:54 txtl.basex > -rw-r--r-- 1 root root 838900 Dec 23 02:54 txtr.basex > > TIA, > > Ludovic Kuty >

On 23 déc. 2014, at 10:34, Ludovic Kuty <mailing at kuty.be> wrote: > BTW here is the output of the INFO INDEX command. We can see that the text index has a size of 202GB. > > Elements > - Structure: Hash > - Entries: 4 > value 2075397x, strings, leaf > name 2075397x, 47 values, leaf > data 2075397x, strings > archive 47354x, strings > > Attributes > - Structure: Hash > - Entries: 2 > time 47354x, strings, leaf > site 47354x, 1 values, leaf > > Text Index > - Structure: Sorted List > - Size: 202 GB > - Entries: 167780 > false 1409387x > true 1384561x > 0.0 162432x > 0 116279x > 0.000 113438x > 9 106765x > 1 77692x > debit turbinable auto SPW quand 67530x > debit turbinable auto SPW 67530x > debit meuse OP 67530x > debit meuse FTP SPW quand 67530x > debit meuse FTP SPW 67530x > choix acquisition 67530x > acquisition automate SPW ok 67530x > acquisition FTP SPW ok 67530x > pression gen4 66632x > pression gen3 66632x > pression gen2 66632x > pression gen1 66632x > p_active_gen6 66632x > p_active_gen5 66632x > p_active_gen4 66632x > p_active_gen3 66632x > p_active_gen2 66632x > p_active_gen1 66632x > niveau aval 66632x > niveau amont 66632x > nb turbines demarrees 66632x > e produite 66632x > P_ACTIVE 66632x > ... > -109.9 1x > -109.5 1x > -108.9 1x > -108.6 1x > -108.5 1x > -108.4 1x > -108.1 1x > -108.0 1x > -107.7 1x > -107.3 1x > -107.2 1x > -105.8 1x > -105.1 1x > -105.0 1x > -103.8 1x > -102.9 1x > -102.3 1x > -101.7 1x > -101.5 1x > -10.7 1x > -10.4 1x > -1.8 1x > -1.7 1x > -1.5 1x > -1.3 1x > -1.0 1x > -0.9 1x > -0.6 1x > -0.5 1x > -0.48 1x > > Attribute Index > - Structure: Sorted List > - Size: 2 GB > - Entries: 67521 > hun 67530x > 2014-12-04T15:28:55 2x > 2014-11-16T13:31:15 2x > 2014-11-11T16:12:50 2x > 2014-11-05T07:25:44 2x > 2014-10-27T17:24:14 2x > 2014-10-10T14:10:39 2x > 2014-08-21T11:21:35 2x > 2014-05-08T09:42:39 2x > 2014-04-11T13:27:36 2x > 2014-02-12T13:45:21 2x > 2014-01-01T05:00:03 1x > 2014-01-01T04:50:01 1x > 2014-01-01T04:39:59 1x > 2014-01-01T04:29:57 1x > 2014-01-01T04:19:55 1x > 2014-01-01T04:09:54 1x > 2014-01-01T03:59:52 1x > 2014-01-01T03:49:50 1x > 2014-01-01T03:39:48 1x > 2014-01-01T03:29:46 1x > 2014-01-01T03:19:41 1x > 2014-01-01T03:09:42 1x > 2014-01-01T02:59:40 1x > 2014-01-01T02:49:38 1x > 2014-01-01T02:39:36 1x > 2014-01-01T02:29:34 1x > 2014-01-01T02:19:32 1x > 2014-01-01T02:09:28 1x > 2014-01-01T01:59:28 1x > ... > 2014-01-01T10:17:34 1x > 2014-01-01T10:07:05 1x > 2014-01-01T09:57:02 1x > 2014-01-01T09:46:58 1x > 2014-01-01T09:36:56 1x > 2014-01-01T09:26:54 1x > 2014-01-01T09:16:52 1x > 2014-01-01T09:06:50 1x > 2014-01-01T08:56:49 1x > 2014-01-01T08:46:47 1x > 2014-01-01T08:36:45 1x > 2014-01-01T08:26:43 1x > 2014-01-01T08:16:41 1x > 2014-01-01T08:06:39 1x > 2014-01-01T07:56:37 1x > 2014-01-01T07:46:36 1x > 2014-01-01T07:36:33 1x > 2014-01-01T07:26:31 1x > 2014-01-01T07:16:31 1x > 2014-01-01T07:06:29 1x > 2014-01-01T06:56:27 1x > 2014-01-01T06:34:53 1x > 2014-01-01T06:24:51 1x > 2014-01-01T06:14:49 1x > 2014-01-01T06:04:47 1x > 2014-01-01T05:54:45 1x > 2014-01-01T05:44:43 1x > 2014-01-01T05:34:41 1x > 2014-01-01T05:24:38 1x > 2014-01-01T05:10:05 1x > > Full-Text Index > - Not available > > Path Summary > doc(): 47354x, strings > archive: 47354x, strings > @site: 47354x, 1 values, leaf > @time: 47354x, strings, leaf > data: 2075397x, strings > name: 2075397x, leaf > text(): 2075397x, 47 values, leaf > value: 2075397x, leaf > text(): 2075397x, strings, leaf >> >> >> >> >> > > > On 23 déc. 2014, at 10:32, Ludovic Kuty <mailing at kuty.be> wrote: > >> Dear users, >> >> Can I remove the file txtl.basex and still get an access to my data ? BaseX of course will be stopped. My HDD is full and I can't optimize all because BaseX times out. Then I would like to deactivate the UPDINDEX option on my already existing DB. I already read the thread https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-July/006942.html ( UPDINDEX and ever growing index size ) and was well aware of the problem but I didn't know that it would grow so fast. >> >> total 214335012 >> -rw-r--r-- 1 root root 1620720 Dec 23 02:54 atv.basex >> -rw-r--r-- 1 root root 2300192644 Dec 23 02:54 atvl.basex >> -rw-r--r-- 1 root root 337605 Dec 23 02:54 atvr.basex >> -rw-r--r-- 1 root root 15 Dec 23 02:54 idp.basex >> -rw-r--r-- 1 root root 137256 Dec 23 02:54 inf.basex >> -rw-r--r-- 1 root root 631959552 Dec 23 02:54 tbl.basex >> -rw-r--r-- 1 root root 1220641 Dec 23 02:54 tbli.basex >> -rw-r--r-- 1 root root 146626967 Dec 23 02:54 txt.basex >> -rw-r--r-- 1 root root 216396026742 Dec 23 02:54 txtl.basex >> -rw-r--r-- 1 root root 838900 Dec 23 02:54 txtr.basex >> >> TIA, >> >> Ludovic Kuty >> >

On Tue, Dec 23, 2014 at 10:56 AM, Ludovic Kuty <mailing at kuty.be> wrote: > I made a drop index and it worked and was fast. I took the risk :) > > On 23 déc. 2014, at 10:34, Ludovic Kuty <mailing at kuty.be> wrote: > >> BTW here is the output of the INFO INDEX command. We can see that the text index has a size of 202GB. >> >> Elements >> - Structure: Hash >> - Entries: 4 >> value 2075397x, strings, leaf >> name 2075397x, 47 values, leaf >> data 2075397x, strings >> archive 47354x, strings >> >> Attributes >> - Structure: Hash >> - Entries: 2 >> time 47354x, strings, leaf >> site 47354x, 1 values, leaf >> >> Text Index >> - Structure: Sorted List >> - Size: 202 GB >> - Entries: 167780 >> false 1409387x >> true 1384561x >> 0.0 162432x >> 0 116279x >> 0.000 113438x >> 9 106765x >> 1 77692x >> debit turbinable auto SPW quand 67530x >> debit turbinable auto SPW 67530x >> debit meuse OP 67530x >> debit meuse FTP SPW quand 67530x >> debit meuse FTP SPW 67530x >> choix acquisition 67530x >> acquisition automate SPW ok 67530x >> acquisition FTP SPW ok 67530x >> pression gen4 66632x >> pression gen3 66632x >> pression gen2 66632x >> pression gen1 66632x >> p_active_gen6 66632x >> p_active_gen5 66632x >> p_active_gen4 66632x >> p_active_gen3 66632x >> p_active_gen2 66632x >> p_active_gen1 66632x >> niveau aval 66632x >> niveau amont 66632x >> nb turbines demarrees 66632x >> e produite 66632x >> P_ACTIVE 66632x >> ... >> -109.9 1x >> -109.5 1x >> -108.9 1x >> -108.6 1x >> -108.5 1x >> -108.4 1x >> -108.1 1x >> -108.0 1x >> -107.7 1x >> -107.3 1x >> -107.2 1x >> -105.8 1x >> -105.1 1x >> -105.0 1x >> -103.8 1x >> -102.9 1x >> -102.3 1x >> -101.7 1x >> -101.5 1x >> -10.7 1x >> -10.4 1x >> -1.8 1x >> -1.7 1x >> -1.5 1x >> -1.3 1x >> -1.0 1x >> -0.9 1x >> -0.6 1x >> -0.5 1x >> -0.48 1x >> >> Attribute Index >> - Structure: Sorted List >> - Size: 2 GB >> - Entries: 67521 >> hun 67530x >> 2014-12-04T15:28:55 2x >> 2014-11-16T13:31:15 2x >> 2014-11-11T16:12:50 2x >> 2014-11-05T07:25:44 2x >> 2014-10-27T17:24:14 2x >> 2014-10-10T14:10:39 2x >> 2014-08-21T11:21:35 2x >> 2014-05-08T09:42:39 2x >> 2014-04-11T13:27:36 2x >> 2014-02-12T13:45:21 2x >> 2014-01-01T05:00:03 1x >> 2014-01-01T04:50:01 1x >> 2014-01-01T04:39:59 1x >> 2014-01-01T04:29:57 1x >> 2014-01-01T04:19:55 1x >> 2014-01-01T04:09:54 1x >> 2014-01-01T03:59:52 1x >> 2014-01-01T03:49:50 1x >> 2014-01-01T03:39:48 1x >> 2014-01-01T03:29:46 1x >> 2014-01-01T03:19:41 1x >> 2014-01-01T03:09:42 1x >> 2014-01-01T02:59:40 1x >> 2014-01-01T02:49:38 1x >> 2014-01-01T02:39:36 1x >> 2014-01-01T02:29:34 1x >> 2014-01-01T02:19:32 1x >> 2014-01-01T02:09:28 1x >> 2014-01-01T01:59:28 1x >> ... >> 2014-01-01T10:17:34 1x >> 2014-01-01T10:07:05 1x >> 2014-01-01T09:57:02 1x >> 2014-01-01T09:46:58 1x >> 2014-01-01T09:36:56 1x >> 2014-01-01T09:26:54 1x >> 2014-01-01T09:16:52 1x >> 2014-01-01T09:06:50 1x >> 2014-01-01T08:56:49 1x >> 2014-01-01T08:46:47 1x >> 2014-01-01T08:36:45 1x >> 2014-01-01T08:26:43 1x >> 2014-01-01T08:16:41 1x >> 2014-01-01T08:06:39 1x >> 2014-01-01T07:56:37 1x >> 2014-01-01T07:46:36 1x >> 2014-01-01T07:36:33 1x >> 2014-01-01T07:26:31 1x >> 2014-01-01T07:16:31 1x >> 2014-01-01T07:06:29 1x >> 2014-01-01T06:56:27 1x >> 2014-01-01T06:34:53 1x >> 2014-01-01T06:24:51 1x >> 2014-01-01T06:14:49 1x >> 2014-01-01T06:04:47 1x >> 2014-01-01T05:54:45 1x >> 2014-01-01T05:44:43 1x >> 2014-01-01T05:34:41 1x >> 2014-01-01T05:24:38 1x >> 2014-01-01T05:10:05 1x >> >> Full-Text Index >> - Not available >> >> Path Summary >> doc(): 47354x, strings >> archive: 47354x, strings >> @site: 47354x, 1 values, leaf >> @time: 47354x, strings, leaf >> data: 2075397x, strings >> name: 2075397x, leaf >> text(): 2075397x, 47 values, leaf >> value: 2075397x, leaf >> text(): 2075397x, strings, leaf >>> >>> >>> >>> >>> >> >> >> On 23 déc. 2014, at 10:32, Ludovic Kuty <mailing at kuty.be> wrote: >> >>> Dear users, >>> >>> Can I remove the file txtl.basex and still get an access to my data ? BaseX of course will be stopped. My HDD is full and I can't optimize all because BaseX times out. Then I would like to deactivate the UPDINDEX option on my already existing DB. I already read the thread https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-July/006942.html ( UPDINDEX and ever growing index size ) and was well aware of the problem but I didn't know that it would grow so fast. >>> >>> total 214335012 >>> -rw-r--r-- 1 root root 1620720 Dec 23 02:54 atv.basex >>> -rw-r--r-- 1 root root 2300192644 Dec 23 02:54 atvl.basex >>> -rw-r--r-- 1 root root 337605 Dec 23 02:54 atvr.basex >>> -rw-r--r-- 1 root root 15 Dec 23 02:54 idp.basex >>> -rw-r--r-- 1 root root 137256 Dec 23 02:54 inf.basex >>> -rw-r--r-- 1 root root 631959552 Dec 23 02:54 tbl.basex >>> -rw-r--r-- 1 root root 1220641 Dec 23 02:54 tbli.basex >>> -rw-r--r-- 1 root root 146626967 Dec 23 02:54 txt.basex >>> -rw-r--r-- 1 root root 216396026742 Dec 23 02:54 txtl.basex >>> -rw-r--r-- 1 root root 838900 Dec 23 02:54 txtr.basex >>> >>> TIA, >>> >>> Ludovic Kuty >>> >> >