[SOLVED] Indexing wasting all the memory? - Page 2

twobob · 10-04-2013, 07:07 AM

AFAIK that doesn't work brian.

@Akirainblack it's on FAT and the indexes have crazy names. limits the options.

ixtab · 10-04-2013, 07:20 AM

... though one could try to do it the other way around. IIRC, the top-level directory is system/search_indexes (or so) - one could try to delete it and place a file with that name there. Might or might not work, someone just give it a try

In case it does work, it could also have the exact opposite effect, namely the indexer spinning at 100% all the time because it can't ever finish its job...

twobob · 10-04-2013, 07:28 AM

Quote:

Originally Posted by ixtab

... though one could try to do it the other way around. IIRC, the top-level directory is system/search_indexes (or so) - one could try to delete it and place a file with that name there. Might or might not work, someone just give it a try

In case it does work, it could also have the exact opposite effect, namely the indexer spinning at 100% all the time because it can't ever finish its job...

Yup. That's why I didn't post my thoughts on this in the 1st place.

Time to get a "victim kindle" methinks...

twobob · 10-04-2013, 07:43 AM

Quote:

131004:102943 cvm[28743]: C MasterIndexFile:CriticalError::BAD_INDEX_VERSION: 2010.09.09
[!]131004:102943 cvm[28743]: java.io.FileNotFoundException: /mnt/us/system/Search Indexes/Index.db (Not a directory)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.open(Native Method)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.<init>(Unknown Source)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.<init>(Unknown Source)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.P.aL(ggd:820)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.p.createRandomAccessFile (ul:1673)
[!]131004:102943 cvm[28743]: at jdbm.recman.RecordFile.<init>(RecordFile.java:98)
[!]131004:102943 cvm[28743]: at jdbm.recman.BaseRecordManager.<init>(BaseRecordMan ager.java:140)
[!]131004:102943 cvm[28743]: at jdbm.recman.Provider.createRecordManager(Provider. java:89)
[!]131004:102943 cvm[28743]: at jdbm.RecordManagerFactory.createRecordManager(Reco rdManagerFactory.java:114)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.JA.URb(ij:574)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.JA.uQb(ij:763)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.DA.uQb(fbd:523)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.ini tializeMasterIndex(txc:1086)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.get MasterIndex(txc:2440)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.run (txc:211)
[!]131004:102943 cvm[28743]: at java.lang.Thread.startup(Unknown Source)
131004:102943 cvm[28743]: E SearchSDK:EXCEPTION::Unable to load or create MasterIndexFile.
[!]131004:102943 cvm[28743]: java.io.FileNotFoundException: /mnt/us/system/Search Indexes/Index.db (Not a directory)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.open(Native Method)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.<init>(Unknown Source)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.<init>(Unknown Source)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.P.aL(ggd:820)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.p.createRandomAccessFile (ul:1673)
[!]131004:102943 cvm[28743]: at jdbm.recman.RecordFile.<init>(RecordFile.java:98)
[!]131004:102943 cvm[28743]: at jdbm.recman.BaseRecordManager.<init>(BaseRecordMan ager.java:140)
[!]131004:102943 cvm[28743]: at jdbm.recman.Provider.createRecordManager(Provider. java:89)
[!]131004:102943 cvm[28743]: at jdbm.RecordManagerFactory.createRecordManager(Reco rdManagerFactory.java:114)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.JA.URb(ij:574)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.JA.uQb(ij:763)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.DA.uQb(fbd:523)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.ini tializeMasterIndex(txc:1086)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.get MasterIndex(txc:2440)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.run (txc:211)
[!]131004:102943 cvm[28743]: at java.lang.Thread.startup(Unknown Source)
131004:102943 cvm[28743]: E IndexerThread:IOException:file=masterIndex:
131004:102943 cvm[28743]: I IndexerThread:CLEANUP:action=BEGIN_INDEXER_CLEANUP :
131004:102943 cvm[28743]: C MasterIndexFile:CriticalError::BAD_INDEX_VERSION: 2010.09.09
[!]131004:102943 cvm[28743]: java.io.FileNotFoundException: /mnt/us/system/Search Indexes/Index.db (Not a directory)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.open(Native Method)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.<init>(Unknown Source)
[!]131004:102943 cvm[28743]: at java.io.RandomAccessFile.<init>(Unknown Source)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.P.aL(ggd:820)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.p.createRandomAccessFile (ul:1673)
[!]131004:102943 cvm[28743]: at jdbm.recman.RecordFile.<init>(RecordFile.java:98)
[!]131004:102943 cvm[28743]: at jdbm.recman.BaseRecordManager.<init>(BaseRecordMan ager.java:140)
[!]131004:102943 cvm[28743]: at jdbm.recman.Provider.createRecordManager(Provider. java:89)
[!]131004:102943 cvm[28743]: at jdbm.RecordManagerFactory.createRecordManager(Reco rdManagerFactory.java:114)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.JA.URb(ij:574)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.JA.uQb(ij:763)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.DA.uQb(fbd:523)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.ini tializeMasterIndex(txc:1086)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.get MasterIndex(txc:2440)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.ind exMissingContents(txc:1477)
[!]131004:102943 cvm[28743]: at com.amazon.kindle.indexer.bundle.IndexerThread.run (txc:1754)
[!]131004:102943 cvm[28743]: at java.lang.Thread.startup(Unknown Source)
131004:102943 cvm[28743]: E SearchSDK:EXCEPTION::Unable to load or create MasterIndexFile.
[!]131004:102943 cvm[28743]: java.io.FileNotFoundException: /mnt/us/system/Search Indexes/Index.db (Not a directory)
...
131004:102943 cvm[28743]: E IndexerThread:IOException:file=masterIndex:
131004:102946 tmd[1161]: I recompute_retry_time:new_time:next_retry = {never} for recompute_retry_time() init:
131004:102947 scan[29050]: I fullscan:THUMB::----4----
131004:102947 scan[29050]: I libload:loaded:glob=*.pdf,ep=load_pdf_extractor:
131004:102947 scan[29050]: I NATIVE:dlopen:so=/usr/lib/ccat/libpdfE.so:loaded
131004:102948 scan[29050]: I fullscan:IDLE::----0----
131004:102956 todo[1138]: I todo:ProcessingToDo:status=starting,reason=Network Startup:Started processing ToDo
131004:102956 cvm[28743]: I lipc:evts:name=credentialsInstalled, origin=com.lab126.DeviceAuthenticationService:Even t sent
131004:102956 todo[1138]: W url_builder:GetURLWarning:reason=missingGlobalPara meter,param=currentCountry:
131004:102956 todo[1138]: I conutils:conEnsureConnectionInternal::setting cmd property
131004:102956 cmd[1134]: I def:req::Got a connection request:~:
131004:102956 todo[1138]: I conutils:conEnsureConnectionResponse::response=0
131004:102957 todo[1138]: I todo:ProcessingToDoItem:id=NONE,topic=legacy.UPLOA D.MESG:
131004:102957 cvm[28743]: I ToDoImpl:StartProcessingToDoItem:id=NONE,topic=leg acy.UPLOAD.MESG:
131004:102957 todo[1138]: I todo:ProcessingToDoItem:id=archive,topic=archive.s ync:
131004:102957 archive[1137]: I

...

131004:103218 cvm[28743]: I IndexerThread:Information::INDEXER_WAIT_DUE_TO_PAU SE_OR_ENVIRONMENT:Queue=0:Pausers:com.lab126.archi ve:759099ms, scanner:4993ms:

...

will require further testing but seems to have upset it

Aeris · 10-04-2013, 07:49 AM

Are you saying that ixtab method seems to work? Did you test it on PW or touch?

Akirainblack · 10-04-2013, 08:05 AM

So, it stops the indexing process.
Did it make the kindle sluggish at all twobob?

Aeris · 10-04-2013, 08:08 AM

Quote:

Originally Posted by Akirainblack

So, it stops the indexing process.
Did it make the kindle sluggish at all twobob?

I didn't ssh etc. like him because I'm not good at it. But I've followed ixtab instructions: the folder doesn't recreate and the system seems even faster and more responsive then before in some situations (mega-placebo effect? O.o).

To be sure I've renamed the old folder instead of removing it

Akirainblack · 10-04-2013, 08:24 AM

How did you access your PW Aeris?
If at all possible, would you mind telling me what you did, step by step?
Obviously only if you have the time and inclination.

Aeris · 10-04-2013, 08:29 AM

Bug: crashed while view a pdf due to insufficient memory O.o It never happened before (the pdf file is huge). Trying to put indexer back and test again.
EDIT: tests done, the issue doesn't seem to be related to the indexer.

Quote:

How did you access your PW Aeris?
If at all possible, would you mind telling me what you did, step by step?
Obviously only if you have the time and inclination.

Attach the USB to you kindle, go to "system" folder (maybe it's hidden under Windows, enable hidden folders), rename the folder "Search Indexes" into "Search Indexes backup", make an empty file in system folder naming it "Search Indexes" (not a txt file, drop the extension by enambling extesions view).

Ixtab correct me if I'm wrong

Akirainblack · 10-04-2013, 08:39 AM

Doh, why did I think it would be in an area we couldn't gain direct access to?

Thanks alot for pointing that out to me Aeris, done it on my PW now.

Thanks to all who have had input with this.

twobob · 10-04-2013, 10:09 AM

Fell asleep again.

Nothing about it in the logs since.

err..Warning. I don't actually read books on my device. soo... That needs looking at.
OR ever restart - I'll check that now.

twobob · 10-04-2013, 10:22 AM

Warning:

Device went to a blank white screen after first reboot.

Reboot fixed it.

So... there may be dragons lurking.

Akirainblack · 10-04-2013, 10:24 AM

I've already restarted my PW with no problems at all and have been going through the kindle for a while now, I'm just trying to copy books to and from the device to see if I can get everything to "fall over" but no problems thus far

twobob · 10-04-2013, 10:28 AM

Haven't managed to reproduce.

Akirainblack · 10-04-2013, 10:32 AM

just as well, we only want one twobob running around.

Could that have been down to a ghost in the machine?
How long did you wait at the white screen?

10-04-2013, 07:49 AM	#20
Aeris Developer's Corner Mascot Posts: 486 Karma: 1277790 Join Date: Sep 2013 Device: Kindle Paperwhite 5.3.4, Kindle Keyboard 3.4	Are you saying that ixtab method seems to work? Did you test it on PW or touch? Last edited by Aeris; 10-04-2013 at 07:57 AM.

10-04-2013, 10:09 AM	#26
twobob ( ͡° ͜ʖ ͡°){ʇlnɐɟ ƃǝs}Týr Posts: 6,586 Karma: 6299993 Join Date: Jun 2012 Location: uti gratia usura (Yao ying da ying; Mo ying da yieng) Device: PW-WIFI\|K5-3G+WIFI\| K4\|K3-3G\|DXG\|K2\| Rooted Nook Touch	Fell asleep again. Nothing about it in the logs since. err..Warning. I don't actually read books on my device. soo... That needs looking at. OR ever restart - I'll check that now. Last edited by twobob; 10-04-2013 at 10:22 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Kindle PW new FW5.3.4 solved PDF low memory	bthoven	Amazon Kindle	6	01-24-2014 07:53 PM
Am I Wasting My Time Requesting Books For The Kindle?	NVash	General Discussions	20	12-12-2010 03:23 AM
Seriously thoughtful "Higher Education: How Colleges are Wasting our Money"	MartinParish	Lounge	29	08-31-2010 11:13 AM
iPad Scribd: Publishers Are Wasting Time, Money, Effort In Creating iPad Apps	kjk	Apple Devices	0	06-11-2010 03:27 PM
SOLVED: How to see the internal memory again	Sunspark	Astak EZReader	19	06-08-2010 12:33 PM

10-04-2013, 07:07 AM	#16
twobob ( ͡° ͜ʖ ͡°){ʇlnɐɟ ƃǝs}Týr Posts: 6,586 Karma: 6299993 Join Date: Jun 2012 Location: uti gratia usura (Yao ying da ying; Mo ying da yieng) Device: PW-WIFI\|K5-3G+WIFI\| K4\|K3-3G\|DXG\|K2\| Rooted Nook Touch	AFAIK that doesn't work brian. @Akirainblack it's on FAT and the indexes have crazy names. limits the options.

10-04-2013, 07:20 AM	#17
ixtab (offline) Posts: 2,907 Karma: 6736094 Join Date: Dec 2011 Device: K3, K4, K5, KPW, KPW2	... though one could try to do it the other way around. IIRC, the top-level directory is system/search_indexes (or so) - one could try to delete it and place a file with that name there. Might or might not work, someone just give it a try In case it does work, it could also have the exact opposite effect, namely the indexer spinning at 100% all the time because it can't ever finish its job...

10-04-2013, 08:05 AM	#21
Akirainblack abibliophobic Posts: 220 Karma: 219708 Join Date: Aug 2012 Device: KV jailbroken	So, it stops the indexing process. Did it make the kindle sluggish at all twobob?

10-04-2013, 08:24 AM	#23
Akirainblack abibliophobic Posts: 220 Karma: 219708 Join Date: Aug 2012 Device: KV jailbroken	How did you access your PW Aeris? If at all possible, would you mind telling me what you did, step by step? Obviously only if you have the time and inclination.

10-04-2013, 08:39 AM	#25
Akirainblack abibliophobic Posts: 220 Karma: 219708 Join Date: Aug 2012 Device: KV jailbroken	Doh, why did I think it would be in an area we couldn't gain direct access to? Thanks alot for pointing that out to me Aeris, done it on my PW now. Thanks to all who have had input with this.

10-04-2013, 10:22 AM	#27
twobob ( ͡° ͜ʖ ͡°){ʇlnɐɟ ƃǝs}Týr Posts: 6,586 Karma: 6299993 Join Date: Jun 2012 Location: uti gratia usura (Yao ying da ying; Mo ying da yieng) Device: PW-WIFI\|K5-3G+WIFI\| K4\|K3-3G\|DXG\|K2\| Rooted Nook Touch	Warning: Device went to a blank white screen after first reboot. Reboot fixed it. So... there may be dragons lurking.

10-04-2013, 10:24 AM	#28
Akirainblack abibliophobic Posts: 220 Karma: 219708 Join Date: Aug 2012 Device: KV jailbroken	I've already restarted my PW with no problems at all and have been going through the kindle for a while now, I'm just trying to copy books to and from the device to see if I can get everything to "fall over" but no problems thus far

10-04-2013, 10:28 AM	#29
twobob ( ͡° ͜ʖ ͡°){ʇlnɐɟ ƃǝs}Týr Posts: 6,586 Karma: 6299993 Join Date: Jun 2012 Location: uti gratia usura (Yao ying da ying; Mo ying da yieng) Device: PW-WIFI\|K5-3G+WIFI\| K4\|K3-3G\|DXG\|K2\| Rooted Nook Touch	Haven't managed to reproduce.

10-04-2013, 10:32 AM	#30
Akirainblack abibliophobic Posts: 220 Karma: 219708 Join Date: Aug 2012 Device: KV jailbroken	just as well, we only want one twobob running around. Could that have been down to a ghost in the machine? How long did you wait at the white screen?