Auto-delete news

[chaley]

Originally Posted by NSILMike

Thanks. The log shows it downloading news sources ("receiving book CNET News") on 24 June and also correctly deleting news sources set to be deleted.
On 25 June, it tries to connect and says "no servers found" It does, though, correctly delete new sources set to be deleted. On 26 June, it does it again. No servers found, etc.
I'm not sure why this is happening. Calibre is set to automatically start by windows, and is running at the time CC is set to automatically connect. When I saw that it was failing to automatically download, I did it manually from CC: Connect...Wireless Device/sync books
And that worked fine. And I did not restart CC or Calibre...
I think I may have my old problem where CC can't find Calibre again...

Edit: Yes. And just restarting Calibre on the PC cures it, as before.

First thing to check: is WiFi on when the device is asleep? Go to Device Settings / WiFi / Advanced (on the 3-dot menu) and ensure that "Keep WiFi on during sleep" is set to "Always". If it is already set to that then send me (only me) a debug log. There is more information in that than in the log you were looking at.

[NSILMike]

Originally Posted by chaley

First thing to check: is WiFi on when the device is asleep? Go to Device Settings / WiFi / Advanced (on the 3-dot menu) and ensure that "Keep WiFi on during sleep" is set to "Always". If it is already set to that then send me (only me) a debug log. There is more information in that than in the log you were looking at.

Yes, it is on during sleep, but I think you just clued me in to a possible cause. I also have Android's battery saver enabled. As you may know, this feature -when enabled- shuts down certain processes to keep the device from totally shutting down from lack of charge. I have it set to 20%, so when the battery drops to or below this level, certain services (like location) are limited. Also app's that depend upon sync'ing will not do so unless you manually open that app. Since radios are power hogs I am pretty certain this is at least a contributing cause, & probably the root cause. I will see if I can verify that from observation and let you know.

[NSILMike]

Originally Posted by chaley

I really do mean it.

It is that glass of wine (of which I have had more than one) and my incipient Alzheimers that prevents me from remembering by myself. Sigh ...

Friendly reminder. But as I said, it's good as is, so don't treat this as an urgent issue based only on my input.

[chaley]

Originally Posted by NSILMike

Friendly reminder. But as I said, it's good as is, so don't treat this as an urgent issue based only on my input.

Thanks for the reminder. I need to put on my calibre hat.

Out of curiosity, does it happen if you don't use "sync books"?

[NSILMike]

Originally Posted by chaley

Thanks for the reminder. I need to put on my calibre hat.

Out of curiosity, does it happen if you don't use "sync books"?

I do not know...

[chaley]

I have looked at this.

What I know so far:

1) Calibre does not reuse book UUIDs, so the "reuse" is coming from somewhere else.
2) You report that changing the reuse path option in the wireless fixes the problem, thus "something" is writing the old UUID into the cache.

Questions:
1) Does downloading a new CNET "book" delete previous books? In other words, is the calibre option "Keep at most N issues" set to 1?

2) What is the title of the CNET book? Not the file name, but the title shown in calibre and in CC?

Reason for asking: if keep at most is set to 1 and if the titles of the news books are the "same" then device book matching will connect the one of the previous news books still on the device with the new one downloaded by calibre. Such a match would cause all the problems we are seeing, including the modification of the calibre date you reported. I quoted "same" because the titles don't need to be identical. It is sufficient that the characters in the title are the same, ignoring white space and special characters.

For the above to be true you would have had either to customize the recipe changing the time format or have selected a Kindle device when you ran the calibre welcome wizard (whenever that is). You can see what device you have chosen by going to your calibre configuration folder, going into the "coversions" folder, and opening the file "page_setup.py" in a text editor. If "output_profile" contains the word "kindle" then I think we know what is happening. The fix would be to pick any other device other than kindle, but that would make news no longer be a periodical on a kindle.

[NSILMike]

Originally Posted by chaley

I have looked at this.

What I know so far:

1) Calibre does not reuse book UUIDs, so the "reuse" is coming from somewhere else.
2) You report that changing the reuse path option in the wireless fixes the problem, thus "something" is writing the old UUID into the cache.

Questions:
1) Does downloading a new CNET "book" delete previous books? In other words, is the calibre option "Keep at most N issues" set to 1?
Mike-> Yes

2) What is the title of the CNET book? Not the file name, but the title shown in calibre and in CC?
Mike-> CNET News

Reason for asking: if keep at most is set to 1 and if the titles of the news books are the "same" then device book matching will connect the one of the previous news books still on the device with the new one downloaded by calibre. Such a match would cause all the problems we are seeing, including the modification of the calibre date you reported. I quoted "same" because the titles don't need to be identical. It is sufficient that the characters in the title are the same, ignoring white space and special characters.

For the above to be true you would have had either to customize the recipe changing the time format or have selected a Kindle device when you ran the calibre welcome wizard (whenever that is). You can see what device you have chosen by going to your calibre configuration folder, going into the "coversions" folder, and opening the file "page_setup.py" in a text editor.
Mike-> I have no such file on my laptop... However, if asked to pick a device when I first configured Calibre, it would have been a Kindle Keyboard. However now, I also have a Nexus tablet, and use only the tablet with CC.
If "output_profile" contains the word "kindle" then I think we know what is happening. The fix would be to pick any other device other than kindle, but that would make news no longer be a periodical on a kindle.

Thanks, and sorry for the delayed reply.

[NSILMike]

I just re-ran the Calibre Welcome Wizard to see if it would confirm my device selection. It does, and it is the Nexus, not the Kindle. I know it was originally the Kindle, but I changed it when I got the Nexus. I use both now, but mainly the Nexus and with CC. The Kindle gets sync'd rarely and if so, by USB.

[chaley]

Originally Posted by NSILMike

Mike-> CNET News

Originally Posted by NSILMike

I just re-ran the Calibre Welcome Wizard to see if it would confirm my device selection. It does, and it is the Nexus, not the Kindle. I know it was originally the Kindle, but I changed it when I got the Nexus. I use both now, but mainly the Nexus and with CC. The Kindle gets sync'd rarely and if so, by USB.

Hmmm, this is confusing. As far as I can tell, the only way that the date is not in the title (I see CNET News [Mon, 27 Jul 2015]) is for the output profile to be a kindle. Perhaps there are some defaults lying around that I haven't found. Also, I cannot find any way to set the output profile to "Nexus". The closest I can find is "Android tablet". Where did you see "Nexus"?


In any event, and assuming you use news scheduling and not the command line, and assuming that the output profile is something like "Android tablet", the next time you fetch news the title of CNET should have the date in it. That will fix the overwrite and date change problems.

[NSILMike]

Originally Posted by chaley

Hmmm, this is confusing. As far as I can tell, the only way that the date is not in the title (I see CNET News [Mon, 27 Jul 2015]) is for the output profile to be a kindle. Perhaps there are some defaults lying around that I haven't found. Also, I cannot find any way to set the output profile to "Nexus". The closest I can find is "Android tablet". Where did you see "Nexus"?
Attachment 140589

In any event, and assuming you use news scheduling and not the command line, and assuming that the output profile is something like "Android tablet", the next time you fetch news the title of CNET should have the date in it. That will fix the overwrite and date change problems.

1) Nothing on my tablet or in Calibre has a date in the title. The date is visible in both in separate fields, but not in the title.
2) Yes, I said Nexus to be as specific as I could.

[chaley]

Originally Posted by NSILMike

1) Nothing on my tablet or in Calibre has a date in the title. The date is visible in both in separate fields, but not in the title.
2) Yes, I said Nexus to be as specific as I could.

As far as I can tell the first can happen only if the output profile is for a kindle. Also, and again as far as I can tell, there must be a configuration file containing the output profile. Something isn't right in River City. Note: if something changed the output profile then only newly-downloaded news will have the date in the title.

Could you at some point check the configuration file again? To get there, go to Preferences, Miscellaneous and tap "Open calibre configuration directory". A folder browser should open. Navigate to the "conversion" folder. You will see a lot of files where one of them must be "page_setup.py". It should contain something very close to the following:

{
	'margin_left' : 5.0,
	'margin_top' : 5.0,
	'input_profile' : 'default',
	'output_profile' : 'generic_eink',
	'margin_right' : 5.0,
	'margin_bottom' : 5.0,
}

Thanks.

[NSILMike]

That file contains:

{
'input_profile' : 'default',
'margin_bottom' : 5.0,
'output_profile' : 'kindle_fire',
'margin_top' : 5.0,
'margin_left' : 5.0,
'margin_right' : 5.0,
}
So, for some reason kindle is still there... How do I correct that?
Edit- I've changed it to Android Tablet.

[chaley]

Originally Posted by NSILMike

That file contains:

{
'input_profile' : 'default',
'margin_bottom' : 5.0,
'output_profile' : 'kindle_fire',
'margin_top' : 5.0,
'margin_left' : 5.0,
'margin_right' : 5.0,
}
So, for some reason kindle is still there... How do I correct that?

What worked for me was to start calibre normally, click the down-arrow on Preferences, and choose Run welcome wizard. You must select the correct profile on the second screen. On the third screen be sure to press the "Finish" button. The wizard should go away and calibre should restart. At this point the file should be changed.

[NSILMike]

Originally Posted by chaley

What worked for me was to start calibre normally, click the down-arrow on Preferences, and choose Run welcome wizard. You must select the correct profile on the second screen. On the third screen be sure to press the "Finish" button. The wizard should go away and calibre should restart. At this point the file should be changed.

Wow! The whole user experience on my tablet using CC improved dramatically! I had no idea what I was missing. The CC experience got close to, if not identical to the Calibre experience on a PC. Now I see the 'book' covers, and the ToC is vastly improved (and pretty similar to the Calibre version.) Also, the dates now show up in the book title as you had indicated was normal for a non-kindle device.
I'm sure this occurred because my initial device (which I still use semi-frequently) was a Kindle Keyboard. I had no idea to re-run setup when I got the Nexus android tablet, since it worked just fine.

Edit- Date shows up for all daily downloads except the New York Times. I have no idea why, but unless it indicates some other more serious issue, I also don't care.

[chaley]

Originally Posted by NSILMike

Edit- Date shows up for all daily downloads except the New York Times. I have no idea why, but unless it indicates some other more serious issue, I also don't care.

For some reason the NYT recipe sets the time format specifier used to generate dates to '', effectively ensuring that there aren't any dates generated. I have no idea why whoever built the recipe did that. I also don't know what would happen if you customized the recipe and removed that specification. If I get some time I will try it.