[Android] WiFi keeps dying on me when I try to load ebooks

RsH · 12-19-2016, 07:49 PM

I have about 15,300 ebooks to put onto my Samsung Tablet A via the SD card in it. When I try to do that using my computer and WiFi it almost always dies out after 4 or 5 or 6 ebooks have been transferred to the tablet. I simply get a message that the WiFi connection has been lost. That WiFi is shared by me and my wife, as well as our WiFi connected printer. Thus I find it impossible to use Calibre Companion with my tablet. I have transferred all of the ebooks to a different directory on the tablet via the USB direct connection to the tablet, but that means that I cannot see them using Calibre Companion and thus am missing its library features. I want those features but cannot spend weeks uploading the ebooks to the tablet a few books at a time. Any good suggestions for transferring over 15000 ebooks to that tablet AND being able to use Calibre Companion?

chaley · 12-20-2016, 04:47 AM

My guess is that you are running into the problem described in this FAQ: [Android] I have added a lot of books and now adding books takes forever. What do I do?. My thought is that you have reached a point where it is so slow that the network connection is timing out, but as you didn't say how many books you have already transferred I am just guessing.

If you send me the CC and calibre debug logs (how to do this is explained in this FAQ) I will see if there is more detail available.

RsH · 12-20-2016, 12:00 PM

I have attached the two log files you want. I am quite willing to try the third of your suggested templates but I have no idea how to write it or use it. I have 15,315 books in Calibre and 2,969 books on the Samsung Galaxy Tab A on the external SDCard, The CC debug log will come from torontorsh.

chaley · 12-20-2016, 01:22 PM

Thanks for the debug logs. It really looks like WiFi is being turned off in the middle of CC's processing, about 3.5 minutes after connecting. Both calibre and CC think the other side disappeared. Neither report an error.

Have you checked the tablet's "WiFi during sleep" policy? If might be set to turn off WiFi when the screen turns off. This web page tells how to check it: http://ccm.net/faq/15059-samsung-gal...i-sleep-policy

Another interesting thing: in the last connection in the second debug log the transfers from calibre were much slower than normal. They were running at about 1/2 the speed of the connection earlier in the day. Is there a reason that transfers at 11 o'clock would be much faster than transfers at transfers at noon? Was your device in a different place, perhaps with a worse WiFi connection?

FWIW: the log shows no transfers. The network is disconnecting (or whatever is happening) during the automatic metadata exchange.

As for the template: it isn't currently the problem but it will become one. See "Solution 1" in the FAQ How do I get the same file names in CC no matter which connection I use? for how to set a template in CC. You would enter the third template into the template input box.

RsH · 12-20-2016, 01:39 PM

I've checked and the WiFi is set to never turn off... so that is not the issue. I've entered the template #3 and am now trying to delete the books already on the tablet and it is dying while I do that so I suspect I need to go into the tablet and delete that directory and the calibre metadata file as well, and then start from scatch. As for the location of the tablet and the computer between the two logs, nothing changed... both were in the same locations...

RsH

chaley · 12-20-2016, 03:43 PM

The network is shutting down while exchanging metadata so you won't be able to delete files from calibre.

If you want to try with the new template then see the FAQ How do I reinitialize CC without reinstalling the app?. Solution 2 is probably the best approach.

Given that there isn't an error in either log, it might be that we won't find a solution for the problem. If that happens then we would be happy to give you a refund. Use the "Contact us" form at www.multipie.co.uk to ask for one.

Dopedangel · 12-21-2016, 12:00 AM

Quote:

Originally Posted by RsH

I've checked and the WiFi is set to never turn off... so that is not the issue. I've entered the template #3 and am now trying to delete the books already on the tablet and it is dying while I do that so I suspect I need to go into the tablet and delete that directory and the calibre metadata file as well, and then start from scatch. As for the location of the tablet and the computer between the two logs, nothing changed... both were in the same locations...

RsH

Do you have a battery saver type app installed. Those sometime are over aggressive in shutting down network connections etc.

RsH · 12-21-2016, 01:16 AM

I switched to the content server and set it up using explicit port numbers just to be sure, and it has been working perfectly with over 1600 ebooks being transferred in one go... without a time out or any other issue... WiFi kept dying even using template #2 but using the content server is fine, and I can be doing other things while it is running without any issues... so that is the way I will have to work it. I have no idea how it is handling the metadata but it is moving books over at a good rate. I have a number of ebooks set with author unknown and at the number of those have built up the transfer of those ebooks has slowed down quite a bit, but the others with author names are going over in seconds.

chaley · 12-21-2016, 03:40 AM

At the networking level, the difference between the content server and the wireless device connection is that the content server opens a new connection to calibre for every book. Said another way, the content server uses lots of short-lived connections while the wireless device uses one long-lived connection. All the evidence I have seen says that *something* on your network (in the computer running calibre, in the router, or in the Tab) is force-closing long-open network connections, thereby stopping the wireless device midstream.

I wonder if the problem is on the calibre machine. What antivirus/security suite are you running? Does the problem go away if you don't run it? Now that you have something that works, if you are tired of these experiments I understand.

BTW: the cloud connection also uses short-lived connections so it should also work.

RsH · 12-21-2016, 11:58 AM

I am using MalwareBytes and F-Prot as well as whatever MS has built into Windows 10... but both my programs have been told to ignore the Calibre folder and its subfolders. That made no difference to the WiFi connection but the Content Server works fine, and I will continue to use it for most of the ebooks I want to put onto the tablet. Right now I have it transferring over 3000 ebooks in epub format by Harlequin to the tablet, based on publisher and download all. That should take a while, even if it is doing a book every one or two seconds.

RsH · 12-21-2016, 12:02 PM

A quick related question... when I use the Content Server and ask it to download all and there are more than a thousand ebooks to download, how do I know when it has finished with the downloading? I have not gotten a message that it is finished and need to scroll though to make certain and that is extremely tedious when we are talking about over 3000 books and only 9 show up on the screen on the tablet. Is there an easy way to know it is finished? The program should know it has finished the download, after all.

chaley · 12-21-2016, 12:10 PM

Quote:

Originally Posted by RsH

I am using MalwareBytes and F-Prot as well as whatever MS has built into Windows 10... but both my programs have been told to ignore the Calibre folder and its subfolders. That made no difference to the WiFi connection but the Content Server works fine ...

It would be the "Network Protection" part of either MalwareBytes or F-Prot that is causing the problem (if it is), not the antivirus part. My theory: the tool sees the long-open connection and kills it, thinking that it might be malware acting as a bot. If I had to guess then I would investigate MalwareBytes because of its "active defense" stuff and because we have had problems with MalwareBytes before. Of course, the only evidence I have for this idea is that *something* is killing that connection.

I am glad you have a work-around.

chaley · 12-21-2016, 12:25 PM

Quote:

Originally Posted by RsH

A quick related question... when I use the Content Server and ask it to download all and there are more than a thousand ebooks to download, how do I know when it has finished with the downloading? I have not gotten a message that it is finished and need to scroll though to make certain and that is extremely tedious when we are talking about over 3000 books and only 9 show up on the screen on the tablet. Is there an easy way to know it is finished? The program should know it has finished the download, after all.

There should be an icon in the notification bar that indicates how many books remain to be downloaded. That icon disappears when the downloads are done. See the attached images.

If is OK to kill a "download all". It remembers what was downloaded. A future download all will download only what hasn't already arrived.

12-19-2016, 07:49 PM	#1
RsH Enthusiast Posts: 26 Karma: 10 Join Date: May 2011 Location: Canada Device: Samsung Tab A and PC + RCA RCT6213W87M Tablet + FiGo telephone	[Android] WiFi keeps dying on me when I try to load ebooks I have about 15,300 ebooks to put onto my Samsung Tablet A via the SD card in it. When I try to do that using my computer and WiFi it almost always dies out after 4 or 5 or 6 ebooks have been transferred to the tablet. I simply get a message that the WiFi connection has been lost. That WiFi is shared by me and my wife, as well as our WiFi connected printer. Thus I find it impossible to use Calibre Companion with my tablet. I have transferred all of the ebooks to a different directory on the tablet via the USB direct connection to the tablet, but that means that I cannot see them using Calibre Companion and thus am missing its library features. I want those features but cannot spend weeks uploading the ebooks to the tablet a few books at a time. Any good suggestions for transferring over 15000 ebooks to that tablet AND being able to use Calibre Companion?

12-20-2016, 01:39 PM	#5
RsH Enthusiast Posts: 26 Karma: 10 Join Date: May 2011 Location: Canada Device: Samsung Tab A and PC + RCA RCT6213W87M Tablet + FiGo telephone	An update I've checked and the WiFi is set to never turn off... so that is not the issue. I've entered the template #3 and am now trying to delete the books already on the tablet and it is dying while I do that so I suspect I need to go into the tablet and delete that directory and the calibre metadata file as well, and then start from scatch. As for the location of the tablet and the computer between the two logs, nothing changed... both were in the same locations... RsH

12-21-2016, 01:16 AM	#8
RsH Enthusiast Posts: 26 Karma: 10 Join Date: May 2011 Location: Canada Device: Samsung Tab A and PC + RCA RCT6213W87M Tablet + FiGo telephone	I've switch to using the Content Server and that works fine... I switched to the content server and set it up using explicit port numbers just to be sure, and it has been working perfectly with over 1600 ebooks being transferred in one go... without a time out or any other issue... WiFi kept dying even using template #2 but using the content server is fine, and I can be doing other things while it is running without any issues... so that is the way I will have to work it. I have no idea how it is handling the metadata but it is moving books over at a good rate. I have a number of ebooks set with author unknown and at the number of those have built up the transfer of those ebooks has slowed down quite a bit, but the others with author names are going over in seconds.

12-21-2016, 11:58 AM	#10
RsH Enthusiast Posts: 26 Karma: 10 Join Date: May 2011 Location: Canada Device: Samsung Tab A and PC + RCA RCT6213W87M Tablet + FiGo telephone	What am I using for security? I am using MalwareBytes and F-Prot as well as whatever MS has built into Windows 10... but both my programs have been told to ignore the Calibre folder and its subfolders. That made no difference to the WiFi connection but the Content Server works fine, and I will continue to use it for most of the ebooks I want to put onto the tablet. Right now I have it transferring over 3000 ebooks in epub format by Harlequin to the tablet, based on publisher and download all. That should take a while, even if it is doing a book every one or two seconds.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Aura Cant load books or connect to WiFi	skurt	Kobo Reader	15	02-05-2016 11:49 PM
Touch Load books onto ST via wifi?	Bighairybloke	Barnes & Noble NOOK	2	09-25-2012 02:58 AM
Touch Load books onto ST via wifi?	Bighairybloke	Barnes & Noble NOOK	0	09-22-2012 04:42 AM
Touch Load a book using wifi only	GVC2031	Kobo Reader	7	09-06-2011 01:49 PM
PRS-950 Can you use wifi/3G to load books or articles on to 950?	charleslou	Sony Reader	1	06-24-2011 12:09 AM

12-20-2016, 04:47 AM	#2
chaley Grand Sorcerer Posts: 12,447 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	My guess is that you are running into the problem described in this FAQ: [Android] I have added a lot of books and now adding books takes forever. What do I do?. My thought is that you have reached a point where it is so slow that the network connection is timing out, but as you didn't say how many books you have already transferred I am just guessing. If you send me the CC and calibre debug logs (how to do this is explained in this FAQ) I will see if there is more detail available.

12-20-2016, 01:22 PM	#4
chaley Grand Sorcerer Posts: 12,447 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	Thanks for the debug logs. It really looks like WiFi is being turned off in the middle of CC's processing, about 3.5 minutes after connecting. Both calibre and CC think the other side disappeared. Neither report an error. Have you checked the tablet's "WiFi during sleep" policy? If might be set to turn off WiFi when the screen turns off. This web page tells how to check it: http://ccm.net/faq/15059-samsung-gal...i-sleep-policy Another interesting thing: in the last connection in the second debug log the transfers from calibre were much slower than normal. They were running at about 1/2 the speed of the connection earlier in the day. Is there a reason that transfers at 11 o'clock would be much faster than transfers at transfers at noon? Was your device in a different place, perhaps with a worse WiFi connection? FWIW: the log shows no transfers. The network is disconnecting (or whatever is happening) during the automatic metadata exchange. As for the template: it isn't currently the problem but it will become one. See "Solution 1" in the FAQ How do I get the same file names in CC no matter which connection I use? for how to set a template in CC. You would enter the third template into the template input box.

12-20-2016, 03:43 PM	#6
chaley Grand Sorcerer Posts: 12,447 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	The network is shutting down while exchanging metadata so you won't be able to delete files from calibre. If you want to try with the new template then see the FAQ How do I reinitialize CC without reinstalling the app?. Solution 2 is probably the best approach. Given that there isn't an error in either log, it might be that we won't find a solution for the problem. If that happens then we would be happy to give you a refund. Use the "Contact us" form at www.multipie.co.uk to ask for one.

12-21-2016, 03:40 AM	#9
chaley Grand Sorcerer Posts: 12,447 Karma: 8012886 Join Date: Jan 2010 Location: Notts, England Device: Kobo Libra 2	At the networking level, the difference between the content server and the wireless device connection is that the content server opens a new connection to calibre for every book. Said another way, the content server uses lots of short-lived connections while the wireless device uses one long-lived connection. All the evidence I have seen says that something on your network (in the computer running calibre, in the router, or in the Tab) is force-closing long-open network connections, thereby stopping the wireless device midstream. I wonder if the problem is on the calibre machine. What antivirus/security suite are you running? Does the problem go away if you don't run it? Now that you have something that works, if you are tired of these experiments I understand. BTW: the cloud connection also uses short-lived connections so it should also work.

12-21-2016, 12:02 PM	#11
RsH Enthusiast Posts: 26 Karma: 10 Join Date: May 2011 Location: Canada Device: Samsung Tab A and PC + RCA RCT6213W87M Tablet + FiGo telephone	A quick related question... when I use the Content Server and ask it to download all and there are more than a thousand ebooks to download, how do I know when it has finished with the downloading? I have not gotten a message that it is finished and need to scroll though to make certain and that is extremely tedious when we are talking about over 3000 books and only 9 show up on the screen on the tablet. Is there an easy way to know it is finished? The program should know it has finished the download, after all.

Advert

Advert