How to best format thumb drive to put my library on it

LadyKate · 12-01-2016, 09:36 PM

I was copying my entire library to a 2 TB thumb drive. This has proven to be impossible.

It is formatted as FAT32 and the library is under a name 2016 Calibre Library.

It stopped after copying with the Error 0x80070052 (The directory or file cannot be created) when
+0.6

I want the thumb drive to be readable on as wide a variety of systems as possible but I also want the library to be accessible as a library, not just as a collection of files or a rar of it (if possible).

The error appeared after 41,385 folders and 43,641 files were copied to the "2016 Calibre Library" folder.

I am open to suggestions as to how to format the thumb drive to be able to put my entire library on it. Backing up a rar file and having to replace it would be painful. The thumb drive is VERY slow.

AnemicOak · 12-01-2016, 09:55 PM

Not really sure, but I know my 128GB drive is formatted FAT32 and has no problem when I copy my library to it (about 8GB, 16,235 Files, 5,384 Folders).

Is the library all contained inside of a folder (mine is called 'Library') or are you copying all of the individual author folders directly to the root? IIRC FAT32 has a limit to the number of files/directories you can have directly in root (512 I think?).

Perhaps try a fresh reformat (FAT32) on the drive or use NTFS (if everything you'll be using it with with support that).

LadyKate · 12-01-2016, 10:23 PM

Quote:

Originally Posted by AnemicOak

Not really sure, but I know my 128GB drive is formatted FAT32 and has no problem when I copy my library to it (about 8GB, 16,235 Files, 5,384 Folders).

Is the library all contained inside of a folder (mine is called 'Library') or are you copying all of the individual author folders directly to the root? IIRC FAT32 has a limit to the number of files/directories you can have directly in root (512 I think?).

Perhaps try a fresh reformat (FAT32) on the drive or use NTFS (if everything you'll be using it with with support that).

As per my original post, the library is in the folder "2016 Calibre Library". At this time it is the only file in the root directory.

In my main library that I am attempting to backup to thumb drive and as of today there are more than 75000 author folders and a total of over 710,000 files (and over 300,000 folders when you consider the folders below each author). This particular library is almost 350Gig and as the thumb drive is a very slow drive the error showed up after over 16 hours of copying.

The error code showed up when attempting to copy the 26,979th folder. This was after over 16 hours of copying.

I seem to be coming up against fat32 limitations and am looking for suggestions on the best format if I want to be able to copy my entire library (reliably) and to be able to sync to it in future. I would prefer to be able to use the thumb drive on my Windows 10 systems as well as on older systems and Linux.

AnemicOak · 12-01-2016, 10:42 PM

Perhaps exFAT format?

Should work "out of the box" with Windows (at least back to XP I believe) & Mac systems. For Linux I think there might be some packages that need to be installed that aren't there by default. I know it's recommended a lot for external drives.

davidfor · 12-01-2016, 11:09 PM

Quote:

Originally Posted by LadyKate

As per my original post, the library is in the folder "2016 Calibre Library". At this time it is the only file in the root directory.

In my main library that I am attempting to backup to thumb drive and as of today there are more than 75000 author folders and a total of over 710,000 files (and over 300,000 folders when you consider the folders below each author). This particular library is almost 350Gig and as the thumb drive is a very slow drive the error showed up after over 16 hours of copying.

The error code showed up when attempting to copy the 26,979th folder. This was after over 16 hours of copying.

I seem to be coming up against fat32 limitations and am looking for suggestions on the best format if I want to be able to copy my entire library (reliably) and to be able to sync to it in future. I would prefer to be able to use the thumb drive on my Windows 10 systems as well as on older systems and Linux.

It's probably directory limitations made worse by the long names.

Each FAT32 directory can have at most 64K files or subdirectories. So, your 75000 author directories will be to many to copy. But, it is worse than that. The 64K is actually the number of directory entries. If long file names are being used, then each file or subdirectory will take up more than one directory entry. And how many directory entries are used depends on the length of the file name.

From what I can see, AnemicOak's suggestion of using exFAT should work.

BetterRed · 12-02-2016, 12:18 AM

IIRC on Win7 (maybe Win 10 too) you have to format exFAT drives from the command line, the regular disk format dialogue no longer offers exFAT. The command is:- "format ?: /FS:exFAT"

But first I'd run "chkdsk ?: /f /r /x" - it could take a while.

BR

drjenkins · 12-02-2016, 08:29 AM

Quote:

Originally Posted by LadyKate

I was copying my entire library to a 2 TB thumb drive. This has proven to be impossible.

Are you certain it is actually a 2 TB drive?

Don't fall for the Flash Drive Scam!

4 Tools to Test and Detect Fake or Counterfeit USB Flash Drives

JSWolf · 12-02-2016, 09:20 AM

From what I've been able to find via Google is that the largest capacity thumb drive is 1tb and that 2TB thumb drives are a scam. Where did you buy this 2TB thumb drive and what brand is it?

LadyKate · 12-02-2016, 04:14 PM

I was impatient and after some additional research I opted with trying NTFS (sorry guys, not ignoring your suggestions just did it before I saw them).

I don't know the brand... it is a no name thumb drive that was picked up supercheap online at wish.com. It is 2TB (well... as counted if a kb was 1000 bytes and not 1024).

At $25 and with their return policy on defective items (my housemate has had to occasionally return items that didn't work and had no problem at all) it seemed like a good deal for "almost static backup".

I admit the speed leaves much to be desired. it is very slow (a usb 2 not usb 3 thumb drive) and I would not buy this particular one again, only because of the speed, but as I have been thinking it is time for me to put my various libraries (and some other items) on a drive to store with a friend in case of fire it seemed to be the right price if it worked (and as I said, my housemate has found wish.com to be easy to deal with when products arrived that were defective in the past).

I'm still doing the copy (after changing my power settings on Windows 10 so it didn't shut down even with a copy going on, it has currently been copying my library since 2am and as of 4pm it is at 23% complete lol)

Ask me in a few days if I still think this inexpensive thumb drive is a good "static backup" tool.

itimpi · 12-03-2016, 01:31 AM

I am still very suspicious - all the reviews I have seen on 2TB thumb drives claim they are fake, and also tend to be virus/Trojan infested. The price also looks an order of magnitude too low for it to be genuine. Have you checked that the files that are apparently being written are actually there - if it is a fake drive you would probably find that even though the write appears to be working the files are not really there after the first 60GB or so have been written.

Having said all that if it turns out to be genuine you have got yourself a bargain.

theducks · 12-03-2016, 02:22 AM

Quote:

Originally Posted by itimpi

I am still very suspicious - all the reviews I have seen on 2TB thumb drives claim they are fake, and also tend to be virus/Trojan infested. The price also looks an order of magnitude too low for it to be genuine. Have you checked that the files that are apparently being written are actually there - if it is a fake drive you would probably find that even though the write appears to be working the files are not really there after the first 60GB or so have been written.

Having said all that if it turns out to be genuine you have got yourself a bargain.

+1 (and I am betting that it is a fake)

That price is less than 1/2 of what a Rotating 2T HD is selling for here, on sale.

LadyKate · 12-03-2016, 06:11 AM

As I said, it is VERY slow and I still have 125 gig of my library to copy (between 10 and 19 hours lol).

When the copy if completed I will do a complete comparison with the library on my hard drive and the copy on the thumb drive. If they don't compare then I guess I'm doing a return... but it is obvious from the time it is taking to do the copy that even if it is legit I can only consider this to be static storage.

BetterRed · 12-03-2016, 07:11 AM

Quote:

Originally Posted by LadyKate

As I said, it is VERY slow and I still have 125 gig of my library to copy (between 10 and 19 hours lol).

When the copy if completed I will do a complete comparison with the library on my hard drive and the copy on the thumb drive. If they don't compare then I guess I'm doing a return... but it is obvious from the time it is taking to do the copy that even if it is legit I can only consider this to be static storage.

No point in doing a backup to anything unless your confident you'll be able to use it to do a restore - and the only way you'll know that you can do a restore, is to do a restore.

BR

drjenkins · 12-03-2016, 08:04 PM

Quote:

Originally Posted by LadyKate

As I said, it is VERY slow

It is not only slow, it is a fraudelent drive. Please, stop using this drive now.

If you haven't read the first two links I provided at least look at one of these:s one:

Fake Flash News – Internet & eBay Fraud

All About Fake Flash Drives

LadyKate · 12-03-2016, 08:56 PM

Ok, Looks like everyone was right. After many hours of copying and then verifying I find the thumb drive is totally corrupted. In the process of attempting to do a problem report/return or whatever.

Will give an update when I find if it is taken care of (ie: refund) or if it is a lost cause.

12-01-2016, 09:36 PM	#1
LadyKate Fanatic Posts: 515 Karma: 1470724 Join Date: Jul 2013 Location: Quebec CA Device: android 4 (samsung tablet and asus tablet)	How to best format thumb drive to put my library on it I was copying my entire library to a 2 TB thumb drive. This has proven to be impossible. It is formatted as FAT32 and the library is under a name 2016 Calibre Library. It stopped after copying with the Error 0x80070052 (The directory or file cannot be created) when +0.6 I want the thumb drive to be readable on as wide a variety of systems as possible but I also want the library to be accessible as a library, not just as a collection of files or a rar of it (if possible). The error appeared after 41,385 folders and 43,641 files were copied to the "2016 Calibre Library" folder. I am open to suggestions as to how to format the thumb drive to be able to put my entire library on it. Backing up a rar file and having to replace it would be painful. The thumb drive is VERY slow.

12-03-2016, 01:31 AM	#10
itimpi Wizard Posts: 4,553 Karma: 950151 Join Date: Nov 2008 Device: Sony PRS-950, iphone/ipad (Marvin/iBooks/QuickReader)	I am still very suspicious - all the reviews I have seen on 2TB thumb drives claim they are fake, and also tend to be virus/Trojan infested. The price also looks an order of magnitude too low for it to be genuine. Have you checked that the files that are apparently being written are actually there - if it is a fake drive you would probably find that even though the write appears to be working the files are not really there after the first 60GB or so have been written. Having said all that if it turns out to be genuine you have got yourself a bargain. Last edited by itimpi; 12-03-2016 at 01:33 AM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Windows wants to format Kobo drive	spannah	Kobo Reader	7	02-02-2019 07:51 PM
Windows not able to access Aura drive (format error)	Sintel	Kobo Reader	14	01-13-2015 01:22 AM
Use your iPhone or iPad as a thumb drive.	monkeyluis	Apple Devices	10	04-02-2012 12:34 PM
can I buy books and store them on thumb drive?	Oldpilot	Sony Reader	9	08-05-2011 10:49 AM
Sell Ipaq 1910 Pocket PC + MP3 Thumb Drive	HaggisMacJedi	Flea Market	4	09-20-2008 09:07 AM

12-01-2016, 09:55 PM	#2
AnemicOak Bookaholic Posts: 14,391 Karma: 54969924 Join Date: Oct 2007 Location: Minnesota Device: iPad Mini 4, AuraHD, iPhone XR +	Not really sure, but I know my 128GB drive is formatted FAT32 and has no problem when I copy my library to it (about 8GB, 16,235 Files, 5,384 Folders). Is the library all contained inside of a folder (mine is called 'Library') or are you copying all of the individual author folders directly to the root? IIRC FAT32 has a limit to the number of files/directories you can have directly in root (512 I think?). Perhaps try a fresh reformat (FAT32) on the drive or use NTFS (if everything you'll be using it with with support that).

12-01-2016, 10:42 PM	#4
AnemicOak Bookaholic Posts: 14,391 Karma: 54969924 Join Date: Oct 2007 Location: Minnesota Device: iPad Mini 4, AuraHD, iPhone XR +	Perhaps exFAT format? Should work "out of the box" with Windows (at least back to XP I believe) & Mac systems. For Linux I think there might be some packages that need to be installed that aren't there by default. I know it's recommended a lot for external drives.

12-02-2016, 12:18 AM	#6
BetterRed null operator (he/him) Posts: 21,722 Karma: 29711016 Join Date: Mar 2012 Location: Sydney Australia Device: none	IIRC on Win7 (maybe Win 10 too) you have to format exFAT drives from the command line, the regular disk format dialogue no longer offers exFAT. The command is:- "format ?: /FS:exFAT" But first I'd run "chkdsk ?: /f /r /x" - it could take a while. BR

12-02-2016, 09:20 AM	#8
JSWolf Resident Curmudgeon Posts: 79,749 Karma: 145864619 Join Date: Nov 2006 Location: Roslindale, Massachusetts Device: Kobo Libra 2, Kobo Aura H2O, PRS-650, PRS-T1, nook STR, PW3	From what I've been able to find via Google is that the largest capacity thumb drive is 1tb and that 2TB thumb drives are a scam. Where did you buy this 2TB thumb drive and what brand is it?

12-02-2016, 04:14 PM	#9
LadyKate Fanatic Posts: 515 Karma: 1470724 Join Date: Jul 2013 Location: Quebec CA Device: android 4 (samsung tablet and asus tablet)	I was impatient and after some additional research I opted with trying NTFS (sorry guys, not ignoring your suggestions just did it before I saw them). I don't know the brand... it is a no name thumb drive that was picked up supercheap online at wish.com. It is 2TB (well... as counted if a kb was 1000 bytes and not 1024). At $25 and with their return policy on defective items (my housemate has had to occasionally return items that didn't work and had no problem at all) it seemed like a good deal for "almost static backup". I admit the speed leaves much to be desired. it is very slow (a usb 2 not usb 3 thumb drive) and I would not buy this particular one again, only because of the speed, but as I have been thinking it is time for me to put my various libraries (and some other items) on a drive to store with a friend in case of fire it seemed to be the right price if it worked (and as I said, my housemate has found wish.com to be easy to deal with when products arrived that were defective in the past). I'm still doing the copy (after changing my power settings on Windows 10 so it didn't shut down even with a copy going on, it has currently been copying my library since 2am and as of 4pm it is at 23% complete lol) Ask me in a few days if I still think this inexpensive thumb drive is a good "static backup" tool.

12-03-2016, 06:11 AM	#12
LadyKate Fanatic Posts: 515 Karma: 1470724 Join Date: Jul 2013 Location: Quebec CA Device: android 4 (samsung tablet and asus tablet)	As I said, it is VERY slow and I still have 125 gig of my library to copy (between 10 and 19 hours lol). When the copy if completed I will do a complete comparison with the library on my hard drive and the copy on the thumb drive. If they don't compare then I guess I'm doing a return... but it is obvious from the time it is taking to do the copy that even if it is legit I can only consider this to be static storage.

12-03-2016, 08:56 PM	#15
LadyKate Fanatic Posts: 515 Karma: 1470724 Join Date: Jul 2013 Location: Quebec CA Device: android 4 (samsung tablet and asus tablet)	Ok, Looks like everyone was right. After many hours of copying and then verifying I find the thumb drive is totally corrupted. In the process of attempting to do a problem report/return or whatever. Will give an update when I find if it is taken care of (ie: refund) or if it is a lost cause.

Advert

Advert