View Single Post
Old 10-29-2024, 04:41 AM   #1
vicar82
Junior Member
vicar82 began at the beginning.
 
Posts: 4
Karma: 10
Join Date: Oct 2024
Device: Amazon Kindle Paperwhite 2021
Converting a large number of e-books from fb2 to epub.

Hi to all!

My library consists of more than 420K e-books in fb2 format.
I set up converting my entire collection to epub format.
It took 1 week.

My server parameters:
Intel Xeon E5-2670 v2 *2
768G - RAM
RaidZ - Intel dc s3710S 1.6 TB * 4
Calibre running in docker container

After I started the conversion, I saw that the work was in progress and the files were being converted and the CPU was busy.
Conversion completed.
In my library, epub books did not appear in the folder, but in the folder /tmp/calibre_7.19.0_tmp_9cx3yqx2 I found 2,389,531 new files that are very similar to the result of format conversion::

Code:
4jig00o_.epub                 ar1vfnfc.fb2                  gyqzezv7.opf                  ipc_result_1_320681_x1t0o2yi.pickle  lvn5rlai.opf                         s3j3c434.fb2                  yb6bfbgp_worker_redirect.log
4jigbfpi.fb2                  ar1vz29g.epub                 gyq_zys3.epub                 ipc_result_1_320682_md_73bdi.pickle  lvn5wfka.fb2                         s3j413o8.jpeg                 yb6c19bc.opf
4jigsbv6.jpeg                 ar1x7nje.fb2                  gyr01hgw.opf                  ipc_result_1_320683_8txijuno.pickle  lvn_8c30.jpeg                        s3j45v59.epub                 yb6dhdjh.epub
4j__ijb8_worker_redirect.log  ar1yk9mb_worker_redirect.log  gyr0_nxo.jpeg                 ipc_result_1_320684_snz0gyfj.pickle  lvn8olfn.epub                        s3j5gqet.fb2                  yb_6evrf.jpeg
4jijxyyn.opf                  ar1ylgt4.opf                  gyr1j51h_worker_redirect.log  ipc_result_1_320685_h_j4syt2.pickle  lvnaf95a.opf                         s3j6fywf.fb2                  yb6_exk0.epub
4jikr6m3.epub                 _ar_1z5v.epub                 gyr2at0d_worker_redirect.log  ipc_result_1_320686_ttp0wtjf.pickle  lvnat15v.opf                         s3j7avaq.fb2                  yb6fy8u4.epub
4jimuw82.fb2                  ar1zmf9k.fb2                  gyr7nkr9_worker_redirect.log  ipc_result_1_320687_2nf7q59_.pickle  l_vnb_2k_worker_redirect.log         s3j8bol5.epub                 yb6g7vf9.jpeg
4jin5hlw.epub                 ar22djdr.fb2                  gyr_7vti_worker_redirect.log  ipc_result_1_320688_0t90dzlg.pickle  lvnc0qxs.fb2                         s3j8iw_h.jpeg                 yb6gtmbp.epub
4jinrrqk.opf                  ar2414q7.jpeg                 gyr7wlf4.jpeg                 ipc_result_1_320689_5r9sc71n.pickle  lv_n_c8z.fb2                         s3jankij.opf                  yb6guhcm.fb2
4jioiche.jpeg                 _ar252x1.fb2                  gyr8aton.jpeg                 ipc_result_1_320690_z2jaeij0.pickle  lvnd0gjv.jpeg                        s3jb1k8q.jpeg                 yb6gyhf4.fb2
4jipbvob.epub                 ar26057s.opf                  gyr8sxvl.opf                  ipc_result_1_320691_gefirdv7.pickle  lvnd957h.opf                         s3jdsxdh.opf                  _yb6lpia_worker_redirect.log
4jipj0b5_worker_redirect.log  ar2_7gql.epub                 gyr9yvds_worker_redirect.log  ipc_result_1_320692_d2gx7ez4.pickle  lvndck41.epub                        s3jexwa9_worker_redirect.log  yb6l_r95.fb2
4jipzmze.epub                 ar27ha_w.fb2                  gyra4q8v.epub                 ipc_result_1_320693_fd13n8j4.pickle  lvne3260.fb2                         s3jfv2wy.epub                 yb6m6c3a_worker_redirect.log
4jiqi5n0.epub                 ar27hjux.opf                  gyrbd3_c.jpeg                 ipc_result_1_320694_u7hr2heq.pickle  lvneaq2_.epub                        s3jglwai.epub                 yb6mqcc2.epub
4jir1q3v.epub                 ar29bl2z_worker_redirect.log  gy_rbgtz_worker_redirect.log  ipc_result_1_320695_sir165ae.pickle  lvngblzb.opf                         s3jhrazi_worker_redirect.log  yb6mqlh4_worker_redirect.log
_4jirec3.fb2                  ar29_ify.epub                 gyrbk428.opf                  ipc_result_1_320696_6atd5jxg.pickle  lvnhdmse.fb2                         s3j__hrw_worker_redirect.log  yb6nebq__worker_redirect.log
Currently, there is only one process running inside the calibre docker container:
Code:
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
644 abc 20 0 17.8g 11.9g 113664 R 100.7 3.1 7d+2h MetadataBackup
This process takes up 100% of one core. It does not write anything and almost does not read anything.
Questions:
What is this process?
What is it doing now?
And when will it end?

I did not find any logs to understand what is happening now
vicar82 is offline   Reply With Quote