An issue in Preview - Page 5

KevinH · Today, 11:02 AM

Okay, I tested those patches and they both apply cleanly inside the qtwebengine directory as follows:

cd qtwebengine

patch -R -p1 < ddcd304.diff # reversing that patch

patch -p1 < 9dd5105.diff

I am rebuilding with those patches in place on my older machine so it may be an hour or so just to rebuild qtwebengine.

I will let you know if I run into any issues.

Update:

It was a fast rebuild. And the build completed with no issues with those patches in place.

DiapDealer · Today, 11:30 AM

I suppose the Python script I use to download/patch sources and kick off the compilation of the individual modules could factor into the slow-down, but I don't see how. It was always painfully slow even before I scripted things.

KevinH · Today, 11:35 AM

Could be, if you use the Qt single package the build runs in parallel across all qt modules.
They have really done a good job speeding the builds up using cmake at least they did on macos and Linux. Full Qt 5.15 builds on my old macOS box took about 8 hours. Recent Qt6 builds (and the codesize has really increased since Qt5) now take 3 hours on that same machine.

DiapDealer · Today, 11:58 AM

I just can't manage the single package any more. The resulting package is too huge and can't easily be uploaded for CI, or be easily moved to other machines. It actually results in more unnecessary modules, plugins and cruft being linked into the Windows Sigil bundle too. Building only the modules that are necessary for Sigil is the only way I can keep my Qt6 environment (not to mention the Sigil installer bundles) small enough to be useful.

I will try an all-in-one build sometime just to rule out the possibility that my methods are causing the slowdown. I just don't see how it could be, though, since the QtWebEngine build alone takes hours and hours. And it uses ninja, which automatically makes use of parallel processing.

JSWolf · Today, 12:07 PM

Quote:

Originally Posted by DiapDealer

QtWebEngine has always been a mess of a build on Windows. Very memory intensive. A myriad of tiny build tools and libraries that are already available on Linux and Macs need to be compiled first. The list of pre-requisites for building are also ridiculous. Plus there's a massive linking phase at the end of the process where things slow to a complete crawl (even when limiting parallel jobs to avoid maxing out memory usage). Things actually managed to get inexplicably worse when MSVC became fully 64-bit (the tool chain for building 64-bit binaries was actually 32-bit for years).

It's possible that things might work better on Intel, but I don't have the time (or the money) to build a new Windows machine that will literally sit collecting dust between custom Qt builds. Building Qt for Sigil is the only thing I need a physical Windows machine for these days. If not for QtWebEngine's incompatibility, I could probably do better cross-compiling for Windows with MinGW on Linux.

You could get a Micro-PC that has a good processor, 32GB Ram, and a 1TB SSD. They are a lot less expensive then a full size desktop. I bought one with a 12th gen 17 and it was less then $500. It came with Windows 11 Pro.

KevinH · Today, 12:07 PM

Understood. Yes the macdeployqt often includes unnecessary libs. No idea why.

DiapDealer · Today, 12:33 PM

Quote:

Originally Posted by JSWolf

You could get a Micro-PC that has a good processor, 32GB Ram, and a 1TB SSD. They are a lot less expensive then a full size desktop. I bought one with a 12th gen 17 and it was less then $500. It came with Windows 11 Pro.

I've actually been looking. But anything I would consider a significant upgrade from what I have would be considerably more than $500. I'm not going to waste money on anything less than 128Gb and I9. Plus I'm not convinced the bus speeds on those minis is apples to apples when it comes to the same maxed-out ram/processors on full-size motherboards. I'd also want PCIe M.2 disk speeds.

There's no doubt those minis are great replacements for even high-end general-use PCs. I'm just not convinced they'd be the answer for intensive compilation duties.

kovidgoyal · Today, 07:30 PM

@DiapDealer: FYI, You can build Qt, including web engine just fine using a hardware accelerated qemu Windows VM running under Linux, that's how I do it. Indeed I have mine running in a VM that is actually running on a remote server so that I dont have to bother keeping a powerful machine in house just for this.

Today, 11:02 AM	#61
KevinH Sigil Developer Posts: 8,928 Karma: 6361444 Join Date: Nov 2009 Device: many	Okay, I tested those patches and they both apply cleanly inside the qtwebengine directory as follows: cd qtwebengine patch -R -p1 < ddcd304.diff # reversing that patch patch -p1 < 9dd5105.diff I am rebuilding with those patches in place on my older machine so it may be an hour or so just to rebuild qtwebengine. I will let you know if I run into any issues. Update: It was a fast rebuild. And the build completed with no issues with those patches in place. Last edited by KevinH; Today at 11:08 AM.

Today, 11:35 AM	#63
KevinH Sigil Developer Posts: 8,928 Karma: 6361444 Join Date: Nov 2009 Device: many	Could be, if you use the Qt single package the build runs in parallel across all qt modules. They have really done a good job speeding the builds up using cmake at least they did on macos and Linux. Full Qt 5.15 builds on my old macOS box took about 8 hours. Recent Qt6 builds (and the codesize has really increased since Qt5) now take 3 hours on that same machine. Last edited by KevinH; Today at 11:38 AM.

Today, 11:58 AM	#64
DiapDealer Grand Sorcerer Posts: 28,728 Karma: 205159604 Join Date: Jan 2010 Device: Nexus 7, Kindle Fire HD	I just can't manage the single package any more. The resulting package is too huge and can't easily be uploaded for CI, or be easily moved to other machines. It actually results in more unnecessary modules, plugins and cruft being linked into the Windows Sigil bundle too. Building only the modules that are necessary for Sigil is the only way I can keep my Qt6 environment (not to mention the Sigil installer bundles) small enough to be useful. I will try an all-in-one build sometime just to rule out the possibility that my methods are causing the slowdown. I just don't see how it could be, though, since the QtWebEngine build alone takes hours and hours. And it uses ninja, which automatically makes use of parallel processing. Last edited by DiapDealer; Today at 12:08 PM.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Kindle 4 Cant reach certain buttons issue and opening keyboard issue	Thefirebeast	KOReader	6	06-26-2021 12:46 AM
issue converting from azw3 to mobi (ccs and font issue)	fatkinglet	Conversion	3	10-15-2020 10:13 PM
preview vs print preview	isalherbo	Sigil	7	04-23-2013 03:52 PM
Nook Simple Touch Glowlight - technological issue or quality-control issue?	Dr. Drib	Barnes & Noble NOOK	1	12-04-2012 01:32 PM
Hyperlinks Issue in NLT Bible (ebook or software issue)?	myet01	Kobo Reader	5	07-29-2011 08:47 AM

Today, 11:30 AM	#62
DiapDealer Grand Sorcerer Posts: 28,728 Karma: 205159604 Join Date: Jan 2010 Device: Nexus 7, Kindle Fire HD	I suppose the Python script I use to download/patch sources and kick off the compilation of the individual modules could factor into the slow-down, but I don't see how. It was always painfully slow even before I scripted things.

Today, 12:07 PM	#66
KevinH Sigil Developer Posts: 8,928 Karma: 6361444 Join Date: Nov 2009 Device: many	Understood. Yes the macdeployqt often includes unnecessary libs. No idea why.

Today, 07:30 PM	#68
kovidgoyal creator of calibre Posts: 45,470 Karma: 27757440 Join Date: Oct 2006 Location: Mumbai, India Device: Various	@DiapDealer: FYI, You can build Qt, including web engine just fine using a hardware accelerated qemu Windows VM running under Linux, that's how I do it. Indeed I have mine running in a VM that is actually running on a remote server so that I dont have to bother keeping a powerful machine in house just for this.

Advert

Advert