Multi-terabyte USB3 (they should work on USB2, just slower) Hard drives are available for (well) under US$100
They are way faster than common pen drives (flash)
The down side, is some laptops can not supply enough power (

use a powered USB hub)
Flash also does not give warning when they are about to fail. Works, then it does not.