What you're describing is a halftone. There's a lot of work on the best way to convert still images into halftones, but I don't know if there's much on converting video (where obviously you don't want large changes from frame to frame in how the image is represented as a halftone).
See the Wikipedia articles on
halftone and
error diffusion