Why do we need dithering?

3 months ago (typefully.com)

This is going to be an odd comment, but I immediately recognised the parrot in the test images. It's the scarlet macaw from 2004 which is often used in many Wikipedia articles about colour graphics.

I think this is the original, photographed and contributed by Adrian Pingstone: https://commons.wikimedia.org/wiki/File:Parrot.red.macaw.1.a...

But this particular derivative is the one that appears most often in the Wikipedia articles: https://commons.wikimedia.org/wiki/File:RGB_24bits_palette_s...

This parrot has occurred in several articles on the web. For example, here's one article from a decade or so ago: https://retroshowcase.gr/index.php?p=palette

Parrots are often used in articles and research papers about computer graphics and I think I know almost all the parrots that have ever appeared in computing literature. This particular one must be the oldest computing literature parrot I know!

By the way, I've always been fascinated by dithering ever since I first noticed it in newspapers as a child. Here was a clever human invention that could produce rich images with so little, something I could see every day and instinctively understand how it creates the optical illusion of smooth gradients, long before I knew what it was called.

  • The predecessor of dithering was the art of wood engraving, which reproduced the texture of illustrations in wood blocks used for printing in newspapers and books; necessarily in black and white. It's difficult to imagine now, but there was an entire industry of engravers to many of whom solely practiced engraving of others designs (often supplied drawn directly on the block to be engraved, to save time). These engravers were highly skilled and the artistry with which a piece was engraved could make a huge difference.

    For example see "A treatise on wood engravings : historical and practical", by John Jackson and William Chatto, 1839[1]; here is a quote (p585 of the linked edition):

    "With respect to the direction of lines, it ought at all times to be borne in mind by the wood engraver, — and more especially when the lines are not laid in by the designer, — that they should be disposed so as to denote the peculiar form of the object they are intended to represent. For instance, in the limb of a figure they ought not to run horizontally or vertically, — conveying the idea of either a flat surface or of a hard cylindrical form, — but with a gentle curvature suitable to the shape and the degree of rotundity required. A well chosen line makes a great difference in properly representing an object, when compared with one less appropriate, though more delicate. The proper disposition of lines will not only express the form required, but also produce more colour as they approach each other in approximating curves, as in the following example, and thus represent a variety of light and shade, without the necessity of introducing other lines crossing them, which ought always to be avoided in small subjects : if, however, the figures be large, it is necessary to break the hard appearance of a series of such single lines by crossing them with others more delicate."

    There was even a period of a few decades after the invention of photography, during which it was not known how to mass produce photographs, and so they were manually engraved as with artworks. Eventually however, the entire profession became extinct.

    [1] https://archive.org/details/treatiseonwooden00chat/page/585/.... (This is the 1881 edition)

  • This also used to be a really common test image: https://en.wikipedia.org/wiki/Lenna

    But its apparently a cropped centerfold from Playboy

    • https://en.wikipedia.org/wiki/Grandfather_clause

      mercer on Nov 11, 2017 [–]

      Is the nipples being marked 'A' and 'B' part of the joke?

      DonHopkins on Nov 11, 2017 | parent [–]

      As far as I know, those were not the points of the joke. I noticed them for the first time yesterday too, after not noticing them for decades!

      As a teen, I'd printed it out, pinned it up on my wall next to the Cray-1 centerfold, and scribbled a bunch of modem phone numbers, user names and passwords all over it, and never even noticed.

      I did a quick search for other A's and B's and found that it used those characters as much as any other character for shading, but that sure seems like something some mischievous student, lab member, turist or sentient TECO script at the MIT-AI Lab might have done.

      There was no file security so anyone could have edited them in.

      Maybe one of Minsky's grad students was performing some A/B testing or eye tracking experiments.

      Somebody should ask RMS if EMACS had some special mode for editing line printer porn.

  • When teaching print (halftones, LPI, CMYK etc) I also use a parrot. I've used rainbows and chameleons too, but settled on the parrot as being the most appropriate. But now I begin to wonder if I was just parroting(har har) a paradigm.

This was recently shared on HN: https://visualrambling.space/dithering-part-1/

For anyone interested in seeing how dithering can be pushed to the limits, play 'Return of the Obra Dinn'. Dithering will always remind you of this game after that.

- https://visualrambling.space/dithering-part-1

- https://store.steampowered.com/app/653530/Return_of_the_Obra...

A related bit of tech trivia is that digital audio also often involves dithering, and not just decimated or compressed audio. Even very high-quality studio mastered audio benefits from an audio specific kind of dithering called noise shaping. Depending on the content, studio mixing engineers may choose different noise shaping algorithms.

https://en.wikipedia.org/wiki/Noise_shaping

Dithering is still very common in rendering pipelines. 8 bits per channel is not enough to capture subtle gradients, and you’ll get tons of banding. Particularly in mostly monochrome gradients produced by light sources. So you render everything to a floating point buffer and apply dithering.

Unlike the examples in this post, this dithering is basically invisible at high resolutions, but it’s still very much in use.

  • Another place where dithering is useful in graphics is when you can’t do enough samples in every point to get a good estimation of some value. Add jitter to each sample and then blur, and then suddenly each point will be influenced by the samples made around them, giving higher fidelity.

    I recently learned the slogan “Add jitter as close to the quantisation step as possible.” I realised that “quantisation step” is not just when clamping to a bit depth, but basically any time there is an if-test on a continuous value! This opens my mind to a lot of possible places to add dithering!

  • A lot of display hardware uses a combination of spatial and temporal dithering these days. You can see it sometimes if you look up close, it appears as very faint flickering "snow" (the kind you'd see on old analog TV). Ironically, making this kind of dithering even less perceivable may turn out to be the foremost benefit of high pixel resolutions (beyond 1080p) and refresh rates (beyond 120Hz) since it seems that raising those specs is easier than directly improving color depth in hardware.

  • Adobe Illustrator 2026 has only -just- added a dithering option to their gradient tool.

I haven't written about this yet but I don't often see it mentioned: dithering has applications outside of image processing. Any time one needs to create a sequence sampled from a distribution, but would like to do so "evenly" without creating lumps, Floyd–Steinberg is a decent candidate.

I have noticed author uses values 0-255 for shades of grey. When 0-255 range is used, this is usually nonlinear scale with average gamma 2.2. And de facto there is a standard function that maps 0-31 to linear function and the rest to power 2.4. Average power 2.2. Checkmate black 0 and white 255 is equavalent to uniform grey shade 185 or 186 as opposed to 127 or 128. Proper calculations should be done in linear space, and 16 bits per channel is desired at least.

Dithering is super useful in dark scenes in games and movies.

By adding random noise to the screen it makes bands of color with harsh transitions imperceptible, and the dithering itself also isn't perceptible.

I'm sure there are better approaches nowadays but in some of my game projects I've used the screen space dither approach used in Portal 2 that was detailed in this talk: https://media.steampowered.com/apps/valve/2015/Alex_Vlachos_...

It's only a 3 line function but the jump in visual quality in dark scenes was dramatic. It always makes me sad when I see streamed content or games with bad banding, because the fix is so simple and cheap!

One thing that's important to note is that it's a bit tricky to make dithering on / off comparisons because resizing a screenshot of a scene with dithering makes the dithering no longer work unless one pixel in the image ends up exactly corresponding to one pixel on your screen

  • It's not cheap for streaming. It's harder to compress and is lost in the process. The video codec is a smart low pass filter.

    • The AV1 codec has support to tell the decoder to generate fake film grain, so you can add back all the noise lost in compression.

      Although I don't think it's very widely used, I dunno if that's due to the compressors or decompressors.

You still see dithering from time to time as a cheap transparency, it's been a few years since Mario Odyssey but that's when last I recall it really stood out: https://xcancel.com/chriswade__/status/924071608976924673

  • I don't know why but I loathe this feature.

    It's pretty much the norm now and I think late UE4 in AAA games is what really pushed it?

    It's cheap and simple to setup, and most games rely on TAA to make it less annoying.

    But TAA sucks! And TAA encourages all sorts of extremely lazy workflows and graphical effects because it will clean them up a little, but they look so bad without it.

    I hate it. Raytracing is part of this. It's all just really big companies with billions of dollars cheaping out on authoring good visuals.

    Microsoft flight simulator has weird sparkly shadows because it's tracing a few hundred rays and expects you to use TAA to cover it up and it's so bad. Same exact story for reflections.

    So now companies expect you to buy $800 GPUs that chew through half a kilowatt of power so that they can be lazy and not care how poorly they've authored their assets and don't really have to consider anything about their visuals.

    It makes me sad.

  • This is what I'm doing for my game, I didn't know it was actually a thing in some big titles too, that's reassuring. I landed on it because it was a huge code simplification compared to every other method of handling transparency, and it doesn't look completely shit in the era of high resolutions and frame rates.

    • I just implemented it for a VR app I’ve been working on where the semi-transparent objects can appear any which way, intersecting, etc. I didn’t realize how much of an issue that’d be…or how hard it’d be to come up with a shader for dithering in VR that doesn’t look awful. I’m still not super happy with what I have - it moves along with the player’s eyes - but every other solution I could come up with didn’t interact well with two screens, especially at far distances from the object. Moire for days.

  • mafia2 used that as well (at least for cars appearing into your bubble)

    • First time I saw it was in the original Unreal game (1998) when using the software renderer. It had this very distinct asymmetric dithering pattern.

      Can't find a screenshot of it on short order, seems most screenshots are either of unrelated newer Unreal Engine or use hardware rendering which doesn't show this dithering.

The figures in this article are really great. How where they made? If I was to try and recreate them I might render things individually and then lay it out in Illustrator to get that 3D isomorphic look, but I assume there's a better way.

Is zooming disabled for anyone else? The article depends on me looking at the photos, but they're the size of a MicroSD card on my screen, and zooming in is disabled on this site!

We really don't anymore.

Back in the late 90s maybe. Gifs and other paletted image formats were popular.

I even experimented with them. I designed various formats for The Palace. The most popular was 20-bit (6,6,6,2:RGBA, also 5,5,5,5; but the lack of color was intense, 15 bits versus 18 is quite a difference). This allowed fairly high color with anti-aliasing -edges that were semi transparent.

One thing with dithering writeups that always bothered me: There never seems to be coverage of how to calculate colour similarity when there are multiple different colours involved, rather than just black and white gradients.

I am trying to implement it for myself, but really struggling to find any proper literature on that, that I am actually able to understand.

  • The first step is to convert from the RGB color space to something more perceptual, like Lab. I'm sure there's a standard for comparing the color similarity of two images but I'm having trouble remembering the name - too early in the morning I guess.

Even though it looks less accurate, I prefer the look of the Ordered Bayer image. It looks artistically low-fi while the others look more like a highly compressed image to me. Considering we are able to just represent images with full colour today, the only reason I'd dither is for the aesthetic.

Can somebody explain to me how dithering is an aesthetic (as mentioned in the article)? I feel I'm too young to understand that

For some good examples, check out what people have achieved on the PlayDate handheld with dithering on its 1-bit screen.

This is the best explanation I’ve come across. I enjoy dithering as a playful way to compress file size when it makes sense.

Slightly frustrating the author started out with color images and then switched to grayscale.

That was disappointing. I expected from the title that it would cover modern use cases. When's the last time you needed to use a web-safe palette?

It's still useful if you're trying to display a 10-bit-per-channel image on an 8-bit-per-channel display, but the gain isn't nearly as dramatic. And the need doesn't come up very often.

So, uh, why do we need dithering?

I thought the era of 4 bit color had passed.

  • Dithering is usually used up to 18-bit color (6 bits each red, green and blue components). But it's useful even past that to reduce banding.

We've had a couple of other recent discussions on dithering: https://www.rtings.com/tv/learn/chroma-subsampling has nice illustrations). Each 2×2 4-pixel block on the display would have one sample of chroma, which could be a 12-bit sample: 6 bits of U and 6 bits of V. Moreover, you can interpolate the U and V values from one 2×2 block to the next. As long as you're careful to avoid drawing text on backgrounds that differ only in chroma (as in the examples in that web page) you'd get full resolution for antialiased text and near-photo-quality images.

That wouldn't liberate you completely from the need for dithering, but I think you could have produced much higher quality images that way than we in fact did with MCGA and VGA GIFs.

They answered the question in the first two sentences: We don't need it, it's just an aesthetic nowadays.

  • Dithering can be for aesthetic reasons, I presume especially old-school dithering that is especially pronounced. However, dithering is actually still useful in all sorts of signal processing, particularly when there are perceptible artifacts of quantization. This occurs all the time: you can trivially observe it by making gradients that go between close looking colors, something you can see on the web right now. There are many techniques to avoid banding like this, but dithering lets you hide banding without needing increased bit depth or choosing strategic stop colors by trading off spatial resolution for (perceived) color resolution, which works excellently for gradients because it's all low frequency.

    And frankly, it turns out 256 colors is quite a lot of colors especially for a small image, so with a very good quantization algorithm and a very good dithering algorithm, you can seriously crunch a lot of things down to PNG8 with no obvious loss in quality. I have done this at many of my employers, armed with other tricks, to dramatically reduce page load sizes.

  • Dithering isn't only applied to 2D graphics, it can be applied in any type of spatial or temporal data to reduce the noise floor, or tune aliasing distortion noise to other parts of the frequency spectrum. Also common in audio.

  • It's not just aesthetic, I keep seeing games with color banding because they don't bother to dither before quantizing.

    • From the article:

      > We don't really need dithering anymore because we have high bit-depth colors so its largely just a retro aesthetic now.

      By the way, dithering in video creates additional problems because you want some kind of stability between successive frames.

      20 replies →