Miscellaneous

Color Survey

People have made some fun things with the color survey data already.  Howard Yeend did a 3D visualization, Gissehel made some maps out of the raw data, and Rune Grimstad made a color picker tool.  Also, Jacob Rus nerd sniped me with this, which is not related to the color survey but I’m sharing it anyway.

School-Building

Breadpig, the publisher of the xkcd book, is holding a survey to see where people want Room to Read to invest their remaining profits from the book.  If you want to vote, it closes at noon EST on Monday.

xkcd: Mobile Version

If you read xkcd on your phone, or you just prefer simple pages without a lot of clutter, check out m.xkcd.com.  It has a nice, clean design and should be capable of showing the alt-text in any browser (even Lynx, which can’t even show the comic). Report any problems with the site to mobile@xkcd.com.  Thanks!

Sex and Gender

I’ve gotten a few emails and /msgs about this so I really wanted to post a clarification.

When I put the color survey together, I was mostly interested in making maps and tables of color names; the opening survey was almost an afterthought. Elizabeth added a question about chromosomal sex, since it’s closely correlated with colorblindness (she’s one of the rare colorblind women).

We debated for a long time to find a wording of the question that would be answerable unambiguously by everyone, regardless of gender identification or any other issues.  In response to a friend who was suggesting we were overcomplicating things, she said, “I *refuse* to word the question in a way that doesn’t have a good, clear answer available for transsexuals, intersex people, and people who already know they have chromosomal anomalies.”  I felt the same way, and at the same time I didn’t want to assume everyone remembers what the hell chromosomes are. After hours of debate, everyone was happy with this:

Do you have a Y chromosome?

If unsure, select “Yes” if you are physically male and “No” if you are physically female. If you have had SRS, please respond for your sex at birth. This question is relevant to the genetics of colorblindness.

We didn’t add a question about gender identification, in part because I wasn’t really planning to do anything with the survey data beyond basic calibration and didn’t want to hassle people with more questions, and in part because gender is really complicated.  We recently programmed Bucket, the IRC chat bot in #xkcd, to allow people set their gender so he can use pronouns for them.  This ended up taking hundreds of lines of code, three pages of documentation, and six different sets of pronouns and variables, just to cover all the basic ways people in the channel with different gender identifications wanted to be referred to (even without invented pronouns like “xe”, which we vetoed).  And that’s just to cover the pronouns.  The role of gender in society is the most complicated thing I’ve ever spent a lot of time learning about, and I’ve spent a lot of time learning about quantum mechanics.

So when I wrote the survey, I really didn’t have anything in mind for the data. After it went up, I saw the DoghouseDiaries comic, and immediately wanted to investigate.  I was really amazed by the results, particularly the top-five list of colors, which came as a complete surprise.  Everyone agreed it was the most interesting of my results (at some point, my friends were sick of hearing me talk about hues and saturations) and I couldn’t resist publishing it somehow.

Originally, my post had a big wall of text discussing how all I had was chromosomal data, and that what the comic talked about was gender identification.  I rewrote this post a bunch of times, and ended up with roughly the wording that’s there now:

[...] realized I could test it (as far as chromosomal sex goes, anyway, which we asked about because it’s tied to colorblindness).

I didn’t want to spend a long time boring people about sex and gender (I’ll talk forever if you let me), but I also wanted to clarify that this was something I cared about and was trying to pay proper attention to.  I ran it by some friends before posting, and they approved; one specifically thanked me for adding that note.  So I figured I’d found a good balance.

But a number of people were still offended or upset by my use of the chromosomal data in a conversation about gender. Now, there are always going to be people upset about anything; as Ford Prefect said, “Fuck ‘em. You can’t care about every damn thing.” But this is an issue I really do care about, and one I spend a lot of time trying to get right—and I genuinely appreciate the guidance. If people were offended or feel I didn’t handle this right, I’m sorry, and it’s my fault. But it wasn’t for lack of caring.

And to anyone writing software that handles gender or sex information, it’s a good reminder that these questions are not always straightforward for everyone, and a little courtesy can do a lot to make someone feel respected.

Color Survey Results

Who in the rainbow can draw the line where the violet tint ends and the orange tint begins? Distinctly we see the difference of the colors, but where exactly does the one first blendingly enter into the other? So with sanity and insanity.
—Herman Melville, Billy Budd

Orange, red? I don’t know what to believe anymore!
—Anonymous, Color Survey

I WILL EAT YOUR HEART WITH A FUCKING SPOON IF YOU AKS ANY MORE QUESTIONS ABOUT COLORS
—Anonymous, Color Survey

Thank you so much for all the help on the color survey.  Over five million colors were named across 222,500 user sessions.  If you never got around to taking it, it’s too late to contribute any data, but if you want you can see how it worked and take it for fun here.

First, a few basic discoveries:

  • If you ask people to name colors long enough, they go totally crazy.
  • “Puke” and “vomit” are totally real colors.
  • Colorblind people are more likely than non-colorblind people to type “fuck this” (or some variant) and quit in frustration.
  • Indigo was totally just added to the rainbow so it would have 7 colors and make that “ROY G. BIV” acronym work, just like you always suspected. It should really be ROY GBP, with maybe a C or T thrown in there between G and B depending on how the spectrum was converted to RGB.
  • A couple dozen people embedded SQL ‘drop table’ statements in the color names. Nice try, kids.
  • Nobody can spell “fuchsia”.

Overall, the results were really cool and a lot of fun to analyze.  There are some basic limitations of this survey, which are discussed toward the bottom of this post.  But the sheer amount of data here is cool.

Sex

By a strange coincidence, the same night I first made the color survey public, the webcomic Doghouse Diaries put up this comic (which I altered slightly to fit in this blog, click for original):

It was funny, but I realized I could test whether it was accurate (as far as chromosomal sex goes, anyway, which we asked about because it’s tied to colorblindness) [Note: For more on this distinction, see my follow-up post]. After the survey closed, I generated a version of the Doghouse Diaries comic with actual data, using the most frequent color name for the handful of colors in the survey closest to the ones in the comic:

Basically, women were slightly more liberal with the modifiers, but otherwise they generally agreed (and some of the differences may be sampling noise).  The results were similar across the survey—men and women tended on average to call colors the same names.

So I was feeling pretty good about equality.  Then I decided to calculate the ‘most masculine’ and ‘most feminine’ colors.  I was looking for the color names most disproportionately popular among each group; that is, the names that the most women came up with compared to the fewest men (or vice versa).

Here are the color names most disproportionately popular among women:

  1. Dusty Teal
  2. Blush Pink
  3. Dusty Lavender
  4. Butter Yellow
  5. Dusky Rose

Okay, pretty flowery, certainly.  Kind of an incense-bomb-set-off-in-a-Bed-Bath-&-Beyond vibe.  Well, let’s take a look at the other list.

Here are the color names most disproportionately popular among men:

  1. Penis
  2. Gay
  3. WTF
  4. Dunno
  5. Baige

I … that’s not my typo in #5—the only actual color in the list really is a misspelling of “beige”.  And keep in mind, this is based on the number of unique people who answered the color, not the number of times they typed it.  This isn’t just the effect of a couple spammers. In fact, this is after the spamfilter.

I weep for my gender.  But, on to:

RGB Values

Here are RGB values for the first 48 out of about a thousand colors whose RGB values (across the average monitor, shown on a white background) I was able to pin down with a fairly high degree of precision:

The full table of 954 colors is here, also available as a text file here (I have no opinion about whether it should be used to build a new X11 rgb.txt except that seems like the transition would be a huge headache.)

The RGB value for a name is based on the location in the RGB color space where there was the highest frequency of responses choosing that name.  This was tricky to calculate.  I tried simple geometric means (conceptually flawed), a brute force survey of all potential center points (too slow), and fitting kernel density functions (math is hard). In the end, I used the average of a bunch of runs of a stochastic hillclimbing algorithm.  For mostly boring notes on my data handling for this list, see the comments at the bottom of the xkcd.com/color/rgb/ page.

Spelling and Spam

Spelling was an issue for a lot of users:

Now, you may notice that the correct spelling is missing.  This is because I can’t spell it either, and when running the analysis, used Google’s suggestion feature as a spellchecker:

A friend pointed out that to spell it right, you can think of it as “fuck-sia” (“fuch-sia”).

Misspellings aside, a lot of people spammed the database, but there were some decent filters in place.  I dropped out people who gave too many answers which weren’t colors used by many other people.  I also looked at the variation in hue; if people gave the same answer repeatedly for colors of wildly varying hue, I threw out all their results.  This mainly caught people who typed the same thing over and over.  Some were obviously using scripts; based on the filter’s certainty, the #1 spammer in the database was someone who named 2,400 colors—all with the same racial slur.

Map

Here’s a map of color boundaries for a particular part of the RGB cube.  The data here comes from a portion of the survey (1.5 million results) which sampled only this region and showed the colors against both black and white backgrounds.

The data for this chart is here (3.6 MB text file with each RGB triplet named).  Despite some requests, I’m not planning to make a poster of any of this, since it seems wrong to take advantage of all this volunteer effort for a profit; I just wanted to see what the results looked like.  You’re welcome to print one up yourself (huge copy here), but keep in mind that print color spaces are different from monitor ones.

Basic Issues

Of course, there are basic issues with this color survey.  People are primed by the colors they saw previously, which adds overall noise and some biases to the data (although it all seemed to even out in the end).  Moreover, monitors vary; RGB is not an absolute color space.  Fortunately, what I’m really interested in is what colors will look like on a typical monitors, so most of this data is across the sample of all non-colorblind users on all types of monitors (>90% LCD, roughly 6% CRT).

Color is a really fascinating topic, especially since we’re taught so many different and often contradictory ideas about rainbows, different primary colors, and frequencies of light. If you want to understand it better, you might try the neat introduction in Chapter 35 ofThe Feynman Lectures on Physics (Vol. 1), read Charles Poynton’s Color FAQ, or just peruse links from the Wikipedia article on color.  For the purposes of this survey, we’re working inside the RGB space of the average monitor, so this data is useful for picking and naming screen colors. And really, if you’re reading this blog, odds are you probably—like me—spend more time looking at a monitor than at the outdoors anyway.

Miscellaneous

Lastly, here are some assorted things people came up with while labeling colors:

Thank you so much to relsqui for writing the survey frontend, and to everyone else who sacrificed their eyeballs for this project.  If you have ideas and want to analyze these results further, I’ve posted the raw data as an SQLite dump here (84 MB .tar.gz file). It’s been anonymized, with IPs, URLs, and emails removed.  I also have GeoIP information; if you’d like to do geocorrelation of some kind, I’ll be providing a version of the data with basic region-level lat/long information (limited to protect privacy) sometime in the next few days. Note: The ColorDB data is the main survey.  The SatOnly data is the supplementary survey covering only the RGB faces in the map, and was presented on a half-black half-white background.)

And, of course, if you do anything fun with this data, I’d love to see the results—let me know at xkcd@xkcd.com.