← Back to context

Comment by Shog9

5 months ago

There was definitely a bit of Pournelle's Iron Law of Bureaucracy [0] at work. I worked there during a lot of the drama you allude to, and... It sucked, for everyone. But also...

For most of SO's history, the vast majority of visitors (and this questions, answers) came in via Google. Not "search engines"; Google. This was pretty much baked in right at the start, and it effectively served as the site's primary user interface for years. And it worked. It worked pretty well! Until it didn't.

At some point, Google started surfacing fewer "tried and true" Q&A examples and more unanswered, poorly-answered or moderated examples. This broke the fundamental assumption that sat behind SO's moderation - that curating a smaller set of posts was preferable to encouraging more, and newer. Suddenly, Google wasn't a very good UI for SO anymore.

...and SO didn't really have a fallback. Heck, for a while during this period they actually stopped showing questions on their homepage unless you were already logged in; the core assumption remained that there was a never-ending spring of new people feeding the thing. LLMs weren't the start of the problem, they were the end - the final wake-up call.

I don't know that a site like SO can exist without the old Google, the old Internet; it is a product of all that, in the same way that mass-market TV shows were a product of 20th-century broadcast technology, or trade paperbacks of a particular intersection of printing tech and reading habits.

[0]: https://www.jerrypournelle.com/reports/jerryp/iron.html

Oh, hey, Shog, good to see you doing well. It was a heck of a ride, hmm?

  • Yes indeed! Glad to see you over on Codidact; I suspect small, bespoke q&a will be the future of the form, at least after Facebook implodes.

    • Believe me, I'm full of vision (and hope). But it's hard to write stuff when there's so much to write that I can't find a natural starting point, and when the (lack-of-)network effects are so brutal.

Lots of moderation issues are also UI issues.

I suspect it’s the same issue for whatever is the “meta” in a competitive video game.

Optimization based on the available affordances ?

Best answer so far, too bad way down here.

  • It still seems a bit too simplistic… no one imagined that Google could behave less than 100% virtuously in the future? Really?

    • I don’t think there’s anything virtuous or non-virtuous about it. The internet is a big place and search engines aren’t optimized to produce results according to singular sites’ idiosyncrasies.

      The obvious flaw in Stack Overflow’s bias toward closing new questions is that over time the best pages are also the oldest and most stale. They even locked questions with enough answers to prevent new content from being added, guaranteeing that they became stale.

      Yet at the same time they allowed new questions to be asked and indexed by search engines, but didn’t allow new answers to that new content. So the freshest and most recent content was also the worst.

      I don’t see this as a “Google bad” moment. It’s a failure of Stack Overflow in clinging to their oldest content and building rules that made all new posts frustrating and unhelpful.

      1 reply →

    • It worked that way for its first ten plus years. Why would it change? Why/How could you plan for an unknown future. Personally I’m horrible at predicting the future, so I don’t blame them.

> the core assumption remained that there was a never-ending spring of new people feeding the thing.

Hi Shog, hope you're doing well! Just thought this bit was insightful; I can fully believe this was the idea and the motivating factor for a lot of the decisions made seemingly in a vacuum (from the outside).

How much do you think Area51 and the push for the SE network rather than sticking with the Big Three affected things? I always got the impression that they tried to scale into places that ultimately attracted too much noise and overestimated the willingness of (community) moderators to effectively work for free for them to take on the wave of less technical/principled users.

  • There was some of that for sure; sites that were all but designed to be attractive nuisances and took near-heroic efforts to moderate at all, with little chance of not causing a lot of drama.

    OTOH, topic-specific sites like Mathematics, MathOverflow, Physics, even small ones like Home Improvement or Seasoned Advice... Managed to collect a lot of good stuff: common niche questions with good answers that have a good chance at staying relevant for a long time to come.

    In a sane world, a few relevant ads on these sites would be enough to fund them for decades. But that appears to be another area where Google kinda shit the bed.

Shog9, excellent comment and very apt. I have to point out that you were also part of the toxicity and bad tone. You very much were part of the problem. Moderation and staff were very much the downfall.

  • Shog9 was probably the best person on staff in terms of awareness of the moderation problems and ability to come up with solutions.

    Unfortunately, the company abruptly stopped investing in the Q&A platform in ~2015 or so and shifted their development effort into monetization attempts like Jobs, Teams, Docs, Teams (again), etc. -- right around the time the moderation system started to run into serious scaling problems. There were plans, created by Shog and the rest of the community team, for sweeping overhauls to the moderation systems attempting to fix the problems, but they got shelved as the Q&A site was put in maintenance mode.

    It's definitely true that staff is to blame for the site's problems, but not Shog or any of the employees whose usernames you'd recognize as people who actually spent time in the community. Blame the managers who weren't users of the site, decided it wasn't important to the business, and ignored the problems.

    • Blame the managers who weren't users of the site, decided it wasn't important to the business, and ignored the problems.

      This always cracks me up. I've seen it so many times, and so many books cover this...

      Classic statement is "never take your eye off the ball".

      Sure, you need to plan ahead. You need to move down a path. But take your eye off of today, and you won't get to tomorrow.

      Maybe they'll SCO it, and spend the next 10 years suing everyone and their LLM dog.

      You know, I wonder how the board and execs made out suing Linux related... things. End users were threatened too, compelled to pay...

      SO could be spun off into a neat tiger, nipping at everyone's toes.

      1 reply →