Comment by ot1138

7 months ago

Phenomenal article, very entertaining and aligns with my experience as a prominent search "outsider" (I founded the first search intelligence service back in 2004, which was later acquired by WPP. Do I have some stories).

The engineers at Google were wonderful to work with up to 2010. It was like a switch flipped mid-2011 and they became actively hostile to any third party efforts to monitor what they were doing. To put it another way, this would like NBC trying to sue Nielsen from gathering ratings data. Absurd.

Fortunately, the roadblocks thrown up against us were half-hearted ones and easily circumvented. Nevertheless, I had learned an important lesson about placing reliance for one's life work on a faceless mega tech corporation.

It was not soon after when Google eliminated "Don't Be Evil" from the mission statement. At least they were somewhat self aware, I suppose.

I'm really glad the article came out though, it fills in some gaps that I was fairly confident about but didn't have anything other than my sense of the players and their actions to back up what I thought was going on.

I and a number of other people left in 2010. I went on to work at Blekko which was trying to 'fix' search using a mix of curation and ranking.

When I left, this problem of CPC's (the amount Google got per ad click in search) was going down (I believe mostly because of click fraud and advertisers losing faith in Google's metrics). While they were reporting it in their financial results, I had made a little spreadsheet[1] from their quarterly reports and you can see things tanking.

I've written here and elsewhere about it, and watched from the outside post 2010 and when people were saying "Google is going to steam roll everyone" I was saying, "I don't think so, I think unless they change they are dead already." There are lots of systemic reasons inside Google why it was hard for them to change and many of their processes reinforced the bad side of things rather than the good side. The question for me has always been "Will they pull their head out in time to recover?" recognizing that to do that they would have to be a lot more honest internally about their actions than they were when I was there. I was also way more pessimistic, figuring that they would be having company wide layoffs by 2015 to 2017 but they pushed that out by 5 years.

I remember pointing out to an engineering director in 2008 that Google was living in the dead husk of SGI[2] which caused them to laugh. They re-assured me that Google was here to stay. I pointed out that Wei Ting told me the same thing about SGI when they were building the campus. (SGI tried to recruit me from Sun which had a campus just down the road from where Google is currently.)

[1] https://docs.google.com/spreadsheets/d/18_y-Zyhx-5a1_kcW-x7p...

[2] Silicon Graphics -- https://www.sfchronicle.com/news/article/peninsula-high-tech...

  • > I was also way more pessimistic, figuring that they would be having company wide layoffs by 2015 to 2017 but they pushed that out by 5 years.

    Well in 2011 Google had just over 30k employees, and now they're doing "layoffs" with 180k+ in 2024. I don't think the layoffs mean much.

    • Did I mention I was more pessimistic? :-) I expect that today they could layoff 150k, keep the 30K that are involved with search and enough ads that are making business and that husk would do okay for a long time. I don't suppose you watched SGI die, that happened to them, kind of spiraled into a core that has some money making business and then lived on that.

      One of my observations between "early" Google and "late" Google (and like the grandparent post I see 2010 as a pretty key point in their evolution) was employee "efficiency." I don't know if you've ever been in that situation where someone leaves a company and the company ends up hiring two or three people to replace them because of all the things they were doing. Not 10x engineers but certainly 3 - 5x engineers. Google starting losing lots of those in that decade. They had gone through the "Great Repricing" in 2008 when Google lowered the strike price on thousands of share options. And having been there 5 to 10 years had enough wealth built up in Google stock that for a modest level of "this isn't fun any more" could just do that.

      But aside from your observation that "they have plenty of people" it is similar to observing that a plane that has lost its engine at 36,000' has "plenty of altitude" both true and less helpful than "and here is the process we're going to use as we fall out of the sky to get the engines back on."

      Google has lots of resources. If you have ever read about IBM reinventing itself in the 90's its quite interesting to note that had IBM not owned a ton of real estate it likely would not have had the resources to restructure itself. I worked with an executive at IBM who was part of that restructuring and it really impressed on me how important "facing reality" was at a corporation, and looking at the situation more realistically. I had started trying to get Google to do that but gave up when Alan Eustace explained that he understood my argument but they weren't going to do any of the things I had recommended. At that point its like "Okay then, have fun." Still, at some point, they could. They could figure out exactly what their "value add" is and the big E economics of their business and realign to focus on that. Their 'mission oriented' statement suggests that they are paying some attention to that idea now. But to really pull it off a lot of smart, self-interested, and low-EQ people are going to have to come to terms with being wrong about a lot of stuff. That is what I don't see happening and so I'm not really expecting them to transform. Both not enough star bits and the luma are just not hungry enough.

      9 replies →

  • ChuckMcM, I just wanted to say, I really appreciate the long view you bring to HN discussions. When you've been in tech for a few decades you start to see predictable patterns. History may not repeat, but it often rhymes.

    • Piggybacking on this to also express my appreciation. If/when you write a memoir someday, it would be a valuable historical record. If not, your hn comments are a wonderful corpus too :)

      Thank you for sharing your experiences, Chuck!

  • A) I think it’s important to acknowledge that in many ways Google is actively trying to keep CPC low - what they care most about is total spend. A low CPC means an effective advertising network where interested consumers are efficiently targeted. Their position is complex thanks to their monopoly status over online advertising.

    B) I don’t think it’s fair to characterize recent layoffs as some put-off collapse… criticize Google all you want for running a bad search engine, but right now they’re still dominant and search is the most effective advertising known to man. They’re raking in buckets of money: they had 54K employees on 01/01/2015, and 182K on 01/01/2024. Similarly, they made 66B in 2014, and 305B in 2023. The latest layoffs are them cleaning house and scaring their workers into compliance, not the death throes of a company in trouble — they’re barely a dent in the exponential graphs: https://www.macrotrends.net/stocks/charts/GOOG/alphabet/numb...

    • A) This is short-sighted. What you're suggesting is in fact a way to optimize short-term gain over long-term viability. It's pure MBA tactics.

      Additionally, it's complete and total oversimplification. If you look at Google's earnings it's pretty damn clear that at least until 2020 they were not just going for maximum total spend, but for a steady, gradual raise in total spend. Not too slow, not too fast. They were NOT taking every opportunity they had, in fact they're famous for systematically refusing many opportunities (see the original founders' letter, but even after that). They were farming the ad market, the ad spend, growing it, nurturing it. Then COVID blew up the farm.

      Maybe you're right now, but I do hope they're recovering their old tactics. Because if they maximize it you'd see nothing but scams ... wait a second.

      B) Google was built by providing a vision, and getting out of the way of ground-up engineer efforts. "Scaring workers into compliance" IS killing the golden goose.

      You can see this in AI. Every story from an AI engineer that ran away from Google is the same. They didn't run away for the money, they ran away because they were getting scared into compliance.

      Now AI may make it, or not. I don't know. But this is happening EVERYWHERE in Google. Every effort. Every good idea, and every bad idea runs away, usually inside the mind of "a worker". Not to make them personally maximum money, but it's natural selection: if the idea doesn't run away, the engineer it's in is "scared into compliance", into killing the idea.

      Whatever the next big thing turns out to be, it simply cannot come out of Google. And it will hit suddenly, just like it did for Yahoo.

      10 replies →

    • > The latest layoffs are them cleaning house and scaring their workers into compliance, not the death throes of a company in trouble

      Really? I have the impression Google’s other tools (I have lots of uses of Docs and Meet ) are degrading in quality quite quickly

      That is a subjective judgement, but it seems Google no longer cares

  • What is definition of dead? 15 years later they have huge majority of traffic share and lots of revenue.

    • Companies this size die several years before the body hits the floor.

      They're dead when everyone starts to hate them and someone says "no, look how much money they're making, they're fine." That's the fatal blow, because they think they're fine, and keep doing the things that make everyone hate them.

      At that point you're just waiting for someone else to offer an alternative. Then people prefer the alternative because the incumbent has been screwing them for so long, and even if they change at that point, it's too late because nobody likes or trusts them anymore, and ships that big can't turn on a dime anyway.

      You have to address the rot when customers start complaining about it, not after they've already switched to a competitor.

      44 replies →

    • You know how a chess player will say something like "mate in 6" because their experience of all the options left to their opponent are both easily countered and will not prevent them from losing? Companies, and tech companies in my experience, get into death spirals due to a combination of people, culture, and organization. Pulling out of one of those is possible but requires a unique combination of factors and a strong leadership team to pull off. Something that is very hard to put into place when the existing leadership has overriding voting power. You can look at GE, IBM, and to some extent AT&T as companies that have "re-invented" themselves or at least avoided dissolution into an over marketed brand.

      I have a strong memory of watching a Jacques Cousteau documentary on sharks and learning that Sharks could become mortally wounded but not realize it because of how their nervous system was structured. As a kid I thought that was funny, as an engineer watching companies in the Bay Area die it was more sobering.

      If you have read the article, I think Gomes was right and saw search as a product, whereas Raghavan saw it as a tool for shoveling ads. A good friend of mine who worked there until 2020 wouldn't tell me why they left, but acknowledged that it was this that finally "ruined" Google.

      Their cash cow is dying, I know from running a search engine what sort of revenue you can get from being "just one of the search engine choices" versus the 800lb gorilla. Advertisers are disillusioned, and structurally their company requires growth to support the stock price which supports their salary offerings. There is a nice supportable business for about 5,000 - 8,000 people there, but getting there from where they are?

      My best guess at the moment is that when they die, "for reals" as they say, their other bets will either be spun off or folded, their search team will get bought by Apple with enough infrastructure to run it, Amazon or someone else buys a bunch of data centers, and one of the media companies buys the youtube assets.

      11 replies →

    • The majority of that revenue comes from violating data protection law and regulators and litigants are slowly racking up a series of wins which will gut ads margins.

      There is no Plan B, they are just going to break the law until they can’t and there’s zero clue what happens after that.

      They sat back and let OpenAI kick their ass precisely because ghouls like Prabakar call the shots and LLM are not a good display ads fit.

      The best parallel for Google is Kodak.

    • Dead in the same sense that IBM was dead in the late 90s, but it is not quite there yet I would say.

  • How did the slashtag feature worked and what did it do ? It seems like a interesting concept but sadly the site is dead . What happened to it ?

    • People would add sites for a particular topic (aka slashtag) to their list. That would build a virtual custom search engine within the search engine. And topic specific searches thrown at it would consistently out perform Bing and Google in terms of search quality. The meta "spam" slash tag (everyone got their own) would let you tell the engine sites you never wanted to see in your search results so if you were tired of your medical queries being spammed by quacks, add them to your spam list and they wouldn't be in your results.

      5 replies →

The 2010-2013 timeline was also when the problem of ad fraud exploded. Google even acquired a company (or multiple, if I recon correctly: https://www.ft.com/content/352c7d8e-9acc-11e3-946b-00144feab... ). You had these companies popping up left and right that were snooping on Google and the emerging programmatic advertising environment to see if the websites and the traffic delivered were legit, and there were some scary numbers flying around.

The whole problem kind of got swept under the rug with most advertising ecosystems implementing a checkbox solution for clean traffic, and the web turned mobile user first.

My impression is that ad fraud never disappeared - it just got sanitized and rolled in with the other parts of the ad stack.

  • Exactly.

    How much of (online) advertising is legit? Does any one know?

    What would a "healthy" ad ecosystem look like? What should the the FTC (and advertisers) be working towards?

    Eliminate any potential conflicts of interest? Bust up vertical integration (eg search & ads must remain separate companies)? Independent verification, as best able (eg like Nielsen does for ratings)?

    Or maybe we determine (digital) ads based biz models are irredeemable, and we figure something else out.

1. Do you know what caused it ? 2. How did the hostility look like ? 3. How did you circumvented them ? 4. What did your search service do ?

  • I don't know what caused it but I suspected at the time, and still do, that it was simply business people getting more involved in order to drive growth.

    The hostility was simply this. One day we had a dedicated high level Google engineer helping us out and giving us guidance (and even special tags) to get the data we needed in a cost effective manner for both Google and us. The next day, he was gone and we received demands to know exactly what we were doing, why and even sensitive information about our business. After several months of such probing, we were summarily told that the access we had was revoked and that there was no recourse.

    We circumvented by setting up thousands of unique IP addresses in 50+ countries throughout the world and pointing our spiders at Google through them (same as they do to everyone else). These were throttled to maintain very low usage rates and stay off the radar. We continually refilled our queues with untouched IPs in case any were ever blacklisted (which happened occasionally).

    As for what we did, we sampled ads for every keyword under the sun, aggregated and analyzed them to find out what was working and what wasn't. This even led to methods for estimating advertiser budgets. At one point, we had virtually every Google advertiser and their ongoing monthly spend, keywords and ad copy in our database. Highly valuable to smart marketers who were looking for an edge.

I enjoy reading this chap's stuff. It's not the way that I would write, but he's got a much broader audience than I do, so he obviously is meeting the needs of the reading population.

I do feel that I can't argue with his stuff, although it is very dark and cynical (and, truth be told, I have a lot of dark and cynical, in me, as well, but I try not to let it come out to play, too often).

Before 2019, the year most people who had issues with Google Search gave as the last one it was decent was 2012, so that tracks.

How many companies have management consultants taken down? It's quite amazing how bad they are at anything. Peter Thiel's hatred for consultants is really legit.