Day 1: Crawling 19
Shown on screen 5
For classic Search, crawling means Googlebot, scheduling and robots.txt, with AI used in parts such as scheduling. Indexing is one big but not limitless index that calculates signals and understands more than words, with AI such as BERT. Serving uses hundreds of signals tailored to the moment, with AI such as RankBrain.
Speaker Cherry Prommawin, Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence slide photo, transcript
- Extended by D1-C205 Day 1: Signals calculated for a page during indexing are stored in the index and used both to decide whether the…
- Extended by D1-C211 Day 1: Index selection runs after signals are collected and duplicates are dropped, and decides what goes into…
- Extended by D2-C344 Day 2: Google deduplicates pages because many sites have very many pages and Google's index does not have room for…
- Extended by D2-C648 Day 2: Among the many signals Google calculates during indexing, the ones singled out as having large effects on…
- Repeated by D2-C680 Day 2: Google's index is immense but finite, so Google cannot index every URL it finds on a web with a practically…
- Extended by D2-C684 Day 2: Index selection is a predictive AI system that relies heavily on machine learning.
- Extended by D2-C722 Day 2: Each document in Google's index has pretty much all the signals calculated for it attached, for example…
Statistical models have been used at Google for over 20 years, for catching spam and originally for the 'Did you mean' feature.
Speaker Cherry Prommawin, Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence slide photo, transcript
- Extended by D1-C209 Day 1: Google launched the 'Did you mean' feature around 2001-2002 using a statistical model, which Gary Illyes…
- Extended by D2-C668 Day 2: Google uses more and more AI to detect spam, and Google's testing shows that this AI-based detection is…
- Extended by D2-C669 Day 2: SpamBrain, Google's AI-based spam detection system, is nowadays built on Gemini and fine-tuned specifically…
- Extended by D3-C680 Day 3: Gary Illyes said machine learning is about 50 years old and that Google has been using it for 'probably 30…
BERT is used in indexing to understand each word in the context of the whole sentence rather than one word at a time.
Speaker Cherry Prommawin, Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence slide photo, transcript
Used byglossary term BERT, RankBrain and MUM
- Extended by D2-C338 Day 2: Google detects soft 404s with a language model, described as something like BERT, that is trained to…
- Extended by D3-C684 Day 3: Predictive language models have been used a lot in Search, and BERT is one: technically, in the purest sense…
RankBrain is used in serving to interpret the intent behind queries, especially new or unusual ones, and match them to relevant results.
Speaker Cherry Prommawin, Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence slide photo
Used byglossary term BERT, RankBrain and MUM
- Extended by D1-C217 Day 1: Google began talking publicly about its use of AI in Search around 2015-2016, and RankBrain was the first…
MUM (Multitask Unified Model) understands information across text, images, audio and video, and processes information in more than 75 languages.
Speaker Cherry Prommawin, Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence slide photo
- Extended by D1-C218 Day 1: Google said MUM helps it understand the context of the words in a query: a search for hiking shoes that…
Said on stage 9
Google said it declared itself an AI-first company more than a decade ago.
Speaker Lino CattaruzziIn Day 1, 11:00 · Welcome and opening keynotesEvidence transcript
Google said it created the Transformer architecture (the paper 'Attention Is All You Need', the T in ChatGPT) and published it to move the industry forward, competitors included.
Speaker Lino CattaruzziIn Day 1, 11:00 · Welcome and opening keynotesEvidence transcript
Used byglossary term Transformer
- Extended by D1-C199 Day 1: Gary Illyes said searching by image or by video, as Search offers it today, was not possible before…
Google described a full-stack approach to AI, from its own TPU chips for AI inference through research and frontier models such as Gemini to its apps.
Speaker Lino CattaruzziIn Day 1, 11:00 · Welcome and opening keynotesEvidence transcript
Google said that last year (2025) it delivered a decade of innovation in 12 months, with its new Gemini model at the top of all the benchmarks.
Speaker Lino CattaruzziIn Day 1, 11:00 · Welcome and opening keynotesEvidence transcript
Gary Illyes said searching by image or by video, as Search offers it today, was not possible before transformers were invented.
Speaker Gary IllyesIn Day 1, 11:35 · What's new in the world of SearchEvidence transcript
- Extends D1-C161 Day 1: Google said it created the Transformer architecture (the paper 'Attention Is All You Need', the T in ChatGPT)…
Google launched the 'Did you mean' feature around 2001-2002 using a statistical model, which Gary Illyes counted as AI because it is a form of machine learning.
Speaker Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence transcript
- Extends D1-C041 Day 1: Statistical models have been used at Google for over 20 years, for catching spam and originally for the 'Did…
- Repeated by D3-C680 Day 3: Gary Illyes said machine learning is about 50 years old and that Google has been using it for 'probably 30…
Google began talking publicly about its use of AI in Search around 2015-2016, and RankBrain was the first such system it publicised widely.
Speaker Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence transcript
- Extends D1-C043 Day 1: RankBrain is used in serving to interpret the intent behind queries, especially new or unusual ones, and…
Google said MUM helps it understand the context of the words in a query: a search for hiking shoes that mentions Mount Everest rather than Kilimanjaro gets results suited to that climb.
Speaker Gary IllyesIn Day 1, 11:45 · How Search works and where's AI?Evidence transcript
- Extends D1-C044 Day 1: MUM (Multitask Unified Model) understands information across text, images, audio and video, and processes…
Google said a majority of its search features now use AI.
Speaker Cherry PrommawinIn Day 1, 11:45 · How Search works and where's AI?Evidence transcript
What Google's documentation says 3
Google's ranking systems guide lists BERT among its ranking systems, as an AI system that helps Google understand how combinations of words express different meanings and intent.
“an AI system Google uses that allows us to understand how combinations of words express different meanings and intent”
Publisher Google Search CentralAnnotates Day 1, 11:45 · How Search works and where's AI?
Google's May 2021 announcement of MUM says it is trained across 75 languages and understands information across text and images, and that it could expand to other modalities such as video and audio in the future.
“MUM is multimodal, so it understands information across text and images and, in the future, can expand to more modalities like video and audio.”
Publisher Google blog (18 May 2021)Annotates Day 1, 11:45 · How Search works and where's AI?
Google's ranking systems guide says MUM is not currently used for general ranking in Search, only for specific applications such as COVID-19 vaccine searches and featured snippet callouts.
“It's not currently used for general ranking in Search”
Publisher Google Search CentralAnnotates Day 1, 11:45 · How Search works and where's AI?
Used byglossary term BERT, RankBrain and MUM
- Extended by D3-C135 Day 3: The quality talk's slide listed MUM among Google's ranking systems, while Google's ranking systems guide says…
Analysis by the author 2
Visual search predates transformers in Google's own history: its Search timeline dates Google Images to 2001 and Google Lens to 2017, the year Google Research published the Transformer, so read the stage remark as being about today's multimodal AI search.
Author Ibrahim AnjroAnnotates Day 1, 11:35 · What's new in the world of Search
On stage MUM was placed three years after RankBrain, but Google dates RankBrain to 2015 and announced MUM in May 2021, more than five years later; date these systems by Google's own posts, not by the talk.
Author Ibrahim AnjroAnnotates Day 1, 11:45 · How Search works and where's AI?
Day 2: Indexing 13
Shown on screen 1
Structured data gives the high precision that complex schemas such as sale pricing need, with higher accuracy than large-scale extraction by large language models (LLMs).
“Structured data provides the high precision needed for complex schema (sale pricing), achieving higher accuracy than large-scale LLM extraction.”
Wording checked against the slide or recording
Speaker Ryan LeveringIn Day 2, 13:35 · What is Structured Data and why we need it on the internet.Evidence slide photo, transcript
Said on stage 11
Google detects soft 404s with a language model, described as something like BERT, that is trained to understand the structure and layout of a page as well as its language, instead of reading the page as one flat wall of text.
“This is basically an LLM thing, something like BERT, that is specifically trained to understand page structure”
Speaker Gary IllyesIn Day 2, 11:30 · Understanding what's on a pageEvidence transcript
- Extends D1-C042 Day 1: BERT is used in indexing to understand each word in the context of the whole sentence rather than one word at…
Google picks the canonical from a variety of criteria and uses some kind of machine learning to decide how much weight each criterion gets; the weighting changes from time to time.
“we use some kind of machine learning to understand how strong these criteria should be. And this changes from time to time.”
Speaker John MuellerIn Day 2, 11:55 · Handling web duplicationEvidence transcript
Automatic LLM extraction of structured information makes a great demo but is not yet good enough for extraction that aims at something like 99.9% accuracy, the speaker said.
Speaker Ryan LeveringIn Day 2, 13:35 · What is Structured Data and why we need it on the internet.Evidence transcript
Even Google cannot afford to run complex AI models on every page in its index, and distilling them into cheaper models makes them less precise.
Speaker Ryan LeveringIn Day 2, 13:35 · What is Structured Data and why we need it on the internet.Evidence transcript
The diffusion models that generate images were built to generate images, not text, so they are typically poor at rendering text inside an image.
Speaker Gary IllyesIn Day 2, 13:50 · Using images to your advantage and Engaging Search users with videosEvidence transcript
Used byrequirement DEV-IMG-08
- Extended by D3-C688 Day 3: Generative models, including image diffusion models, make things up when they lack information or because of…
Google uses more and more AI to detect spam, and Google's testing shows that this AI-based detection is highly accurate.
Speaker GoogleIn Day 2, 15:30 · Calculating (some) signalsEvidence transcript
- Extends D1-C041 Day 1: Statistical models have been used at Google for over 20 years, for catching spam and originally for the 'Did…
- Extended by D3-C205 Day 3: Google's quality talk said AI has fundamentally changed how Google builds spam updates, letting it evaluate…
- Extended by D3-C206 Day 3: Google's quality talk said AI lets Google catch new types of spam and catch more of it.
SpamBrain, Google's AI-based spam detection system, is nowadays built on Gemini and fine-tuned specifically for finding spam.
“built on top of, well, nowadays, Gemini, and fine-tuned to that specific purpose of finding spam”
Speaker GoogleIn Day 2, 15:30 · Calculating (some) signalsEvidence transcript
Used byglossary term SpamBrain
- Extends D1-C041 Day 1: Statistical models have been used at Google for over 20 years, for catching spam and originally for the 'Did…
- Extends D1-C039 Day 1: Gemini is not part of Search, but it uses crawlers for data, shares some technologies such as tokenization…
Index selection is a predictive AI system that relies heavily on machine learning.
Speaker GoogleIn Day 2, 15:40 · Deciding what goes in the index?Evidence transcript
- Extends D1-C037 Day 1: For classic Search, crawling means Googlebot, scheduling and robots.txt, with AI used in parts such as…
Besides posting lists, Google can retrieve documents through vector embeddings: parts of documents are associated with embeddings, which form a vector space used for retrieval.
“just like you build a posting list, you can also build a vector space”
Speaker GoogleIn Day 2, 16:15 · How does the index look like?Evidence transcript
Used byglossary term Vector embeddings
- Extended by D3-C077 Day 3: The first condition for retrieving a document is that the query's words, or its concepts in the case of…
- Extended by D3-C311 Day 3: Google handles an image used as a search query much like a text query interpreted as an embedding: the image…
In embedding-based retrieval, the distance between the embeddings of documents and the embedding of the user's query decides which documents are returned.
Speaker GoogleIn Day 2, 16:15 · How does the index look like?Evidence transcript
Used byglossary term Vector embeddings
- Extends D1-C129 Day 1: Google's guide says creating separate content for every variation of how people might search, including…
Google said a vector space also holds embeddings for associations the web makes with a page, such as what is known about its author; most of them sit far from typical queries, and a query that names the association may move closer to them.
Speaker GoogleIn Day 2, 16:15 · How does the index look like?Evidence transcript
What Google's documentation says 1
Google's guidance on generative AI content warns that AI output can contain hallucinations and says AI-generated metadata, including structured data and image alt text, should be fact-checked before publishing and the markup validated.
Publisher Google Search CentralAnnotates Day 2, 13:35 · What is Structured Data and why we need it on the internet.
Used byrequirement DEV-SDA-11
- Extends D1-C250 Day 1: In a community demo, a fix loop gave a large LLM (Claude Opus) the current markup, the errors Google's test…
- Extended by D2-C947 Day 2: In a community speaker's case, an LLM asked to write alt text for a product image of a veterinary anxiety…
- Extended by D2-C952 Day 2: A community speaker warned that articles still recommend rewriting alt text with AI, called AI a tool, and…
- Extended by D3-C686 Day 3: Hallucinations can happen with any AI model, and with current training methods there is no way to get rid of…
Day 3: Serving: Ranking, Search Console, and Performance 18
Shown on screen 3
Google's slide said there is not one single ranking system and named spam detection systems, the reviews system, BERT, MUM, RankBrain, freshness systems, deduplication systems, crisis information systems and link analysis systems (PageRank).
“There’s not one single ranking system...”
Wording checked against the slide or recording
Speaker GoogleIn Day 3, 11:15 · How Google thinks about QualityEvidence slide photo, transcript
The community workflow's third step feeds the exported Search Console dataset into the agency's LLM agent, which queries the dataset and returns the evidence rather than a sample.
Speaker Nik VujicIn Day 3, 14:20 · Lightning session L: Understanding SERPs and your usersEvidence slide photo, transcript
- Extends D1-C256 Day 1: An agency's automated monthly SEO report follows four simple steps: the data comes in, a script processes it…
Google's closing slide told site owners they should use AI, which can supercharge workflows, help with content creation and with website and customer management.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence slide photo, transcript
Said on stage 14
With AI, Google can finally look inside the shop and check how a page's content matches its storefront, a community speaker said.
Speaker Community speakersIn Day 3, 10:45 · Lightning session K: Facets of qualityEvidence transcript
Google's quality talk said AI has fundamentally changed how Google builds spam updates, letting it evaluate many more candidates and drastically increasing its velocity, so it launches faster with more impact.
Speaker GoogleIn Day 3, 11:15 · How Google thinks about QualityEvidence transcript
- Extends D2-C668 Day 2: Google uses more and more AI to detect spam, and Google's testing shows that this AI-based detection is…
Google's quality talk said AI lets Google catch new types of spam and catch more of it.
Speaker GoogleIn Day 3, 11:15 · How Google thinks about QualityEvidence transcript
- Extends D2-C668 Day 2: Google uses more and more AI to detect spam, and Google's testing shows that this AI-based detection is…
Google said there is so much going on in Search that AI topics were covered across the event only where contextually important, and its closing message was to use AI but understand how it works so as to use it responsibly.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Google described AI as an umbrella of many technologies working together, one of which is machine learning: systems that learn from large amounts of data to make informed decisions.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Gary Illyes said machine learning is about 50 years old and that Google has been using it for 'probably 30 years', starting with statistical models that made the 'Did you mean' feature possible.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
- Extends D1-C041 Day 1: Statistical models have been used at Google for over 20 years, for catching spam and originally for the 'Did…
- Repeats D1-C209 Day 1: Google launched the 'Did you mean' feature around 2001-2002 using a statistical model, which Gary Illyes…
Some of Google's search ranking features are plain machine learning models, because for some tasks simple machine learning models are more useful than large language models.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Google described large language models as deep learning on internet-scale data sets, trained so that the model has an internal vector space in which concepts are mapped by context.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Google distinguished predictive language models, whose primary job is to predict the next word or words in a text, from generative models that produce output from a prompt; next-word prediction is a guess, made with some accuracy, from the context given.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Predictive language models have been used a lot in Search, and BERT is one: technically, in the purest sense, an LLM.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Used byglossary term BERT, RankBrain and MUM
- Extends D1-C042 Day 1: BERT is used in indexing to understand each word in the context of the whole sentence rather than one word at…
Google said it thinks generative AI is extremely helpful to its users.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Hallucinations can happen with any AI model, and with current training methods there is no way to get rid of them.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Used byrequirement DEV-SPM-05glossary term Hallucination
- Extends D2-C462 Day 2: Google's guidance on generative AI content warns that AI output can contain hallucinations and says…
Adding grounding or retrieval-augmented generation (RAG) on top of a model reduces hallucinations but cannot eliminate them.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Used byglossary term Hallucination
Generative models, including image diffusion models, make things up when they lack information or because of issues in their training.
Speaker Gary IllyesIn Day 3, 16:00 · Wrapping all up: AI, Search, and making sense of everything.Evidence transcript
Used byglossary term Hallucination
- Extends D2-C939 Day 2: The diffusion models that generate images were built to generate images, not text, so they are typically poor…
Analysis by the author 1
The quality talk's slide listed MUM among Google's ranking systems, while Google's ranking systems guide says MUM is not currently used for general ranking in Search; read the slide as a list of systems Google runs, not as proof that each one ranks every query.
Author Ibrahim AnjroAnnotates Day 3, 11:15 · How Google thinks about Quality
- Extends D1-C130 Day 1: Google's ranking systems guide says MUM is not currently used for general ranking in Search, only for…