Nota: A tradução desta entrada está atualmente em revisão de qualidade, portanto parte do conteúdo é exibida temporariamente apenas em inglês.
Este verbete ainda não foi traduzido para o seu idioma, portanto o original é exibido abaixo.
crawler
In a technical context, this term refers to the automated software agents that power search engines. It carries a connotation of systematic, tireless exploration, often contrasted with manual browsing. Users should distinguish this from a "scraper," which focuses on extracting specific data rather than indexing a whole site.
In mechanical and biological contexts, the word emphasizes a specific mode of locomotion—slow, steady, and grounded. When applied to machinery, it specifically denotes the use of continuous tracks (crawlers) to navigate unstable terrain where wheels would sink or slip.
Meanings
A program or automated script that systematically browses the World Wide Web to index content for a search engine.
An organism or animal that moves by crawling, typically one that stays close to the ground or surface.
Examples
The search engine crawler is indexing the new pages of the site.
We need to update the robots.txt file to block the crawler from accessing private directories.
The construction crew used a crawler crane to lift the heavy beams into place.
A massive crawler moved slowly across the muddy terrain of the worksite.
He is a fast crawler and usually wins the fifty meter freestyle.
I wonder if I can beat that crawler in the next heat.