URLtiedoista

URLtiedoista is a term used in digital libraries, data governance and web analytics to refer to datasets that describe URLs and their associated metadata. The concept covers information about how URLs are structured, retrieved, and interpreted on the web, including both the address itself and the results of attempting to access it.

A URLtiedoista dataset typically includes fields such as the original URL, the final URL after redirects, HTTP status code, content type, content length, fetch timestamp, and the number of redirects. Additional metadata may include last-modified times, etag values, language, page title, description, canonical URL, and indicators of accessibility rules (such as robots.txt status). Some datasets also capture performance metrics like response time and the fingerprint of the resource for deduplication.

Applications of URLtiedoista data include web crawling and indexing, search-engine optimization, link integrity checks, web archiving, and studies of web evolution. They support tasks such as tracing redirects, validating links, assessing content changes over time, and providing structured inputs for preservation workflows or analytics pipelines.

Formats and standards commonly used for URLtiedoista data are JSON, CSV, or RDF-based representations, often produced by crawlers, log exports, or sitemap analyses. Schemas from Dublin Core, schema.org metadata, or other metadata frameworks may be employed to describe the fields, enabling interoperability across tools and repositories while respecting privacy and governance considerations.

See also: URL, HTTP, Metadata, Web crawler.