nhagar/CC-MAIN-2014-42_urls

这是一个包含网页爬取信息的数据集，具体包括网页内容（crawl）、网址的主机名（url_host_name）以及该主机名的网址数量（url_count）。数据集提供了一个训练集，共有30886300个样本。This dataset includes web crawling information, specifically the web page content (crawl), the hostname of the URL (url_host_name), and the count of URLs for that hostname (url_count). The dataset provides a training set with a total of 30886300 samples.