LANDER:rdns ipv4-20160312 From Predict README version: 5271, last modified: 2016-03-24. This file describes the trace dataset "rdns_ipv4-20160312" provided by the LANDER project. This dataset contains reverse DNS hostnames for all public, unicast IPv4 addresses allocated by IANA on the day of generation. Contents • 1 LANDER Metadata • 2 Dataset Contents • 3 Collection Method • 4 Citation • 5 Results Using This Dataset • 6 User Annotations LANDER Metadata ┌───────────────────────────┬────────────────────────────────────────────────────────────────────────────────────┐ │ dataSetName │ rdns_ipv4-20160312 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ status │ usc-web-and-predict │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ shortDesc │ Reverse DNS IPv4 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ longDesc │ Reverse-DNS mapping information for all of the allocated IPv4 address space. │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ datasetClass │ Quasi-Restricted │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ commercialAllowed │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ requestReviewRequired │ true │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ productReviewRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ ongoingMeasurement │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ submissionMethod │ Upload │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartDate │ 2016-03-12 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionStartTime │ 22:07:53 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndDate │ 2016-03-20 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ collectionEndTime │ 08:43:16 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartDate │ 2017-01-18 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityStartTime │ 23:50:23 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndDate │ 2030-01-01 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ availabilityEndTime │ 00:00:00 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ anonymization │ none │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ archivingAllowed │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ keywords │ category:dns-data, subcategory:public-dns-data, DNS │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ format │ text │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ access │ https │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ hostName │ USC-LANDER │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ providerName │ USC │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingId │ │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ groupingSummaryFlag │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ retrievalInstructions │ download │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ byteSize │ 54866739200 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ expirationDays │ 14 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ uncompressedSize │ 465048971749 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ impactDoi │ 10.23721/109/1354187 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ useAgreement │ dua-ni-160816 │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ irbRequired │ false │ ├───────────────────────────┼────────────────────────────────────────────────────────────────────────────────────┤ │ privateAccessInstructions │ See https://ant.isi.edu/datasets/#getting-datasets for information on obtaining │ │ │ this dataset. │ │ │ See │ └───────────────────────────┴────────────────────────────────────────────────────────────────────────────────────┘ Dataset Contents This dataset contains reverse-DNS mapping information for all of the allocated IPv4 address space. It's been collected by crawling the reverse DNS space. All of this information is derived from public sources. This datasets consists 14 primary files, each containing the reverse DNS names for IP addresses that start with a given common first four bits: rdns.0.fsdb.bz2 rdns.1.fsdb.bz2 rdns.2.fsdb.bz2 rdns.3.fsdb.bz2 rdns.4.fsdb.bz2 rdns.5.fsdb.bz2 rdns.6.fsdb.bz2 rdns.7.fsdb.bz2 rdns.8.fsdb.bz2 rdns.9.fsdb.bz2 rdns.a.fsdb.bz2 rdns.b.fsdb.bz2 rdns.c.fsdb.bz2 rdns.d.fsdb.bz2 For example, the file rdns.0.fsdb.bz2 contains rnds mappings for ip addresses with first octet ranging from 0 to 15, rdns.1.fsdb.bz2 has mappings for ips with first octet from 16 to 31, and so on. Each file is in Fsdb format, a tab-separated text format with # comments. The schema is: #fsdb -F t block hexip ip answer authority rrsig timestamp duration source error 010000 01000002 1.0.0.2 - - - 1457944460.15 3.00128412247 hcpu051.ant.isi.edu Timeout 010000 01000003 1.0.0.3 - 1.in-addr.arpa. 10800 IN SOA ns1.apnic.net. read-txt-record-of-zone-first-dns-admin.apnic.net. 9929 7200 1800 604800 172800 - 1458119475.58 0.709289073944 hcpu050.ant.isi.edu NXDOMAIN 010000 01000004 1.0.0.4 - 1.in-addr.arpa. 10800 IN SOA ns1.apnic.net. read-txt-record-of-zone-first-dns-admin.apnic.net. 9925 7200 1800 604800 172800 - 1457832625.59 2.22602415085 hcpu045.ant.isi.edu NXDOMAIN • block: first 3 octets of the ip address in hex with leading zeroes. • hexip: is hexdecimal version of the probed IP. • ip: is the full IPv4 address in format. • answer: is the reverse-DNS name for the IP address, or - if none was returned. • authority: is the SOA record in the authority section, if there is no answer. (If there is an answer, it is -) • rrsig: The RRSIG of the IP encoded with Base64. (This is not available in this particular dataset) • timestamp: When the IP was last probed in Unix epoch time format. (This is not available in this particular dataset). • duration: How long the query took (This is not available in this particular dataset). • source: The ID of who is running the probe • error: Error code (if any) Each file is sorted by hexip. The file ".sha1sum" contains SHA1 checksums of individual compressed files. The integrity of the distribution thus can be checked by independently calculating SHA1 sums of files and comparing them with those listed in the file. If you have the sha1sum utility installed on your system, you can do that by executing: sha1sum --check .sha1sum Collection Method The data was collected with probing using software developed by ISI researchers. Citation If you use this trace to conduct additional research, please cite it as: PREDICT ID: USC-LANDER/rdns_ipv4-20160312/rev5271. Traces generated on 2016-03-12. Provided by the USC/LANDER project (http://www.isi.edu/ant/lander). Results Using This Dataset We have used this dataset for some internal work, but publications are not yet released as of 2015-11-08. User Annotations Currently no annotations. Categories: • Datasets • LANDER • LANDER:Datasets • LANDER:Datasets:AddressSpace:Adaptive Probing • LANDER:Datasets:AddressSpace • LANDER:Datasets:DNS:RDNS