FreeBSD Manual Pages
axa_tsindextool(8) BSD System Manager's Manual axa_tsindextool(8) NAME axa_tsindextool -- Extract nmsgs from a previously created nmsg file / timestamp index (tsindex) file pair SYNOPSIS axa_tsindextool [-c count] [-e timestamp] [-f file] [-h] [-j file] [-r file] [-s timestamp] [-v] [-x] DESCRIPTION axa_tsindextool looks for a given epoch timestamp/file offset in the tsindex file foo.mdb, and extracts from the corresponding nmsg file foo.nmsg either a specified number of nmsgs (via -c) or until it hits an ending timestamp (via -e) or the end of file is reached. It writes ex- tracted nmsgs to a new file foo-tsindex.pid.nmsg (which will be the same format as the input nmsg file -- json or binary). axa_tsindextool sup- ports either binary nmsg input files (via -r) or json nmsg input files (via -j). Only one input file specifier may be used ( -r) or ( -j) and only one ending specifier may be used -c) or ( -e). If the -x option is specified, axa_tsindextool will look for an exact match for the starting timestamp and exit on error if it cannot find it. Without this option, axa_tsindextool will still prefer an exact match, but if unavailable, it will return the offset of the next larger timestamp (if available). To generate a tsindex file, sratunnel or radtunnel must be run using the -i option. OPTIONS -c count extract count nmsgs from the input file (or EOF). -e timestamp extract nmsgs until an nmsg with timestamp is found (or EOF). -f file specify the tsindex file. This file is created by either sratunnel or radtunnel with the -i option. -h display options summary. -j file specify a json nmsg input file. This file should have been generated at the same time as the tsindex file specified via -f. -r file specify a binary nmsg input file. This file should have been gener- ated at the same time as the tsindex file specified via -f. -s timestamp specify the starting timestamp. This value should be an epoch time- stamp value of the first nmsg you wish to extract, i.e. "1537989435". Nmsg nanosecond resolution timestamps not yet sup- ported. -v increment verbosity. Specify more v's to be more verbose. -x specify exact match mode. In this mode, the timestamp specified via -s must have an exact match in the tsindex file or an error is re- turned. If this mode is not specified, axa_tsindextool will return the offset of the next larger timestamp if available. EXAMPLES The following uses sratunnel to create a tsindex file and a json nmsg file, then nmsgtool and jq to extract the first 10 unique epoch time- stamps, then axa_tsindextool to extract two nmsgs from the middle of the file: $ sratunnel -s sra-server -c204 -wch=204 -onmsg:file_json:foo.json -i1 -u -C 1000000 $ nmsgtool -j foo.json -J - | jq .time | cut -f1 -d. | tr -d "\"" | date -f - +%s | sort -u | head 1537983067 1537983068 1537983069 1537983070 1537983071 1537983072 1537983073 1537983074 1537983075 1537983076 $ axa_tsindextool -s 1537983070 -f foo.json.mdb -j foo.json -c 2 -vv Found 1537983070 at offset 0x12b0e9c. {"time":"2018-09-26 17:31:10.000212788","vname":"SIE","mname":"dnsdedupe","message":{"type":"EXPIRATION","count":1,"time_first":"2018-09-26 09:39:23","time_last":"2018-09-26 09:39:23","bailiwick":"125.178.in-addr.arpa.","rrname":"166.140.125.178.in-addr.arpa.","rrclass":"IN","rrtype":"PTR","rrttl":21600,"rdata":["mm-166-140-125-178.mfilial.dynamic.pppoe.byfly.by."]}} {"time":"2018-09-26 17:31:10.000216899","vname":"SIE","mname":"dnsdedupe","message":{"type":"EXPIRATION","count":1,"time_first":"2018-09-26 09:39:57","time_last":"2018-09-26 09:39:57","bailiwick":"eu.","rrname":"82sfi0pl3mga2vclecbglu2iahd0ku5i.eu.","rrclass":"IN","rrtype":"RRSIG","rrttl":600,"rdata":["NSEC3 8 2 600 1538478902 1537870502 59289 eu. C1ZcCcIzXNioLqW1MLYtyNzd2rPrms4RBFND+9XwBZryIpPos3QH2YKG v0VsVPs8Loug7dhhggvj9GwSIDf52BR1AARaV74Me4CuA/pp+ZEyucqe 2Scg2Bf9k3sAhd+nth2D+y2TUI72wNyI/Z1+22DyEjifpbBZa+VShkjd w/0="]}} Wrote 2 nmsgs to foo.json-tsindex.28529.json. SEE ALSO radtunnel(1), sratunnel(1), nmsgtool(1), and lmdb(3). November 05, 2021
NAME | SYNOPSIS | DESCRIPTION | EXAMPLES | SEE ALSO
Want to link to this manual page? Use this URL:
<https://www.freebsd.org/cgi/man.cgi?query=axa_tsindextool&sektion=8&manpath=FreeBSD+13.0-RELEASE+and+Ports>