181 releases (95 stable)
1.4.35 | May 6, 2023 |
---|---|
1.4.32 | Mar 27, 2023 |
1.4.11 | Dec 25, 2022 |
1.4.4 | Nov 28, 2022 |
0.6.1 | Nov 4, 2021 |
#337 in Magic Beans
415 downloads per month
87KB
2K
SLoC
crypto-cli-tools
A collection of CLI tools to process cryptocurrency data.
Install: RUSTFLAGS="-C target-cpu=native" cargo install crypto-cli-tools
crypto-daily-merger
If you have deployed carbonbot to multiple geographical locations, then you need to use this CLI tool to merge and deduplicate data from multiple carbonbots.
Usage: crypto-daily-merger <yyyy-MM-dd> <input_dirs(comma separated)> <output_dir>
.
crypto-msg-parser
Parse raw strings from crypto-crawler
or re-parse messages generated by crypto-msg-parser
. Output messages are sorted by timestamp and deduplicated.
Usage: crypto-msg-parser <input_file> <output_file> [yyyy-MM]
.
If month is specified, only messages of the month will be kept.
csv-to-proto
This CLI tool converts .csv.xz
files to .proto.xz
files.
The CSV messages are generated by to_csv_string()
functions in crypto-message/src/lib.rs.
crypto-daily-processor(DEPRECATED)
Usage: crypto-daily-processor <exchange> <msg_type> <market_type> <day> <input_dir> <output_dir_raw> <output_dir_parsed>
For example:
crypto-daily-processor bitstamp trade spot 2021-09-02 /mnt/dpool/download /mnt/dpool/daily-raw /mnt/dpool/daily-parsed
This CLI tool is replaced by crypto-daily-merger
+ crypto-msg-parser
.
Dependencies
~14–28MB
~460K SLoC