2 releases
new 0.1.1 | Oct 31, 2024 |
---|---|
0.1.0 | Oct 30, 2024 |
#27 in #transformation
248 downloads per month
5KB
58 lines
pipecrafter
PipeCrafter is a flexible, chainable data transformation pipeline library for Rust, designed to make data ingestion, transformation, and output easier for Rust projects.
Features
- Data Ingestion: Easily ingest data from various sources (e.g., CSV, JSON).
- Flexible Transformations: Chain transformations like map, filter, and custom functions.
- Output Options: Output data to files, stdout, or custom sinks.
Example Usage
use pipecrafter::{CsvSource, Pipeline, UppercaseTransform, print_output};
fn main() {
let source = Box::new(CsvSource);
let pipeline = Pipeline::new(source).add_transformation(Box::new(UppercaseTransform));
let result = pipeline.execute().expect("Pipeline execution failed");
print_output(result);
}
Getting Started
Add pipecrafter to your Cargo.toml dependencies
Import the necessary components and build your data pipeline!
License
MIT License
Author
Ben Santora (bensatlantik@gmail.com)
Dependencies
~1.5–2.3MB
~34K SLoC