1 unstable release

0.1.0 Nov 13, 2023

#36 in #data-pipeline

MIT license

7KB
62 lines

ArrowPipe: Build complex pipelines easily

An Arrow is a function composition system that can be used to create complex data processing pipelines.

Installation

Add the following to your Cargo.toml:

[dependencies]
arrowpipe = { git = "https://github.com/Brian3647/arrowpipe" }

Example

use arrowpipe::Arrow;

fn add_one(x: i32) -> i32 {
   x + 1
}

fn double(x: i32) -> i32 {
  x * 2
}

let mut arrow = Arrow::new(add_one);
arrow.symbiotize(Arrow::new(double));
arrow.symbiotize(Arrow::new(|x| x - 1));

assert_eq!(arrow.shoot(1), 3);

Order of execution example:

use arrowpipe::Arrow;

fn add_one(x: i32) -> i32 {
   x + 1
}

let mut first = Arrow::new(add_one); // Second: 2 -> 3
first.symbiotize(Arrow::new(|x| x * 2)); // Third: 3 -> 6

let mut second = Arrow::new(add_one); // First: 1 -> 2
second.symbiotize(first);

assert_eq!(second.shoot(1), 6);

Why?

This is specially useful for long pipelines like a build system. With the Arrow struct, you can simply add another Arrow to an existing one to have a new step.

License

This project is licensed under the MIT license (LICENSE or http://opensource.org/licenses/MIT).

No runtime deps