Expand description
Traits for writing parallel programs using an iterator-style interface
You will rarely need to interact with this module directly unless you have need to name one of the iterator types.
Parallel iterators make it easy to write iterator-like chains that
execute in parallel: typically all you have to do is convert the
first .iter()
(or iter_mut()
, into_iter()
, etc) method into
par_iter()
(or par_iter_mut()
, into_par_iter()
, etc). For
example, to compute the sum of the squares of a sequence of
integers, one might write:
use rayon::prelude::*;
fn sum_of_squares(input: &[i32]) -> i32 {
input.par_iter()
.map(|i| i * i)
.sum()
}
Or, to increment all the integers in a slice, you could write:
use rayon::prelude::*;
fn increment_all(input: &mut [i32]) {
input.par_iter_mut()
.for_each(|p| *p += 1);
}
To use parallel iterators, first import the traits by adding
something like use rayon::prelude::*
to your module. You can
then call par_iter
, par_iter_mut
, or into_par_iter
to get a
parallel iterator. Like a regular iterator, parallel
iterators work by first constructing a computation and then
executing it.
In addition to par_iter()
and friends, some types offer other
ways to create (or consume) parallel iterators:
- Slices (
&[T]
,&mut [T]
) offer methods likepar_split
andpar_windows
, as well as various parallel sorting operations. See theParallelSlice
trait for the full list. - Strings (
&str
) offer methods likepar_split
andpar_lines
. See theParallelString
trait for the full list. - Various collections offer
par_extend
, which grows a collection given a parallel iterator. (If you don’t have a collection to extend, you can usecollect()
to create a new one from scratch.)
To see the full range of methods available on parallel iterators,
check out the ParallelIterator
and IndexedParallelIterator
traits.
If you’d like to build a custom parallel iterator, or to write your own combinator, then check out the split function and the plumbing module.
Note: Several of the ParallelIterator
methods rely on a Try
trait which
has been deliberately obscured from the public API. This trait is intended
to mirror the unstable std::ops::Try
with implementations for Option
and
Result
, where Some
/Ok
values will let those iterators continue, but
None
/Err
values will exit early.
A note about object safety: It is currently not possible to wrap
a ParallelIterator
(or any trait that depends on it) using a
Box<dyn ParallelIterator>
or other kind of dynamic allocation,
because ParallelIterator
is not object-safe.
(This keeps the implementation simpler and allows extra optimizations.)
Modules
- Traits and functions used to implement parallel iteration. These are low-level details – users of parallel iterators should not need to interact with them directly. See the
plumbing
README for a general overview.
Structs
Chain
is an iterator that joinsb
aftera
in one continuous iterator. This struct is created by thechain()
method onParallelIterator
Chunks
is an iterator that groups elements of an underlying iterator.Cloned
is an iterator that clones the elements of an underlying iterator.Copied
is an iterator that copies the elements of an underlying iterator.- Iterator adaptor for the
empty()
function. Enumerate
is an iterator that returns the current count along with the element. This struct is created by theenumerate()
method onIndexedParallelIterator
ExponentialBlocks
is a parallel iterator that consumes itself as a sequence of parallel blocks of increasing sizes (exponentially).Filter
takes a predicatefilter_op
and filters out elements that match. This struct is created by thefilter()
method onParallelIterator
FilterMap
creates an iterator that usesfilter_op
to both filter and map elements. This struct is created by thefilter_map()
method onParallelIterator
.FlatMap
maps each element to a parallel iterator, then flattens these iterators together. This struct is created by theflat_map()
method onParallelIterator
FlatMapIter
maps each element to a serial iterator, then flattens these iterators together. This struct is created by theflat_map_iter()
method onParallelIterator
Flatten
turns each element to a parallel iterator, then flattens these iterators together. This struct is created by theflatten()
method onParallelIterator
.FlattenIter
turns each element to a serial iterator, then flattens these iterators together. This struct is created by theflatten_iter()
method onParallelIterator
.Fold
is an iterator that applies a function over an iterator producing a single value. This struct is created by thefold()
method onParallelIterator
FoldChunks
is an iterator that groups elements of an underlying iterator and applies a function over them, producing a single value for each group.FoldChunksWith
is an iterator that groups elements of an underlying iterator and applies a function over them, producing a single value for each group.FoldWith
is an iterator that applies a function over an iterator producing a single value. This struct is created by thefold_with()
method onParallelIterator
Inspect
is an iterator that calls a function with a reference to each element before yielding it.Interleave
is an iterator that interleaves elements of iteratorsi
andj
in one continuous iterator. This struct is created by theinterleave()
method onIndexedParallelIterator
InterleaveShortest
is an iterator that works similarly toInterleave
, but this version stops returning elements once one of the iterators run out.Intersperse
is an iterator that inserts a particular item between each item of the adapted iterator. This struct is created by theintersperse()
method onParallelIterator
IterBridge
is a parallel iterator that wraps a sequential iterator.Map
is an iterator that transforms the elements of an underlying iterator.MapInit
is an iterator that transforms the elements of an underlying iterator.MapWith
is an iterator that transforms the elements of an underlying iterator.MaxLen
is an iterator that imposes a maximum length on iterator splits. This struct is created by thewith_max_len()
method onIndexedParallelIterator
MinLen
is an iterator that imposes a minimum length on iterator splits. This struct is created by thewith_min_len()
method onIndexedParallelIterator
MultiZip
is an iterator that zips up a tuple of parallel iterators to produce tuples of their items.- Iterator adaptor for the
once()
function. PanicFuse
is an adaptor that wraps an iterator with a fuse in case of panics, to halt all threads as soon as possible.Positions
takes a predicatepredicate
and filters out elements that match, yielding their indices.- Iterator adaptor for the
repeat()
function. - Iterator adaptor for the
repeatn()
function. Rev
is an iterator that produces elements in reverse order. This struct is created by therev()
method onIndexedParallelIterator
Skip
is an iterator that skips over the firstn
elements. This struct is created by theskip()
method onIndexedParallelIterator
SkipAny
is an iterator that skips overn
elements from anywhere inI
. This struct is created by theskip_any()
method onParallelIterator
SkipAnyWhile
is an iterator that skips over elements from anywhere inI
until the callback returnsfalse
. This struct is created by theskip_any_while()
method onParallelIterator
Split
is a parallel iterator using arbitrary data and a splitting function. This struct is created by thesplit()
function.StepBy
is an iterator that skipsn
elements between each yield, wheren
is the given step. This struct is created by thestep_by()
method onIndexedParallelIterator
Take
is an iterator that iterates over the firstn
elements. This struct is created by thetake()
method onIndexedParallelIterator
TakeAny
is an iterator that iterates overn
elements from anywhere inI
. This struct is created by thetake_any()
method onParallelIterator
TakeAnyWhile
is an iterator that iterates over elements from anywhere inI
until the callback returnsfalse
. This struct is created by thetake_any_while()
method onParallelIterator
TryFold
is an iterator that applies a function over an iterator producing a single value. This struct is created by thetry_fold()
method onParallelIterator
TryFoldWith
is an iterator that applies a function over an iterator producing a single value. This struct is created by thetry_fold_with()
method onParallelIterator
UniformBlocks
is a parallel iterator that consumes itself as a sequence of parallel blocks of constant sizes.Update
is an iterator that mutates the elements of an underlying iterator before they are yielded.- ParallelIterator for arbitrary tree-shaped patterns. Returned by the
walk_tree()
function. - ParallelIterator for arbitrary tree-shaped patterns. Returned by the
walk_tree_postfix()
function. - ParallelIterator for arbitrary tree-shaped patterns. Returned by the
walk_tree_prefix()
function. WhileSome
is an iterator that yields theSome
elements of an iterator, halting as soon as anyNone
is produced.Zip
is an iterator that zips upa
andb
into a single iterator of pairs. This struct is created by thezip()
method onIndexedParallelIterator
- An
IndexedParallelIterator
that iterates over two parallel iterators of equal length simultaneously.
Enums
- The enum
Either
with variantsLeft
andRight
is a general purpose sum type with two cases.
Traits
FromParallelIterator
implements the creation of a collection from aParallelIterator
. By implementingFromParallelIterator
for a given type, you define how it will be created from an iterator.- An iterator that supports “random access” to its data, meaning that you can split it at arbitrary indices and draw data from those points.
IntoParallelIterator
implements the conversion to aParallelIterator
.IntoParallelRefIterator
implements the conversion to aParallelIterator
, providing shared references to the data.IntoParallelRefMutIterator
implements the conversion to aParallelIterator
, providing mutable references to the data.- Conversion trait to convert an
Iterator
to aParallelIterator
. ParallelDrainFull
creates a parallel iterator that moves all items from a collection while retaining the original capacity.ParallelDrainRange
creates a parallel iterator that moves a range of items from a collection while retaining the original capacity.ParallelExtend
extends an existing collection with items from aParallelIterator
.- Parallel version of the standard iterator trait.
Functions
- Creates a parallel iterator that produces nothing.
- Creates a parallel iterator that produces an element exactly once.
- Creates a parallel iterator that endlessly repeats
elt
(by cloning it). Note that this iterator has “infinite” length, so typically you would want to usezip
ortake
or some other means to shorten it, or consider using therepeatn()
function instead. - Creates a parallel iterator that produces
n
repeats ofelt
(by cloning it). - The
split
function takes arbitrary data and a closure that knows how to split it, and turns this into aParallelIterator
. - Create a tree like parallel iterator from an initial root node. The
children_of
function should take a node and iterate on all of its child nodes. The best parallelization is obtained when the tree is balanced but we should also be able to handle harder cases. - Create a tree like postfix parallel iterator from an initial root node. The
children_of
function should take a node and iterate on all of its child nodes. The best parallelization is obtained when the tree is balanced but we should also be able to handle harder cases. - Create a tree-like prefix parallel iterator from an initial root node. The
children_of
function should take a node and return an iterator over its child nodes. The best parallelization is obtained when the tree is balanced but we should also be able to handle harder cases.