Skip to content

Writer

dataphy.io.writer

Functions

write_batches(batches: Iterator[Dict[str, Any]], pipe: Callable, output: str, limit: int = 0)

Source code in src/dataphy/io/writer.py 
 4
 5
 6
 7
 8
 9
10
11
def write_batches(batches: Iterator[Dict[str, Any]], pipe: Callable, output: str, limit: int = 0):
    # placeholder sink; extend with Dataphy format
    i = 0
    for b in batches:
        _ = pipe(b)
        i += 1
        if limit and i >= limit:
            break