Base Stream#

fetchez.streams.base#

Base fetchez Reader class to create ‘streams’

copyright:

  1. 2016 - 2026 Regents of the University of Colorado

license:

MIT, see LICENSE for more details.

class fetchez.streams.base.QueueSinkHook(q)[source]#

Bases: FetchHook

An internal hook that yields stream chunks to a Queue.

name = 'queue_sink'#
meta_stage = 'stream'#
__init__(q)[source]#
run(entries)[source]#

Execute the hook.

Parameters:

entries – A list of (module, entry) tuples representing the active pipeline.

Returns:

Modified entries list.

class fetchez.streams.base.BaseStream(modules, region=None, ignore_failures=False)[source]#

Bases: object

__init__(modules, region=None, ignore_failures=False)[source]#
pipe(hook_or_string, **kwargs)[source]#

Chain a processing hook onto the pipeline.