pyspark.sql.streaming.StreamingQueryManager

class pyspark.sql.streaming.StreamingQueryManager(jsqm)[source]

A class to manage all the StreamingQuery StreamingQueries active.

New in version 2.0.0.

Notes

This API is evolving.

Methods

awaitAnyTermination([timeout])

Wait until any of the queries on the associated SQLContext has terminated since the creation of the context, or since resetTerminated() was called.

get(id)

Returns an active query from this SQLContext or throws exception if an active query with this name doesn’t exist.

resetTerminated()

Forget about past terminated queries so that awaitAnyTermination() can be used again to wait for new terminations.

Attributes

active

Returns a list of active queries associated with this SQLContext
pyspark.sql.streaming.StreamingQueryException pyspark.sql.streaming.DataStreamReader.csv