Skip to content

Attributes

spark_expectations.sinks.plugins.base_writer.SPARK_EXPECTATIONS_WRITER_PLUGIN = 'spark_expectations_writer_plugins' module-attribute

spark_expectations.sinks.plugins.base_writer.spark_expectations_writer_impl = pluggy.HookimplMarker(SPARK_EXPECTATIONS_WRITER_PLUGIN) module-attribute

spark_expectations.sinks.plugins.base_writer.writer_plugin_spec = pluggy.HookspecMarker(SPARK_EXPECTATIONS_WRITER_PLUGIN) module-attribute

Classes

spark_expectations.sinks.plugins.base_writer.SparkExpectationsSinkWriter

Functions

writer(_write_args: Dict[Union[str], Union[str, bool, Dict[str, str], DataFrame]]) -> None

function consist signature to write data into delta/nsp, which will be implemented in the child class

Parameters:

Name Type Description Default
_write_args Dict[Union[str], Union[str, bool, Dict[str, str], DataFrame]]
required
Source code in spark_expectations/sinks/plugins/base_writer.py 
12
13
14
15
16
17
18
19
20
21
22
23
24
25
@writer_plugin_spec
def writer(
    self, _write_args: Dict[Union[str], Union[str, bool, Dict[str, str], DataFrame]]
) -> None:
    """
    function consist signature to write data into delta/nsp, which will be implemented in the child class
    Args:
        _write_args:

    Returns:

    """

    pass