Metastore

Create Spark DataFrame from table in Metastore

koheesio.spark.readers.metastore.MetastoreReader

Reader for tables/views from Spark Metastore

Parameters:

Name	Type	Description	Default
table	str	Table name in spark metastore	required

table class-attribute instance-attribute

table: str = Field(
    default=..., description="Table name in spark metastore"
)

execute

execute() -> Output

Source code in src/koheesio/spark/readers/metastore.py

def execute(self) -> Reader.Output:
    self.output.df = self.spark.table(self.table)