DirectoryConnector

class DirectoryConnector(DataConnector)

__init__

def __init__(input_files: List[str] = None,
             input_directory: str = None,
             recursive: bool = False,
             extensions: List[str] = None)

Connector for reading text data from a directory of files.

Arguments:

  • input_files List[str], optional - List of file paths to read. Defaults to None.
  • input_directory str, optional - Directory to read files from. Defaults to None.
  • recursive bool, optional - Whether to read files recursively from the input directory. Defaults to False.
  • extensions List[str], optional - List of file extensions to read. Defaults to None.