Connectors
DirectoryConnector
DirectoryConnector
class DirectoryConnector(DataConnector)
__init__
def __init__(input_files: List[str] = None,
input_directory: str = None,
recursive: bool = False,
extensions: List[str] = None)
Connector for reading text data from a directory of files.
Arguments:
input_files
List[str], optional - List of file paths to read. Defaults to None.input_directory
str, optional - Directory to read files from. Defaults to None.recursive
bool, optional - Whether to read files recursively from the input directory. Defaults to False.extensions
List[str], optional - List of file extensions to read. Defaults to None.