Skip to content

Latest commit

 

History

History
14 lines (8 loc) · 539 Bytes

config-template.md

File metadata and controls

14 lines (8 loc) · 539 Bytes

Spark Configuration

The exact explanation and defaults for spark config can be found here, None means to use the spark native defaults

Config PySpark Session via environment variables

Generated by generate-config-docs.py Run python ./generate_config_docs.py to update this file

{docs}

TIPS

S3 secrets tokens(and others) need only be configured on the Driver or Connect Server, Configuration in Connect client take no effort.