Json File Argument Parser

Json File Argument Parser#

Introduction#

A json file parser for lightning CLI, used by wandb sweep.

Usage#

Use --json-file flag of lightning CLI to load a json config file with this parser, typically used by wandb sweep. For more details, see wandb sweep doc and next section.

There are two points you may want to know:

  • In the parameters section of the sweep config file, use \ to split nested config parameters.

  • You may want to manually set export CUDA_VISIBLE_DEVICES=<device_ids> before run wandb sweep agents.

A typically wandb sweep config file#

method: bayes
metric:
    goal: minimize
    name: train/loss
parameters:
    optimizer_config/optimizer/init_args/lr:
        distribution: uniform
        max: 0.0002
        min: 5e-05
    optimizer_config/optimizer/init_args/weight_decay:
        distribution: uniform
        max: 0.0002
        min: 5e-05
program: cli
command:
    - ${env}
    - "cli"
    - "fit"
    - "--config"
    - "configs/runs/faster-rcnn/faster-rcnn_r50_fpn_8xb3-2x_coco.yaml"
    - "--json-file"
    - ${args_json_file}
Contents