Init
This commit is contained in:
@@ -0,0 +1,67 @@
|
||||
# Training Configuration Guide
|
||||
|
||||
This document explains the key configuration parameters that can be modified for Wall-X training.
|
||||
|
||||
## Quick Start Checklist
|
||||
1. **Update run.sh**: Set `code_dir` and `config_path` to your actual paths
|
||||
2. **Configure GPUs**: Set `CUDA_VISIBLE_DEVICES` for your available GPUs
|
||||
3. **Update config paths**: Replace all `/path/to/` placeholders in config.yml with actual paths
|
||||
4. **Configure robot**: Set `dof_config` and `agent_pos_config` for your robot
|
||||
5. **Set dataset**: Choose appropriate `repo_id` for your dataset
|
||||
6. **Adjust batch size**: Set `batch_size_per_gpu` based on GPU memory
|
||||
7. **Run training**: Execute `bash ./workspace/lerobot_example/run.sh`
|
||||
|
||||
## Required Paths (Must Modify)
|
||||
```yaml
|
||||
processor_path: "/path/to/model/" # Path to model processor
|
||||
pretrained_qwen_vl_path: "/path/to/qwen_vl_model/" # Path to pretrained Qwen VL model
|
||||
qwen_vl_act_config_path: "/path/to/config.json" # Path to model config file
|
||||
action_tokenizer_path: "/path/to/fast/" # Path to action tokenizer
|
||||
save_path: "/path/to/workspace/" # Path to save training outputs
|
||||
```
|
||||
|
||||
## Training Parameters (Commonly Modified)
|
||||
|
||||
### Learning Rate Settings
|
||||
- `learning_rate`: Initial learning rate (default: 0.00009)
|
||||
- `min_lr`: Minimum learning rate for scheduler (default: 0.00005)
|
||||
- `num_warmup_steps`: Number of warmup steps (default: 100)
|
||||
|
||||
### Batch Size and Memory
|
||||
- `batch_size_per_gpu`: Batch size per GPU - adjust based on GPU memory
|
||||
- `gradient_accumulation_steps`: Gradient accumulation steps
|
||||
- `num_training_steps`: Total training steps
|
||||
- `num_epoch`: Number of training epochs
|
||||
|
||||
## Robot Configuration (Modify for Your Robot)
|
||||
|
||||
### DOF Configuration
|
||||
Modify `dof_config` to match your robot's action space:
|
||||
- Add/remove action keys based on your robot's capabilities
|
||||
- Ensure DOF numbers match your robot's action dimensions
|
||||
|
||||
### Agent Position Configuration
|
||||
Keep `agent_pos_config` consistent with `dof_config`.
|
||||
|
||||
### Action Keys
|
||||
- `obs_action_keys`: Actions used as observation context
|
||||
- `predict_action_keys`: Actions to predict/control
|
||||
|
||||
## Data Configuration
|
||||
|
||||
### Dataset
|
||||
- `repo_id`: LeRobot dataset identifier
|
||||
- `train_test_split`: Training/validation split ratio (default: 0.95)
|
||||
- `action_horizon`: Number of future actions to predict (default: 32)
|
||||
|
||||
### Image Settings
|
||||
- `resolution`: Image resolution for different camera views
|
||||
- `download_videos`: Whether to download video files (true/false)
|
||||
|
||||
## Resume Training (Optional)
|
||||
- `resume.ckpt`: Path to checkpoint for resuming training
|
||||
- `resume.load_ckpt_only`: Only load model weights, not optimizer state
|
||||
|
||||
## Performance Settings (Optional)
|
||||
- `profile`: Enable PyTorch profiling (true/false)
|
||||
- `padding_side`: Token padding side (left/right)
|
||||
Reference in New Issue
Block a user