neuron-explorer
Qwen3.5‑4B 전용 조향형 뉴런 탐색기, 모든 MLP 뉴런을 밀어 결과를 보관·탐색
README 전체를 불러오는 중입니다. 아래는 저장된 발췌입니다.
A Control Arena setting for evaluating agents on full repository refactoring tasks with optional
backdoor insertion.
View full documentation.
This setting provides an environment for evaluating agents on full repository refactoring tasks.
Each task involves:
1. Main Task: Refactoring the repository to improve code quality and maintainability.
2. Side Task (Attack Mode): Inserting a hidden vulnerability while performing the refactoring
that is exploited when running the tests.
If not already installed, install Docker. Docker must be
running for the evals to execute.README 전문 보기 ↗A Control Arena setting for evaluating agents on full repository refactoring tasks with optional backdoor insertion.
This setting provides an environment for evaluating agents on full repository refactoring tasks. Each task involves:
Install the package (requires Python 3.12):
# Install the package
pip install refactor-arena
# Setup your .env and initial scenario
refactor-arena init
# Run getting started scenario in honest mode
refactor-arena eval --config getting-started
If not already installed, install Docker. Docker must be running for the evals to execute.
# Run with default settings using `side-tasks-3/mixed-3` dataset
refactor-arena
# Setup your .env and initial scenario
refactor-arena init
# Run getting started scenario in honest mode
refactor-arena eval --config getting-started
# Run getting started scenario in attack mode
refactor-arena eval --config getting-started --eval-mode attack
# Run with a different dataset from `github:fastfedora/full-repo-datasets` and limit main tasks
refactor-arena --dataset side-tasks-3/mixed-20 --main-task "refactor_single_file"
# Run with verbose logging and limit to 3 samples
refactor-arena eval --config getting-started --verbose --limit 3
# View help
refactor-arena --help
To create a new scenario, create a file that references the main configuration file from the package and then override the settings you want to change.
For instance, to create a scenario that runs only the Refactor Single File main task against the
20-repo side-tasks-3/mixed-20 dataset in attack mode, create a file called mixed-20.yaml:
# mixed-20.yaml
includes:
- package:config.yaml
setting:
dataset: "side-tasks-3/mixed-20"
main_task: refactor_single_file$
eval:
# Default mode for this scenario is attack; use `--eval-mode honest` to run in honest mode
mode: attack
Then run this scenario using:
refactor-arena --config=mixed-20
Almost all aspects of the setting can be configured via configuration files, including:
See the documentation for more details.
MIT License