Auto Processing On STBC (Current)

Scope

This page documents the current XAMS production processing flow on STBC. Use this as the operational reference.

Code location

Current scripts live in:

amstrax/auto_processing_new/

Main entry points:

  • auto_processing.py: online loop + single-run submit

  • process.py: per-run worker executed in Condor jobs

  • offline_processing.py: explicit bulk offline reprocessing

Environment

source /data/xenon/xams_v2/setup.sh

Also ensure ~/.xams_config is configured for paths/DB access.

Production writes should run as user xamsdata.

Online processing loop

Typical start command:

cd /data/xenon/xams_v2/software/amstrax/amstrax/auto_processing_new
python auto_processing.py \
  --target raw_records peak_basics event_basics event_positions event_info \
  --production \
  --max_jobs 8 \
  --queue short \
  --mem 8000

Recommended in a screen session:

screen -S xams_auto_processing_online
# run command above

Single-run submit

python auto_processing.py \
  --run_id 007348 \
  --target peak_basics event_basics event_positions event_info \
  --corrections_version ONLINE \
  --production

Offline bulk reprocessing

python offline_processing.py \
  --run_range 7340-7350 \
  --targets peak_basics event_basics event_positions event_info \
  --amstrax_path /data/xenon/xams_v2/software/amstrax_versioned/v2.1.0 \
  --corrections_version ONLINE \
  --production \
  --queue short \
  --mem 8000

Operational notes

  • corrections_version must cover the run ranges in each referenced correction file.

  • LED calibration runs are auto-routed by process.py to: raw_records, records_led, led_calibration.

  • process.py supports optional JSON kwargs: --set_config_kwargs and --set_context_kwargs.