Config Files

  1. on hex0:
     cd ~/correlations
     mkdir t08232 (or whatever the experiment name is)
  2. copy machines, run.sh2] and [@.threads file from a previous experiment
  3. copy .skd file across from hobart
     vex2config.pl -cross -evlbi t08232.skd

-cross indicates create cross-products -evlbi indicates data will be streamed using vsib_send and vsib_recv

creates <blah>.input

edit the input file and check the following:

 EXECUTE TIME (SEC): 50400
 START MJD:          54058
 START SECONDS:      82800

Times in seconds are from the start of the day. Need to change these if correlating a subset of the experiment

Configurations

 NUM CONFIGURATIONS: 1        leave
 CONFIG SOURCE:      DEFAULT   leave
 INT TIME (SEC):     2        change if you want to
 NUM CHANNELS:       128      cahnge
 BLOCKS PER SEND:    1250     change in extreme cases (e.g. lots of spectral pts) for performance
 GUARD BLOCKS:       1        leave don't know what this is
 POST-F FRINGE ROT:  FALSE    TRUE is faster but avoid when high spec res, high fringe rate
 QUAD DELAY INTERP:  TRUE     leave
 WRITE AUTOCORRS:    TRUE     change (if you want to)
 PULSAR BINNING:     FALSE    leave (unless you're interested in pulsars)
 DATASTREAM 0 INDEX: 0        leave
 DATASTREAM 1 INDEX: 1      leave
 BASELINE 0 INDEX:   0   leave 

 # FREQ TABLE #######! leave but check it agrees with obs

 # TELESCOPE TABLE ##!    Change. Use GPS-Maser as first guess. Correlate on a fringe-finder, fringe fit and apply in production run. If monitoring GPS-Maser during the experiment use the rate from that, it's probably better.
 TELESCOPE ENTRIES:  2
 TELESCOPE NAME 0:   HOB
 CLOCK DELAY (us) 0: -10.6
 CLOCK RATE(us/s) 0: 0.0
 TELESCOPE NAME 1:   CED
 CLOCK DELAY (us) 1: 1.05
 CLOCK RATE(us/s) 1: 0.0 

 # DATASTREAM TABLE #!           leave, except maybe Tsys (in Jy)
 DATASTREAM ENTRIES: 2
 DATA BUFFER FACTOR: 256
 NUM DATA SEGMENTS:  16
 TELESCOPE INDEX:    0
 TSYS:               1240
 DATA FORMAT:        LBAVSOP
 QUANTISATION BITS:  2
 FILTERBANK USED:    FALSE
 READ FROM FILE:     TRUE
 NUM FREQS:          1
 FREQ TABLE INDEX 0: 0
 CLK OFFSET 0 (us):  0.000       leave but this is the clock offset per freq. may be used after fringe-fit to correct for differing delays. 
 NUM POLS 0:         2
 INPUT BAND 0 POL:   R  check this is correct.
 INPUT BAND 0 INDEX: 0
 INPUT BAND 1 POL:   L
 INPUT BAND 1 INDEX: 0


 # BASELINE TABLE ###!    defines what to process
 BASELINE ENTRIES:   1
 D/STREAM A INDEX 0: 0
 D/STREAM B INDEX 0: 1    baseline 0 correlates antennas 0 and 1
 NUM FREQS 0:        1
 POL PRODUCTS 0/0:   2
 D/STREAM A BAND 0:  0    A0-B0 (RCP)
 D/STREAM B BAND 0:  0
 D/STREAM A BAND 1:  1    A1-B1 (LCP)
 D/STREAM B BAND 1:  1 

For cross-products too

 vex2config.pl -cross chsb6324.skd 

and the above section will look like this:

 POL PRODUCTS 0/0:   4
 D/STREAM A BAND 0:  0
 D/STREAM B BAND 0:  0
 D/STREAM A BAND 1:  1
 D/STREAM B BAND 1:  1
 D/STREAM A BAND 2:  0
 D/STREAM B BAND 2:  1
 D/STREAM A BAND 3:  1
 D/STREAM B BAND 3:  0


 # DATA TABLE #######     Need to edit this bit if not using evlbi (vsib_send/recv) mode:
 should be the number of raw data files in each directory e.g.:

 # DATA TABLE #######
 D/STREAM 0 FILES:   6
 FILE 0/0:           /data/sb6324/ho/sb6324_Ho_323_230000.lba
 FILE 0/0:           /data/sb6324/ho/sb6324_Ho_323_230010.lba
 FILE 0/0:           /data/sb6324/ho/sb6324_Ho_323_230020.lba
 FILE 0/0:           /data/sb6324/ho/sb6324_Ho_323_230030.lba
 FILE 0/0:           /data/sb6324/ho/sb6324_Ho_323_230040.lba
 FILE 0/0:           /data/sb6324/ho/sb6324_Ho_323_230050.lba
 D/STREAM 1 FILES:   6
 FILE 0/0:           /data/sb6324/cd/sb6324_Cd_323_230000.lba
 FILE 0/0:           /data/sb6324/cd/sb6324_Cd_323_230010.lba
 FILE 0/0:           /data/sb6324/cd/sb6324_Cd_323_230020.lba
 FILE 0/0:           /data/sb6324/cd/sb6324_Cd_323_230030.lba
 FILE 0/0:           /data/sb6324/cd/sb6324_Cd_323_230040.lba
 FILE 0/0:           /data/sb6324/cd/sb6324_Cd_323_230050.lba


 # NETWORK TABLE ####!      for eVLBI. 
 PORT NUM 0:         52100       port number for data stream 1
 TCP WINDOW (KB) 0:  512         TCP window size
 PORT NUM 1:         52101      port number for data stream 2
 TCP WINDOW (KB) 1:  -1

cd to directory with VEX file

 vex2model_updated.pl chsb6324.skd 

machines file

 first line is head node (hex0)
 next is data stream processes:
 hex0


 hex0   head node
 hex0   data stream 0
 hex0   data stream 1
  (if e.g. data were on hex4):
 hex4   data stream 0
 hex4   data stream 1
  next are processing (core) nodes 
 hex1
 hex2
 hex3
 hex4
 hex5
 (leaving hex0 to deal with IO (data streams) and head (manager)). We could specify hex0 as another core node and use the remaining 5 threads (1+4) but in this case there's no need)

edit the threads file. Note number of spaces between text is important:

 NUMBER OF CORES:    5
 8
 8
 8
 8
 8

These would be reduced if running IO nodes on other machines. E.g. if data on hex4:

 8
 8
 8
 6
 8
 ... and may have used hex0 too, but anyway....

edit run.sh

 -np 8 (where 8 is # processes, = wc -l machines)

VEX2config evlbi mode to use vsib_send and recv instead of specifying files by hand. Also, selecting three antennas only:

 vex2config.pl -evlbi -ant Pa -ant At -ant Mp vt12a.skd 

Example

  1. on hex0:
     cd ~/correlations
     mkdir t08232 (or whatever the experiment name is)
  2. copy machines, run.sh2] and [@.threads file from a previous experiment
  3. copy .skd file across from hobart
     vex2config.pl -cross -evlbi t08232.skd
  4. edit the .input file for a fringe search / Ceduna check. e.g First 20 mins is 1921-293:
 EXECUTE TIME: 1200
 INT TIME (SEC):     0.5
 FREQ (MHZ) 0:       6640.00

remove the semi-colon from end of READ FROM FILE If pols swapped at Ceduna, for CED:

 INPUT BAND 0 POL:   L
 INPUT BAND 1 POL:   R
  1. vex2model_updated.pl t08232.skd
  2. edit machines:
 hex0
 hex2
 hex5
 hex1
 hex2
 hex3
 hex4
 hex5
  1. edit t08232.threads:
 NUMBER OF CORES:    5
 8
 7
 8
 8
 7