DX 4D flattening of TS3 on 20180209

16:51 Tested data collection with comm4d.capture()
  • Found that yesterday and at the end of the the day on Tuesday that when a capture of 1000 frames was requested that only ~890 were saved and raw files from 717 on had very small or 0 size. In order to process that noise data I manually removed file 717+ in all directories and then performed a comm4d.produce().
  • Collected 1000 frames this morning and same problem.
  • Rebooted 4D computer
  • Now get 1000 good frames

17:50 Flattening with 20180208_225814
  • before 30 = 700 nm
  • after 30 = 140 nm
  • after 150 = 109 nm
  • after 300 = 89 nm
  • after 500 = 80 nm
    • flat 20180209_225814
  • after 500 = 76 nm
  • after 550 = 75 nm
    • flat from AdSec Control GUI 20180209_181000_550modes.sav
  • after 600 = 69 nm bump at 3:00 is better
  • after 600 = 69 nm
    • flat 20180209_181626
  • after push at bump and center = 98 nm * flat from GUI 20180209_181000_push_1.sav

18:49 hexalign()
  • about the same, some tilt

18:54 New recon
  • 0-200, 185405, 190000
  • 201-400, 185555, 190115
  • 401-600, 185828
  • Note, some saturated pixels (had exp at 10)

19:03 New Recon
  • 0-200, 190244 (2400, 2100), 190633 (2300, 2100)
  • 201-400, 190356 (), 190732 (2300, 2100)
  • 401-600, 190532 (2400, 2200), 190819 (2400, 2100)

19:18 Noise data, everything on
  • 20180209_191800_noise (1000)
  • 20180209_192000_noise (300)

19:58 LUCI2 cold heads off, 4 tree house fans off
  • 20180209_195800_noise (1000)

20:42 Add 449 to no_pos list. Jumped after flattened
  • stop start adsec

21:04 Noise
  • 20180209_210400_noise

21:08 Influence function data
0-4 500nm 125 20180209_210838
0-4 1000nm 125 20180209_211017
5-9 350nm 125 20180209_211239
5-9 700nm 125 20180209_211402
10-19 250nm 51 20180209_211609
10-19 500nm 51 20180209_211726

21:19 Noise
  • 20190209_211900_noise

21:23 Test produce()
  • comm4d.produce('20180209_210838')

21:49 Noise
  • 20180209_214900_noise 1000

21:50 IF
20-37 300 35 20180209_215148
20-37 150 35 20180209_215352
38-55 300 35 20180209_215600
38-55 150 35 20180209_215709
56-73 250 35 20180209_215940
56-73 150 35 20180209_220108
74-91 150 35 20180209_220305
92-109 100 35 20180209_220534
110-127 100 35 20180209_220724
128-145 80 35 20180209_220900
146-163 80 35 20180209_221054
164-181 80 35 20180209_221221
182-199 80 35 20180209_221358
2018-2-9_221400_noise
200-217 70 35 20180209_221655
218-235 50 35 20180209_221909
236-253 50 35 20180209_222027
254-271 50 35 20180209_222154
272-289 50 35 20180209_222424
290-307 40 35 20180209_222627
308-325 40 35 20180209_222805
326-343 40 35 20180209_222931
344-361 40 35 20180209_223123
362-370 40 35 20180209_223306
371-379 40 35 20180209_223538
380-397 40 35 20180209_223640
398-415 40 35 20180209_223755
416-433 40 35 20180209_223916
2018-2-9_224000_noise
434-451 40 35 20180209_224155
452-469 40 35 20180209_224344
470-487 40 35 20180209_224515
488-505 40 35 20180209_224716
506-523 40 35 20180209_224844
524-541 40 35 20180209_225045
542-559 40 35 20180209_225236
560-577 40 35 20180209_225411
578-595 40 35 20180209_225522
596-613 40 35 20180209_225654
614-631 40 35 20180209_225811
632-649 40 35 20180209_225942
2018-2-9_230100_noise

23:02 Small samples
600 40 35 20180209_230239
500 40 35 20180209_230317
400 40 35 20180209_230407
300 40 35 20180209_230447
200 70 35 20180209_230539
100 100 35 20180209_230624
50 150 35 20180209_230711
20 150 35 20180209_230817
10 350 35 20180209_230854
5 500 35 20180209_230915
0 500 35 20180209_231001

flat 231539

600 40 35 20180209_231605
500 40 35 20180209_231636
400 40 35 20180209_231709
300 40 35 20180209_231735
200 70 35 20180209_231756
100 100 35 20180209_231816
50 150 35 20180209_231836
20 150 35 20180209_231908
10 350 35 20180209_231929
5 500 35 20180209_231950
0 500 35 20180209_232007

23:20 Noise
  • 20180209_232000_noise
  • 20180209_232000_noise

23:22 Handover to mountain
  • hex 2.975 -0.657, 3.444, 92.5, 444.94
  • M3: The usual

recon1=['20180209_190244', '20180209_190633']

recon2=['20180209_190356', '20180209_190732']

recon3=['20180209_190532', '20180209_190819']

noise1=['20180209_200000_noise','20180209_210400_noise','20180209_211900_noise','20180209_214900_noise','20180209_221400_noise']

noise2=['20180209_224000_noise','20180209_230100_noise','20180209_232000_noise','20180209_232100_noise','20180209_232100_noise_300']

list1=['20180209_210838','20180209_211017','20180209_211239','20180209_211402','20180209_211609','20180209_211726','20180209_215148','20180209_215352','20180209_215600','20180209_215709','20180209_215940']

list2=['20180209_220534','20180209_220724','20180209_220900','20180209_221054','20180209_221221','20180209_221358','20180209_221655','20180209_221909','20180209_222027','20180209_222154','20180209_222424']

list3=['20180209_222931','20180209_223123','20180209_223306','20180209_223538','20180209_223640','20180209_223755','20180209_223916','20180209_224155','20180209_224344','20180209_224515','20180209_224716']

list4=['20180209_225236','20180209_225411','20180209_225522','20180209_225654','20180209_225811','20180209_225942','20180209_220108','20180209_220305','20180209_222627','20180209_222805','20180209_224844','20180209_225045']

im2mmmatrix, '225814', rebfactor=4
make_make_offload_matrix_proj, '225814',nzernike=22, cl_act=adsec.act_w_cl, act_nomap=badact, /save

list_low_amp=['20180209_210838','20180209_211239','20180209_211609','20180209_215352','20180209_215709','20180209_220108','20180209_220305','20180209_220534','20180209_220724','20180209_220900','20180209_221054','20180209_221221','20180209_221358','20180209_221655','20180209_221909','20180209_222027','20180209_222154','20180209_222424','20180209_222627','20180209_222805','20180209_222931','20180209_223123','20180209_223306','20180209_223538','20180209_223640','20180209_223755','20180209_223916','20180209_224155','20180209_224344','20180209_224515','20180209_224716','20180209_224844','20180209_225045','20180209_225236','20180209_225411','20180209_225522','20180209_225654','20180209_225811','20180209_225942']

list_high_amp=['20180209_211017','20180209_211402','20180209_211726','20180209_215148','20180209_215600','20180209_215940','20180209_220305','20180209_220534','20180209_220724','20180209_220900','20180209_221054','20180209_221221','20180209_221358','20180209_221655','20180209_221909','20180209_222027','20180209_222154','20180209_222424','20180209_222627','20180209_222805','20180209_222931','20180209_223123','20180209_223306','20180209_223538','20180209_223640','20180209_223755','20180209_223916','20180209_224155','20180209_224344','20180209_224515','20180209_224716','20180209_224844','20180209_225045','20180209_225236','20180209_225411','20180209_225522','20180209_225654','20180209_225811','20180209_225942']

list_high_amp_10=['20180209_211017','20180209_211402','20180209_211609','20180209_215148','20180209_215600','20180209_215940','20180209_220305','20180209_220534','20180209_220724','20180209_220900','20180209_221054','20180209_221221','20180209_221358','20180209_221655','20180209_221909','20180209_222027','20180209_222154','20180209_222424','20180209_222627','20180209_222805','20180209_222931','20180209_223123','20180209_223306','20180209_223538','20180209_223640','20180209_223755','20180209_223916','20180209_224155','20180209_224344','20180209_224515','20180209_224716','20180209_224844','20180209_225045','20180209_225236','20180209_225411','20180209_225522','20180209_225654','20180209_225811','20180209_225942']

mm = obj_new('mirmodes', list_low_amp, data_dir = '/local/aomeas/adsec_calib/if_functions')
mm->summary_opds

samp1=['20180209_230239','20180209_230317','20180209_230407','20180209_230447','20180209_230539','20180209_230624','20180209_230711','20180209_230817','20180209_230854','20180209_230915','20180209_231001','20180209_231605']

samp2=['20180209_231636','20180209_231709','20180209_231735','20180209_231756','20180209_231816','20180209_231836','20180209_231908','20180209_231929','20180209_231950','20180209_232007']

20180211 Make sure we have all the IF data files we need

$ aoidl
IDL> @startup
IDL> list_low_amp=['20180209_210838',...    (from above)
IDL> mm = obj_new('mirmodes', list_low_amp, data_dir = '/local/aomeas/adsec_calib/if_functions')
IDL> mm->summary_opds
% Compiled module: MINMAX.
tracknum 		 nn 	 amp [nm] 	 first 	  last 	 missing    sampling
20180209_210838 	 125      500.0           0       4    	 0 	 990 x 1002
20180209_211239 	 125      350.0           5 	  9   	 0 	 990 x 1002
20180209_211609 	 51 	  250.0 	 10   	 19   	 0 	 990 x 1002
20180209_215352 	 35 	  150.0 	 20    	 37   	 0 	 990 x 1002
20180209_215709 	 35 	  150.0 	 38      55   	 0 	 990 x 1002
20180209_220108 	 35 	  150.0 	 56    	 73   	 0 	 990 x 1002
20180209_220305 	 35 	  150.0 	 74      91   	 0 	 990 x 1002
20180209_220534 	 35 	  100.0 	 92   	 109 	 0 	 990 x 1002
20180209_220724 	 35 	  100.0 	 110 	 127 	 0 	 990 x 1002
20180209_220900 	 35 	   80.0 	 128 	 145 	 0 	 990 x 1002
20180209_221054 	 35 	   80.0 	 146 	 163 	 0 	 990 x 1002
20180209_221221 	 35 	   80.0 	 164 	 181 	 0 	 990 x 1002
20180209_221358 	 35 	   80.0 	 182 	 199 	 0 	 990 x 1002
20180209_221655 	 35 	   70.0 	 200 	 217 	 0 	 990 x 1002
20180209_221909 	 35 	   50.0 	 218 	 235 	 0 	 990 x 1002
20180209_222027 	 35 	   50.0 	 236 	 253 	 0 	 990 x 1002
20180209_222154 	 35 	   50.0 	 254 	 271 	 0 	 990 x 1002
20180209_222424 	 35 	   50.0 	 272 	 289 	 0 	 990 x 1002
20180209_222627 	 35 	   40.0 	 290 	 307 	 0 	 990 x 1002
20180209_222805 	 35 	   40.0 	 308 	 325 	 0 	 990 x 1002
20180209_222931 	 35 	   40.0 	 326 	 343 	 0 	 990 x 1002
20180209_223123 	 35 	   40.0 	 344 	 361 	 0 	 990 x 1002
20180209_223306 	 35 	   40.0 	 362 	 370 	 0 	 990 x 1002
20180209_223538 	 35 	   40.0 	 371 	 379 	 0 	 990 x 1002
20180209_223640 	 35 	   40.0 	 380 	 397 	 0 	 990 x 1002
20180209_223755 	 35 	   40.0 	 398 	 415 	 0 	 990 x 1002
20180209_223916 	 35 	   40.0 	 416 	 433 	 0 	 990 x 1002
20180209_224155 	 35 	   40.0 	 434 	 451 	 0 	 990 x 1002
20180209_224344 	 35 	   40.0 	 452 	 469 	 0 	 990 x 1002
20180209_224515 	 35 	   40.0 	 470 	 487 	 0 	 990 x 1002
20180209_224716 	 35 	   40.0 	 488 	 505 	 0 	 990 x 1002
20180209_224844 	 35 	   40.0 	 506 	 523 	 0 	 990 x 1002
20180209_225045 	 35 	   40.0 	 524 	 541 	 0 	 990 x 1002
20180209_225236 	 35 	   40.0 	 542 	 559 	 0 	 990 x 1002
20180209_225411 	 35 	   40.0 	 560 	 577 	 0 	 990 x 1002
20180209_225522 	 35 	   40.0 	 578 	 595 	 0 	 990 x 1002
20180209_225654 	 35 	   40.0 	 596 	 613 	 0 	 990 x 1002
20180209_225811 	 35 	   40.0 	 614 	 631 	 0 	 990 x 1002
20180209_225942 	 35 	   40.0 	 632 	 649 	 0 	 990 x 1002

IDL> commands  (ignore the numbers at the beginning)
10	mm->mask_calibration, SHOW=SHOW
15	list_low_amp=['20180209_210838','....  (see variable defined above)
14	for i=0,n_elements(list_full)-1 do print, list_full[i]
13	mm = obj_new('mirmodes', list_full, data_dir = '/local/aomeas/adsec_calib/if_functions')
12	mm->summary_opds
11	mm->collect_opds
9	set_plot, "X"
8	loadct, 3
7	mm->mask_calibration, /SHOW
6	mm->mask_calibration, /SHOWc
5	mm->produce_ifmat
4	IDL> mm->check_noise
3	 mm->check_noise
2	save, mm, FILE='/local/aomeas/adsec_calib/mirmodes_struct/mirmodes_low_amp.sav'

IDL>  mm->inv_ifmat
IDL> mm->interactive_tweak_mask
    tag = low_amp
IDL> mm->showme_the_modes, zoom=0.15, ncol=10
IDL> mm->inv_ifmat
IDL> klf = obj_new('klfit', mm)

IDL> klf->create_ortho_fitted_kls
Restoring Mirror Modes Influence Function data...
% RESTORE: Portable (XDR) compressed SAVE/RESTORE file.
% RESTORE: Save file written by AOeng@dxadsec.mountain.lbto.org, Sun Feb 11 23:00:33 2018.
% RESTORE: IDL version 7.1 (linux, x86_64).
% RESTORE: Restored variable: DMCOUPLING.
% RESTORE: Restored variable: INV_IFMATRIX.
% RESTORE: Restored variable: IFMATRIX.
Restoring theoretical KL modes data...
Computing M2C...
Computing fitted KLs...
Computing fitting error...
Saving M2V data...
Re-orthonormalizing fitted KLs...
Number of final KLs:          405
Computing ortho-fitted KLs...
Computing ortho M2C...
Saving ortho M2V data...
% Operands of matrix multiply have incompatible dimensions: ORTHOM2V, MM2C.
% Execution halted at: KLFIT::CREATE_ORTHO_FITTED_KLS  235 /home/aoeng/aoroot/idl/adsec_lib/calibration/optical/klfit__define.pro
%                      $MAIN$          

IDL> klf->create_theo_kls, nzern=649, nkl=649
   - same error
   - problem: using the old offload projection matrix
   - Need to go back to section 13 in the document
   - tried to use data from 20180208 but the accelerometer stick had a large shadow.
   - have to process data from 20180209
      - from 190256 through 190819

IDL > im2mmmatrix_new, '20180209_190244', rebfactor=4
   - had to modify to save "mmmatrix.sav"

IDL> make_offload_matrix_proj_new,'20180209_190244', /save, tracknum='20180209_190244'           
% RESTORE: Portable (XDR) SAVE/RESTORE file.
% RESTORE: Save file written by AOeng@dxadsec.mountain.lbto.org, Mon Feb 12 09:10:13 2018.
% RESTORE: IDL version 7.1 (linux, x86_64).
% RESTORE: Restored variable: MMMATRIX.
% RESTORE: Restored variable: DPIX.
% RESTORE: Restored variable: XX.
% RESTORE: Restored variable: YY.
% RESTORE: Restored variable: MM2C.
% RESTORE: Restored variable: IDX_MASK.
pseudo-inverting MMmatrix...
MMMATRIX        FLOAT     = Array[201, 36653]
min/max Singular value: Max=0.00065783545 (Max singular value=132.81902)
MMMATRIX        FLOAT     = Array[201, 36653]
MM2C            DOUBLE    = Array[201, 672]
Angular spread [deg] wo x-mirroring:      113.260, w x-mirroring:      116.540
rotation [deg]:     -45.9896(sigma:      113.260)
scale_factor:   0.00279969(sigma:   0.00220890)
X               FLOAT     = Array[216, 216]
DX              FLOAT     =    -0.0726329
INV_ROT_MAT     FLOAT     = Array[2, 2]
XXYY_ZERN       FLOAT     = Array[216, 432]
% Operands of matrix multiply have incompatible dimensions: XXYY_ZERN, INV_ROT_MAT.
% Execution halted at: MAKE_OFFLOAD_MATRIX_PROJ  232 /home/aoeng/aoroot/idl/adsec_lib/adsec_utilities/make_offload_matrix_proj.pro
%                      $MAIN$          

   - Still does not work.  Dimensions of xx and yy are incorrect.  written is [216x216] but expect [36653]  (2D -vs- 1D) in make_offload_matrix_proj.
   - Help from Runa or Fernando

-- %USERSIG{DougMiller - 2018-02-09}%
Topic revision: r6 - 12 Feb 2018, DougMiller
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback