2020-12-17 14:20:09,179 DEBUG [circus.shared.parser] Creating a Circus Parser for datafile /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy 2020-12-17 14:20:09,183 DEBUG [circus.shared.probes] Reading the probe file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/probe.prb 2020-12-17 14:20:09,186 DEBUG [circus.shared.parser] Cluster not detected, so using global /tmp folder 2020-12-17 14:20:09,186 DEBUG [circus.shared.parser] Hanning filtering is activated 2020-12-17 14:20:09,186 DEBUG [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy 2020-12-17 14:20:09,186 DEBUG [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0 2020-12-17 14:20:09,187 DEBUG [circus.files.datafile] dtype_offset is not set and has the default value of auto 2020-12-17 14:20:09,187 DEBUG [circus.files.datafile] gain is not set and has the default value of 1.0 2020-12-17 14:20:09,211 DEBUG [circus.files.datafile] nb_channels is read from the header with a value of 32 2020-12-17 14:20:09,211 DEBUG [circus.files.datafile] data_dtype is read from the header with a value of float32 2020-12-17 14:20:09,211 DEBUG [circus.files.datafile] data type offset for float32 is automatically set to 0 2020-12-17 14:20:09,211 DEBUG [circus.shared.parser] Changing all values in the param depending on the rate 2020-12-17 14:20:09,212 DEBUG [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy 2020-12-17 14:20:09,212 DEBUG [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0 2020-12-17 14:20:09,212 DEBUG [circus.files.datafile] dtype_offset is not set and has the default value of auto 2020-12-17 14:20:09,212 DEBUG [circus.files.datafile] gain is not set and has the default value of 1.0 2020-12-17 14:20:09,214 DEBUG [circus.files.datafile] nb_channels is read from the header with a value of 32 2020-12-17 14:20:09,214 DEBUG [circus.files.datafile] data_dtype is read from the header with a value of float32 2020-12-17 14:20:09,214 DEBUG [circus.files.datafile] data type offset for float32 is automatically set to 0 2020-12-17 14:20:09,215 INFO [circus.shared.files] Number of recorded channels : 32 2020-12-17 14:20:09,215 INFO [circus.shared.files] Number of analyzed channels : 32 2020-12-17 14:20:09,215 INFO [circus.shared.files] File format : NUMPY 2020-12-17 14:20:09,215 INFO [circus.shared.files] Data type : float32 2020-12-17 14:20:09,215 INFO [circus.shared.files] Sampling rate : 32 kHz 2020-12-17 14:20:09,215 INFO [circus.shared.files] Duration of the recording : 0 min 10 s 0 ms 2020-12-17 14:20:09,215 INFO [circus.shared.files] Width of the templates : 3 ms 2020-12-17 14:20:09,215 INFO [circus.shared.files] Spatial radius considered : 100 um 2020-12-17 14:20:09,215 INFO [circus.shared.files] Threshold crossing : negative 2020-12-17 14:20:09,216 DEBUG [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2)) 2020-12-17 14:20:18,460 DEBUG [circus.filtering] Initializing the filtering step... 2020-12-17 14:20:18,461 DEBUG [circus.filtering] Reading the input file... 2020-12-17 14:20:18,461 DEBUG [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy 2020-12-17 14:20:18,461 DEBUG [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0 2020-12-17 14:20:18,462 DEBUG [circus.files.datafile] dtype_offset is not set and has the default value of auto 2020-12-17 14:20:18,462 DEBUG [circus.files.datafile] gain is not set and has the default value of 1.0 2020-12-17 14:20:18,544 DEBUG [circus.files.datafile] nb_channels is read from the header with a value of 32 2020-12-17 14:20:18,545 DEBUG [circus.files.datafile] data_dtype is read from the header with a value of float32 2020-12-17 14:20:18,545 DEBUG [circus.files.datafile] data type offset for float32 is automatically set to 0 2020-12-17 14:20:18,545 DEBUG [circus.shared.parser] Changing all values in the param depending on the rate 2020-12-17 14:20:18,550 DEBUG [circus.shared.parser] Writing value Started for noedits:filter_done 2020-12-17 14:20:18,558 DEBUG [circus.shared.mpi] Setting data chunk size to 30 second 2020-12-17 14:20:18,558 DEBUG [circus.files.datafile] There are 0 chunks of size 960000 2020-12-17 14:20:18,558 DEBUG [circus.files.datafile] The last chunk has size 320000 2020-12-17 14:20:18,564 DEBUG [circus.filtering] Filtering with a Butterworth filter (order 3) in [300, 15200] Hz 2020-12-17 14:20:21,060 DEBUG [circus.shared.parser] Writing value True for noedits:filter_done 2020-12-17 14:20:21,418 DEBUG [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2)) 2020-12-17 14:20:24,863 DEBUG [circus.shared.mpi] Setting data chunk size to 30 second 2020-12-17 14:20:24,870 DEBUG [circus.whitening] Analyzing data to get whitening matrices and thresholds... 2020-12-17 14:20:24,870 DEBUG [circus.files.datafile] There are 0 chunks of size 960000 2020-12-17 14:20:24,870 DEBUG [circus.files.datafile] The last chunk has size 320000 2020-12-17 14:20:24,871 DEBUG [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy 2020-12-17 14:20:24,871 DEBUG [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0 2020-12-17 14:20:24,871 DEBUG [circus.files.datafile] dtype_offset is not set and has the default value of auto 2020-12-17 14:20:24,871 DEBUG [circus.files.datafile] gain is not set and has the default value of 1.0 2020-12-17 14:20:24,876 DEBUG [circus.files.datafile] nb_channels is read from the header with a value of 32 2020-12-17 14:20:24,876 DEBUG [circus.files.datafile] data_dtype is read from the header with a value of float32 2020-12-17 14:20:24,877 DEBUG [circus.files.datafile] data type offset for float32 is automatically set to 0 2020-12-17 14:20:24,877 DEBUG [circus.whitening] Too much cores, automatically resizing the data chunks 2020-12-17 14:20:24,877 DEBUG [circus.files.datafile] There are 16 chunks of size 20000 2020-12-17 14:20:24,877 DEBUG [circus.files.datafile] The last chunk has size 0 2020-12-17 14:20:25,318 DEBUG [circus.whitening] Found 0.625s without spikes for whitening matrices... 2020-12-17 14:20:25,321 DEBUG [circus.whitening] Because of whitening, need to recompute the thresholds... 2020-12-17 14:20:25,418 DEBUG [circus.shared.mpi] Setting data chunk size to 0.625 second 2020-12-17 14:20:25,424 DEBUG [circus.whitening] Searching spikes to construct the PCA basis... 2020-12-17 14:20:25,425 DEBUG [circus.files.datafile] There are 16 chunks of size 20000 2020-12-17 14:20:25,425 DEBUG [circus.files.datafile] The last chunk has size 0 2020-12-17 14:20:25,473 DEBUG [circus.whitening] Node 8 has collected 42 waveforms 2020-12-17 14:20:25,513 DEBUG [circus.whitening] Node 6 has collected 35 waveforms 2020-12-17 14:20:25,515 DEBUG [circus.whitening] Node 5 has collected 34 waveforms 2020-12-17 14:20:25,518 DEBUG [circus.whitening] Node 10 has collected 34 waveforms 2020-12-17 14:20:25,521 DEBUG [circus.whitening] Node 11 has collected 38 waveforms 2020-12-17 14:20:25,523 DEBUG [circus.whitening] Node 9 has collected 41 waveforms 2020-12-17 14:20:25,524 DEBUG [circus.whitening] Node 4 has collected 41 waveforms 2020-12-17 14:20:25,524 DEBUG [circus.whitening] Node 3 has collected 40 waveforms 2020-12-17 14:20:25,525 DEBUG [circus.whitening] Node 7 has collected 43 waveforms 2020-12-17 14:20:25,525 DEBUG [circus.whitening] Node 1 has collected 42 waveforms 2020-12-17 14:20:25,528 DEBUG [circus.whitening] Node 13 has collected 47 waveforms 2020-12-17 14:20:25,529 DEBUG [circus.whitening] Node 2 has collected 48 waveforms 2020-12-17 14:20:25,530 DEBUG [circus.whitening] Node 14 has collected 50 waveforms 2020-12-17 14:20:25,531 DEBUG [circus.whitening] Node 15 has collected 49 waveforms 2020-12-17 14:20:25,532 DEBUG [circus.whitening] Node 12 has collected 50 waveforms 2020-12-17 14:20:25,543 DEBUG [circus.whitening] Node 0 has collected 48 waveforms 2020-12-17 14:20:25,544 DEBUG [circus.whitening] Found 682 waveforms over 25600 requested 2020-12-17 14:20:25,575 INFO [circus.whitening] A basis with 5 dimensions has been built 2020-12-17 14:20:25,575 DEBUG [circus.whitening] The percentage of variance explained is 0.7755271737933321 for negative spikes 2020-12-17 14:20:25,749 DEBUG [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2)) 2020-12-17 14:20:33,052 DEBUG [circus.shared.mpi] Setting data chunk size to 0.625 second 2020-12-17 14:20:33,076 DEBUG [circus.files.datafile] There are 16 chunks of size 20000 2020-12-17 14:20:33,076 DEBUG [circus.files.datafile] The last chunk has size 0 2020-12-17 14:20:33,077 DEBUG [circus.clustering] Searching isolated random spikes to sample amplitudes... 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 5 has collected 47 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 9 has collected 48 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 7 has collected 39 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 1 has collected 34 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 4 has collected 42 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 15 has collected 42 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 6 has collected 46 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 12 has collected 48 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 8 has collected 40 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 0 has collected 47 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 14 has collected 40 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 2 has collected 40 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 3 has collected 35 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 13 has collected 36 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 10 has collected 31 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 5 has ignored 14 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 11 has collected 45 spikes and rejected 0 spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 9 has ignored 13 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 7 has ignored 8 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 6 has ignored 8 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 1 has ignored 1 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 4 has ignored 7 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 15 has ignored 12 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 8 has ignored 8 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 12 has ignored 16 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 0 has ignored 7 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 14 has ignored 9 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 13 has ignored 5 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 2 has ignored 6 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 10 has ignored 6 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 3 has ignored 7 noisy spikes 2020-12-17 14:20:33,263 DEBUG [circus.clustering] Node 11 has ignored 9 noisy spikes 2020-12-17 14:20:33,264 DEBUG [circus.clustering] Found 660 spikes over 256000 requested 2020-12-17 14:20:33,287 DEBUG [circus.clustering] Estimating amplitudes distributions... 2020-12-17 14:20:33,289 DEBUG [circus.clustering] Smart search is actived on channel 5 2020-12-17 14:20:33,289 DEBUG [circus.clustering] Smart search is actived on channel 8 2020-12-17 14:20:33,289 DEBUG [circus.clustering] Smart search is actived on channel 21 2020-12-17 14:20:33,289 DEBUG [circus.clustering] Smart search is actived on channel 6 2020-12-17 14:20:33,289 DEBUG [circus.clustering] Smart search is actived on channel 10 2020-12-17 14:20:33,289 DEBUG [circus.clustering] Smart search is actived on channel 9 2020-12-17 14:20:33,290 DEBUG [circus.clustering] Smart search is actived on channel 24 2020-12-17 14:20:33,290 DEBUG [circus.clustering] Smart search is actived on channel 3 2020-12-17 14:20:33,290 DEBUG [circus.clustering] Smart search is actived on channel 22 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 19 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 2 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 1 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 13 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 14 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 23 2020-12-17 14:20:33,291 DEBUG [circus.clustering] Smart search is actived on channel 11 2020-12-17 14:20:33,292 DEBUG [circus.clustering] Smart search is actived on channel 30 2020-12-17 14:20:33,298 DEBUG [circus.clustering] Smart Search disabled on 15 electrodes 2020-12-17 14:20:33,298 DEBUG [circus.clustering] Smart Search of good isolated spikes for the clustering (1/3)... 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 3 found not enough spikes: searching only 35 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 5 found not enough spikes: searching only 47 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 0 found not enough spikes: searching only 47 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 1 found not enough spikes: searching only 34 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 10 found not enough spikes: searching only 31 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 13 found not enough spikes: searching only 36 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 14 found not enough spikes: searching only 40 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 9 found not enough spikes: searching only 48 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 6 found not enough spikes: searching only 46 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 7 found not enough spikes: searching only 39 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 12 found not enough spikes: searching only 48 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 8 found not enough spikes: searching only 40 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 2 found not enough spikes: searching only 40 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 15 found not enough spikes: searching only 42 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 4 found not enough spikes: searching only 42 spikes instead of 16000 2020-12-17 14:20:33,311 DEBUG [circus.clustering] Node 11 found not enough spikes: searching only 45 spikes instead of 16000 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 12 has collected 48 spikes and rejected 0 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 6 has collected 45 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 2 has collected 40 spikes and rejected 0 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 4 has collected 42 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 8 has collected 39 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 0 has collected 46 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 10 has collected 30 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 15 has collected 42 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 9 has collected 48 spikes and rejected 0 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 11 has collected 45 spikes and rejected 0 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 1 has collected 34 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 14 has collected 38 spikes and rejected 2 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 12 has ignored 15 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 6 has ignored 7 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 10 has ignored 8 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 7 has collected 39 spikes and rejected 0 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 13 has collected 36 spikes and rejected 1 spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 2 has ignored 3 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 4 has ignored 5 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 0 has ignored 7 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 8 has ignored 8 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 9 has ignored 14 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 15 has ignored 10 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 1 has ignored 1 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 11 has ignored 9 noisy spikes 2020-12-17 14:20:33,463 DEBUG [circus.clustering] Node 14 has ignored 9 noisy spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Node 7 has ignored 8 noisy spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Node 13 has ignored 6 noisy spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Node 3 has collected 35 spikes and rejected 1 spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Node 5 has collected 46 spikes and rejected 1 spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Node 3 has ignored 8 noisy spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Node 5 has ignored 15 noisy spikes 2020-12-17 14:20:33,464 DEBUG [circus.clustering] Found 653 isolated spikes over 256000 requested (12 rejected) 2020-12-17 14:20:33,488 DEBUG [circus.clustering] Computing density estimations... 2020-12-17 14:20:33,489 DEBUG [circus.clustering] Node 0 will use temp file /tmp/tmpvkirl4qh.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 10 will use temp file /tmp/tmpiiduo4da.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 12 will use temp file /tmp/tmpu7v6wdfq.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 8 will use temp file /tmp/tmpys4529_s.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 6 will use temp file /tmp/tmplo5enr8z.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 2 will use temp file /tmp/tmpiadefeq_.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 4 will use temp file /tmp/tmp8xubl4ky.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 1 will use temp file /tmp/tmpi29lspw3.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] Node 9 will use temp file /tmp/tmpb0skuqfi.hdf5 2020-12-17 14:20:33,490 DEBUG [circus.clustering] The variance explained by local PCA on electrode 12 from 1 neg spikes is nan with 1 dimensions 2020-12-17 14:20:33,490 DEBUG [circus.clustering] The variance explained by local PCA on electrode 16 from 1 neg spikes is nan with 1 dimensions 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 7 will use temp file /tmp/tmplby5kyyj.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 13 will use temp file /tmp/tmpmddqa09t.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 5 will use temp file /tmp/tmpmu1173ts.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 3 will use temp file /tmp/tmp9ddrjqfi.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 11 will use temp file /tmp/tmpggt8txju.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 14 will use temp file /tmp/tmpfy5geo_9.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] The variance explained by local PCA on electrode 1 from 4 neg spikes is 1 with 4 dimensions 2020-12-17 14:20:33,491 DEBUG [circus.clustering] The variance explained by local PCA on electrode 8 from 19 neg spikes is 0.797678 with 10 dimensions 2020-12-17 14:20:33,491 DEBUG [circus.clustering] Node 15 will use temp file /tmp/tmp61m1uj4q.hdf5 2020-12-17 14:20:33,491 DEBUG [circus.clustering] The variance explained by local PCA on electrode 10 from 54 neg spikes is 0.522232 with 10 dimensions 2020-12-17 14:20:33,491 DEBUG [circus.clustering] The variance explained by local PCA on electrode 2 from 25 neg spikes is 0.732587 with 10 dimensions 2020-12-17 14:20:33,491 DEBUG [circus.clustering] The variance explained by local PCA on electrode 9 from 27 neg spikes is 0.68984 with 10 dimensions 2020-12-17 14:20:33,492 DEBUG [circus.clustering] The variance explained by local PCA on electrode 13 from 10 neg spikes is 1 with 10 dimensions 2020-12-17 14:20:33,492 DEBUG [circus.clustering] The variance explained by local PCA on electrode 23 from 10 neg spikes is 1 with 10 dimensions 2020-12-17 14:20:33,492 DEBUG [circus.clustering] The variance explained by local PCA on electrode 11 from 10 neg spikes is 1 with 10 dimensions 2020-12-17 14:20:33,492 DEBUG [circus.clustering] The variance explained by local PCA on electrode 3 from 4 neg spikes is 1 with 4 dimensions 2020-12-17 14:20:33,492 DEBUG [circus.clustering] The variance explained by local PCA on electrode 31 from 1 neg spikes is nan with 1 dimensions 2020-12-17 14:20:33,493 DEBUG [circus.clustering] The variance explained by local PCA on electrode 6 from 111 neg spikes is 0.308454 with 10 dimensions 2020-12-17 14:20:33,493 DEBUG [circus.clustering] The variance explained by local PCA on electrode 5 from 47 neg spikes is 0.645619 with 10 dimensions 2020-12-17 14:20:33,494 DEBUG [circus.clustering] The variance explained by local PCA on electrode 19 from 31 neg spikes is 0.659163 with 10 dimensions 2020-12-17 14:20:33,495 DEBUG [circus.clustering] The variance explained by local PCA on electrode 14 from 27 neg spikes is 0.630693 with 10 dimensions 2020-12-17 14:20:33,496 DEBUG [circus.clustering] The variance explained by local PCA on electrode 25 from 1 neg spikes is nan with 1 dimensions 2020-12-17 14:20:33,496 DEBUG [circus.clustering] The variance explained by local PCA on electrode 24 from 49 neg spikes is 0.577031 with 10 dimensions 2020-12-17 14:20:33,499 DEBUG [circus.clustering] The variance explained by local PCA on electrode 30 from 2 neg spikes is 1 with 2 dimensions 2020-12-17 14:20:33,500 DEBUG [circus.clustering] The variance explained by local PCA on electrode 21 from 100 neg spikes is 0.559383 with 10 dimensions 2020-12-17 14:20:33,510 DEBUG [circus.clustering] The variance explained by local PCA on electrode 22 from 119 neg spikes is 0.50882 with 10 dimensions 2020-12-17 14:20:33,525 DEBUG [circus.clustering] Searching random spikes to refine the clustering (2/3)... 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 10 has collected 1 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 4 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 1 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 11 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 14 has collected 2 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 2 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 8 has collected 1 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 0 has collected 1 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 12 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 6 has collected 1 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 9 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 15 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 13 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 7 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 5 has collected 1 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 3 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 10 has ignored 6 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 12 has ignored 15 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 4 has ignored 6 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 1 has ignored 1 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 11 has ignored 6 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 2 has ignored 4 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 14 has ignored 8 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 0 has ignored 6 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 8 has ignored 8 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 6 has ignored 7 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 13 has ignored 5 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 7 has ignored 7 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 9 has ignored 13 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 15 has ignored 10 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 5 has ignored 13 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Node 3 has ignored 6 noisy spikes 2020-12-17 14:20:33,610 DEBUG [circus.clustering] Found 7 spikes over 256000 requested 2020-12-17 14:20:33,617 DEBUG [circus.clustering] Refining density estimations... 2020-12-17 14:20:33,628 DEBUG [circus.clustering] Searching random spikes to refine the clustering (3/3)... 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 12 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 11 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 8 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 2 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 4 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 10 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 1 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 15 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 9 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 0 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 6 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 14 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 12 has ignored 15 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 10 has ignored 6 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 11 has ignored 6 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 8 has ignored 8 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 2 has ignored 4 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 4 has ignored 6 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 1 has ignored 1 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 9 has ignored 13 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 15 has ignored 10 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 0 has ignored 6 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 6 has ignored 7 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 14 has ignored 8 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 7 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 13 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 5 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 3 has collected 0 spikes and rejected 0 spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 13 has ignored 5 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 7 has ignored 7 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 5 has ignored 13 noisy spikes 2020-12-17 14:20:33,709 DEBUG [circus.clustering] Node 3 has ignored 6 noisy spikes 2020-12-17 14:20:33,710 DEBUG [circus.clustering] Found 0 spikes over 256000 requested 2020-12-17 14:20:33,710 INFO [circus.clustering] No more spikes in the recording, stop searching 2020-12-17 14:20:33,716 DEBUG [circus.clustering] Refining density estimations... 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 4: not enough negative spikes on channel 4 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 12: not enough negative spikes on channel 12 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Running density-based clustering... 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 12: not enough negative spikes on channel 28 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 4: not enough negative spikes on channel 20 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 7: not enough negative spikes on channel 7 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 15: not enough negative spikes on channel 15 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 15: not enough negative spikes on channel 31 2020-12-17 14:20:33,717 DEBUG [circus.clustering] Node 0: not enough negative spikes on channel 0 2020-12-17 14:20:33,718 DEBUG [circus.clustering] Node 0: not enough negative spikes on channel 16 2020-12-17 14:20:33,722 DEBUG [circus.clustering] Node 3: 1-0 negative templates on channel 3 from 4 spikes: [] 2020-12-17 14:20:33,723 DEBUG [circus.clustering] Node 1: 1-0 negative templates on channel 1 from 4 spikes: [] 2020-12-17 14:20:33,723 DEBUG [circus.clustering] Node 1: not enough negative spikes on channel 17 2020-12-17 14:20:33,724 DEBUG [circus.clustering] Node 7: 1-0 negative templates on channel 23 from 10 spikes: [] 2020-12-17 14:20:33,728 DEBUG [circus.clustering] Node 13: 1-0 negative templates on channel 13 from 10 spikes: [] 2020-12-17 14:20:33,728 DEBUG [circus.clustering] Node 13: not enough negative spikes on channel 29 2020-12-17 14:20:33,728 DEBUG [circus.clustering] Node 10: 1-0 negative templates on channel 10 from 54 spikes: [54] 2020-12-17 14:20:33,728 DEBUG [circus.clustering] Node 10: not enough negative spikes on channel 26 2020-12-17 14:20:33,730 DEBUG [circus.clustering] Node 11: 1-0 negative templates on channel 11 from 10 spikes: [] 2020-12-17 14:20:33,730 DEBUG [circus.clustering] Node 11: not enough negative spikes on channel 27 2020-12-17 14:20:33,730 DEBUG [circus.clustering] Node 5: 1-0 negative templates on channel 5 from 47 spikes: [47] 2020-12-17 14:20:33,733 DEBUG [circus.clustering] Node 8: 1-0 negative templates on channel 8 from 19 spikes: [] 2020-12-17 14:20:33,733 DEBUG [circus.clustering] Node 14: 1-0 negative templates on channel 14 from 27 spikes: [27] 2020-12-17 14:20:33,734 DEBUG [circus.clustering] Node 9: 1-0 negative templates on channel 9 from 27 spikes: [27] 2020-12-17 14:20:33,734 DEBUG [circus.clustering] Node 9: not enough negative spikes on channel 25 2020-12-17 14:20:33,735 DEBUG [circus.clustering] Node 14: 1-0 negative templates on channel 30 from 2 spikes: [] 2020-12-17 14:20:33,736 DEBUG [circus.clustering] Node 2: 1-0 negative templates on channel 2 from 25 spikes: [25] 2020-12-17 14:20:33,736 DEBUG [circus.clustering] Node 2: not enough negative spikes on channel 18 2020-12-17 14:20:33,744 DEBUG [circus.clustering] Node 5: 1-0 negative templates on channel 21 from 100 spikes: [100] 2020-12-17 14:20:33,744 DEBUG [circus.clustering] Node 6: 1-0 negative templates on channel 6 from 111 spikes: [111] 2020-12-17 14:20:33,745 DEBUG [circus.clustering] Node 3: 1-0 negative templates on channel 19 from 31 spikes: [31] 2020-12-17 14:20:33,757 DEBUG [circus.clustering] Node 8: 1-0 negative templates on channel 24 from 49 spikes: [49] 2020-12-17 14:20:33,767 DEBUG [circus.clustering] Node 6: 1-0 negative templates on channel 22 from 119 spikes: [119] 2020-12-17 14:20:33,768 INFO [circus.clustering] Number of clusters found : 10 2020-12-17 14:20:33,768 INFO [circus.clustering] Number of local merges : 0 (method nd-bhatta, param 2) 2020-12-17 14:20:33,768 INFO [circus.clustering] Not enough spikes gathered: -put safety_space=False? 2020-12-17 14:20:33,769 INFO [circus.clustering] -remove smart_search? 2020-12-17 14:20:33,769 DEBUG [circus.clustering] Estimating the templates with the median-raw procedure ... 2020-12-17 14:20:33,769 DEBUG [circus.clustering] Templates will be smoothed by Savitzky Golay Filtering ... 2020-12-17 14:20:34,680 DEBUG [circus.clustering] Merging similar templates... 2020-12-17 14:20:34,723 DEBUG [circus.shared.files] Overlaps computed, now gathering data by MPI 2020-12-17 14:20:35,164 DEBUG [circus.shared.algorithms] Node 0 is slicing templates 2020-12-17 14:20:35,236 DEBUG [circus.shared.algorithms] Node 0 is slicing clusters 2020-12-17 14:20:35,407 DEBUG [circus.clustering] Removing mixtures of templates... 2020-12-17 14:20:35,468 DEBUG [circus.shared.files] Overlaps computed, now gathering data by MPI 2020-12-17 14:20:36,159 INFO [circus.clustering] Number of global merges : 1 2020-12-17 14:20:36,159 INFO [circus.clustering] Number of mixtures removed : 0 2020-12-17 14:20:36,159 DEBUG [circus.clustering] Computing optimal amplitudes for the templates... 2020-12-17 14:20:37,252 DEBUG [circus.shared.files] Pre-computing the overlaps of templates... 2020-12-17 14:20:37,263 DEBUG [circus.shared.files] Overlaps computed, now gathering data by MPI 2020-12-17 14:20:37,564 DEBUG [circus.shared.files] Overlaps gathered, now computing overlaps/lags 2020-12-17 14:20:38,311 DEBUG [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2)) 2020-12-17 14:20:41,718 DEBUG [circus.shared.mpi] Setting data chunk size to 0.1 second 2020-12-17 14:20:41,723 DEBUG [circus.fitting] nb_chances set automatically to 1 2020-12-17 14:20:41,841 DEBUG [circus.fitting] Here comes the SpyKING CIRCUS using 16 CPUs and 9 templates... 2020-12-17 14:20:41,842 DEBUG [circus.shared.utils] Removing .data for directory /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording 2020-12-17 14:20:41,846 DEBUG [circus.files.datafile] There are 100 chunks of size 3200 2020-12-17 14:20:41,846 DEBUG [circus.files.datafile] The last chunk has size 0 2020-12-17 14:20:42,082 DEBUG [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy 2020-12-17 14:20:42,082 DEBUG [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0 2020-12-17 14:20:42,082 DEBUG [circus.files.datafile] dtype_offset is not set and has the default value of auto 2020-12-17 14:20:42,083 DEBUG [circus.files.datafile] gain is not set and has the default value of 1.0 2020-12-17 14:20:42,085 DEBUG [circus.files.datafile] nb_channels is read from the header with a value of 32 2020-12-17 14:20:42,085 DEBUG [circus.files.datafile] data_dtype is read from the header with a value of float32 2020-12-17 14:20:42,085 DEBUG [circus.files.datafile] data type offset for float32 is automatically set to 0 2020-12-17 14:20:42,087 DEBUG [circus.shared.files] Gathering spikes from 16 nodes... 2020-12-17 14:20:42,137 INFO [circus.shared.files] Number of spikes fitted : 795 2020-12-17 14:20:42,162 DEBUG [circus.shared.utils] Removing .data for directory /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording 2020-12-17 14:20:42,340 DEBUG [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2)) 2020-12-17 14:20:50,527 DEBUG [circus.merging] Launching the merging GUI... 2020-12-17 14:20:50,608 INFO [circus.shared.gui] Automatic merging with a threshold of 0.75 2020-12-17 14:20:50,609 DEBUG [circus.shared.gui] Updating the data... 2020-12-17 14:20:50,612 INFO [circus.shared.gui] No pairs were found given the parameters 2020-12-17 14:20:50,618 DEBUG [circus.shared.algorithms] Node 0 is slicing templates 2020-12-17 14:20:50,692 DEBUG [circus.shared.algorithms] Node 0 is slicing clusters 2020-12-17 14:20:50,850 INFO [circus.shared.gui] We kept 9 templates out of 9 after merging 2020-12-17 14:20:50,850 INFO [circus.shared.gui] As meta merging is still experimental, you need 2020-12-17 14:20:50,850 INFO [circus.shared.gui] to use the extension option to see its results 2020-12-17 14:20:50,850 INFO [circus.shared.gui] >> circus-gui-matlab mydata.dat -e merged 2020-12-17 14:20:50,850 INFO [circus.shared.gui] or 2020-12-17 14:20:50,850 INFO [circus.shared.gui] >> spyking-circus mydata.dat -m converting -e merged