ephy_testing_data/spykingcircus/spykingcircus_example0/recording.log

2020-12-17 14:20:09,179 DEBUG    [circus.shared.parser] Creating a Circus Parser for datafile /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy
2020-12-17 14:20:09,183 DEBUG    [circus.shared.probes] Reading the probe file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/probe.prb
2020-12-17 14:20:09,186 DEBUG    [circus.shared.parser] Cluster not detected, so using global /tmp folder
2020-12-17 14:20:09,186 DEBUG    [circus.shared.parser] Hanning filtering is activated
2020-12-17 14:20:09,186 DEBUG    [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy
2020-12-17 14:20:09,186 DEBUG    [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0
2020-12-17 14:20:09,187 DEBUG    [circus.files.datafile] dtype_offset is not set and has the default value of auto
2020-12-17 14:20:09,187 DEBUG    [circus.files.datafile] gain is not set and has the default value of 1.0
2020-12-17 14:20:09,211 DEBUG    [circus.files.datafile] nb_channels is read from the header with a value of 32
2020-12-17 14:20:09,211 DEBUG    [circus.files.datafile] data_dtype is read from the header with a value of float32
2020-12-17 14:20:09,211 DEBUG    [circus.files.datafile] data type offset for float32 is automatically set to 0
2020-12-17 14:20:09,211 DEBUG    [circus.shared.parser] Changing all values in the param depending on the rate
2020-12-17 14:20:09,212 DEBUG    [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy
2020-12-17 14:20:09,212 DEBUG    [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0
2020-12-17 14:20:09,212 DEBUG    [circus.files.datafile] dtype_offset is not set and has the default value of auto
2020-12-17 14:20:09,212 DEBUG    [circus.files.datafile] gain is not set and has the default value of 1.0
2020-12-17 14:20:09,214 DEBUG    [circus.files.datafile] nb_channels is read from the header with a value of 32
2020-12-17 14:20:09,214 DEBUG    [circus.files.datafile] data_dtype is read from the header with a value of float32
2020-12-17 14:20:09,214 DEBUG    [circus.files.datafile] data type offset for float32 is automatically set to 0
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Number of recorded channels : 32
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Number of analyzed channels : 32
2020-12-17 14:20:09,215 INFO     [circus.shared.files] File format                 : NUMPY
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Data type                   : float32
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Sampling rate               : 32 kHz
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Duration of the recording   : 0 min 10 s 0 ms
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Width of the templates      : 3 ms
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Spatial radius considered   : 100 um
2020-12-17 14:20:09,215 INFO     [circus.shared.files] Threshold crossing          : negative
2020-12-17 14:20:09,216 DEBUG    [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2))
2020-12-17 14:20:18,460 DEBUG    [circus.filtering] Initializing the filtering step...
2020-12-17 14:20:18,461 DEBUG    [circus.filtering] Reading the input file...
2020-12-17 14:20:18,461 DEBUG    [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy
2020-12-17 14:20:18,461 DEBUG    [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0
2020-12-17 14:20:18,462 DEBUG    [circus.files.datafile] dtype_offset is not set and has the default value of auto
2020-12-17 14:20:18,462 DEBUG    [circus.files.datafile] gain is not set and has the default value of 1.0
2020-12-17 14:20:18,544 DEBUG    [circus.files.datafile] nb_channels is read from the header with a value of 32
2020-12-17 14:20:18,545 DEBUG    [circus.files.datafile] data_dtype is read from the header with a value of float32
2020-12-17 14:20:18,545 DEBUG    [circus.files.datafile] data type offset for float32 is automatically set to 0
2020-12-17 14:20:18,545 DEBUG    [circus.shared.parser] Changing all values in the param depending on the rate
2020-12-17 14:20:18,550 DEBUG    [circus.shared.parser] Writing value Started for noedits:filter_done
2020-12-17 14:20:18,558 DEBUG    [circus.shared.mpi] Setting data chunk size to 30 second
2020-12-17 14:20:18,558 DEBUG    [circus.files.datafile] There are 0 chunks of size 960000
2020-12-17 14:20:18,558 DEBUG    [circus.files.datafile] The last chunk has size 320000
2020-12-17 14:20:18,564 DEBUG    [circus.filtering] Filtering with a Butterworth filter (order 3) in [300, 15200] Hz
2020-12-17 14:20:21,060 DEBUG    [circus.shared.parser] Writing value True for noedits:filter_done
2020-12-17 14:20:21,418 DEBUG    [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2))
2020-12-17 14:20:24,863 DEBUG    [circus.shared.mpi] Setting data chunk size to 30 second
2020-12-17 14:20:24,870 DEBUG    [circus.whitening] Analyzing data to get whitening matrices and thresholds...
2020-12-17 14:20:24,870 DEBUG    [circus.files.datafile] There are 0 chunks of size 960000
2020-12-17 14:20:24,870 DEBUG    [circus.files.datafile] The last chunk has size 320000
2020-12-17 14:20:24,871 DEBUG    [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy
2020-12-17 14:20:24,871 DEBUG    [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0
2020-12-17 14:20:24,871 DEBUG    [circus.files.datafile] dtype_offset is not set and has the default value of auto
2020-12-17 14:20:24,871 DEBUG    [circus.files.datafile] gain is not set and has the default value of 1.0
2020-12-17 14:20:24,876 DEBUG    [circus.files.datafile] nb_channels is read from the header with a value of 32
2020-12-17 14:20:24,876 DEBUG    [circus.files.datafile] data_dtype is read from the header with a value of float32
2020-12-17 14:20:24,877 DEBUG    [circus.files.datafile] data type offset for float32 is automatically set to 0
2020-12-17 14:20:24,877 DEBUG    [circus.whitening] Too much cores, automatically resizing the data chunks
2020-12-17 14:20:24,877 DEBUG    [circus.files.datafile] There are 16 chunks of size 20000
2020-12-17 14:20:24,877 DEBUG    [circus.files.datafile] The last chunk has size 0
2020-12-17 14:20:25,318 DEBUG    [circus.whitening] Found 0.625s without spikes for whitening matrices...
2020-12-17 14:20:25,321 DEBUG    [circus.whitening] Because of whitening, need to recompute the thresholds...
2020-12-17 14:20:25,418 DEBUG    [circus.shared.mpi] Setting data chunk size to 0.625 second
2020-12-17 14:20:25,424 DEBUG    [circus.whitening] Searching spikes to construct the PCA basis...
2020-12-17 14:20:25,425 DEBUG    [circus.files.datafile] There are 16 chunks of size 20000
2020-12-17 14:20:25,425 DEBUG    [circus.files.datafile] The last chunk has size 0
2020-12-17 14:20:25,473 DEBUG    [circus.whitening] Node 8 has collected 42 waveforms
2020-12-17 14:20:25,513 DEBUG    [circus.whitening] Node 6 has collected 35 waveforms
2020-12-17 14:20:25,515 DEBUG    [circus.whitening] Node 5 has collected 34 waveforms
2020-12-17 14:20:25,518 DEBUG    [circus.whitening] Node 10 has collected 34 waveforms
2020-12-17 14:20:25,521 DEBUG    [circus.whitening] Node 11 has collected 38 waveforms
2020-12-17 14:20:25,523 DEBUG    [circus.whitening] Node 9 has collected 41 waveforms
2020-12-17 14:20:25,524 DEBUG    [circus.whitening] Node 4 has collected 41 waveforms
2020-12-17 14:20:25,524 DEBUG    [circus.whitening] Node 3 has collected 40 waveforms
2020-12-17 14:20:25,525 DEBUG    [circus.whitening] Node 7 has collected 43 waveforms
2020-12-17 14:20:25,525 DEBUG    [circus.whitening] Node 1 has collected 42 waveforms
2020-12-17 14:20:25,528 DEBUG    [circus.whitening] Node 13 has collected 47 waveforms
2020-12-17 14:20:25,529 DEBUG    [circus.whitening] Node 2 has collected 48 waveforms
2020-12-17 14:20:25,530 DEBUG    [circus.whitening] Node 14 has collected 50 waveforms
2020-12-17 14:20:25,531 DEBUG    [circus.whitening] Node 15 has collected 49 waveforms
2020-12-17 14:20:25,532 DEBUG    [circus.whitening] Node 12 has collected 50 waveforms
2020-12-17 14:20:25,543 DEBUG    [circus.whitening] Node 0 has collected 48 waveforms
2020-12-17 14:20:25,544 DEBUG    [circus.whitening] Found 682 waveforms over 25600 requested
2020-12-17 14:20:25,575 INFO     [circus.whitening] A basis with 5 dimensions has been built
2020-12-17 14:20:25,575 DEBUG    [circus.whitening] The percentage of variance explained is 0.7755271737933321 for negative spikes
2020-12-17 14:20:25,749 DEBUG    [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2))
2020-12-17 14:20:33,052 DEBUG    [circus.shared.mpi] Setting data chunk size to 0.625 second
2020-12-17 14:20:33,076 DEBUG    [circus.files.datafile] There are 16 chunks of size 20000
2020-12-17 14:20:33,076 DEBUG    [circus.files.datafile] The last chunk has size 0
2020-12-17 14:20:33,077 DEBUG    [circus.clustering] Searching isolated random spikes to sample amplitudes...
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 5 has collected 47 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 9 has collected 48 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 7 has collected 39 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 1 has collected 34 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 4 has collected 42 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 15 has collected 42 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 6 has collected 46 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 12 has collected 48 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 8 has collected 40 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 0 has collected 47 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 14 has collected 40 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 2 has collected 40 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 3 has collected 35 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 13 has collected 36 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 10 has collected 31 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 5 has ignored 14 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 11 has collected 45 spikes and rejected 0 spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 9 has ignored 13 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 7 has ignored 8 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 6 has ignored 8 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 1 has ignored 1 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 4 has ignored 7 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 15 has ignored 12 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 8 has ignored 8 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 12 has ignored 16 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 0 has ignored 7 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 14 has ignored 9 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 13 has ignored 5 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 2 has ignored 6 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 10 has ignored 6 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 3 has ignored 7 noisy spikes
2020-12-17 14:20:33,263 DEBUG    [circus.clustering] Node 11 has ignored 9 noisy spikes
2020-12-17 14:20:33,264 DEBUG    [circus.clustering] Found 660 spikes over 256000 requested
2020-12-17 14:20:33,287 DEBUG    [circus.clustering] Estimating amplitudes distributions...
2020-12-17 14:20:33,289 DEBUG    [circus.clustering] Smart search is actived on channel 5
2020-12-17 14:20:33,289 DEBUG    [circus.clustering] Smart search is actived on channel 8
2020-12-17 14:20:33,289 DEBUG    [circus.clustering] Smart search is actived on channel 21
2020-12-17 14:20:33,289 DEBUG    [circus.clustering] Smart search is actived on channel 6
2020-12-17 14:20:33,289 DEBUG    [circus.clustering] Smart search is actived on channel 10
2020-12-17 14:20:33,289 DEBUG    [circus.clustering] Smart search is actived on channel 9
2020-12-17 14:20:33,290 DEBUG    [circus.clustering] Smart search is actived on channel 24
2020-12-17 14:20:33,290 DEBUG    [circus.clustering] Smart search is actived on channel 3
2020-12-17 14:20:33,290 DEBUG    [circus.clustering] Smart search is actived on channel 22
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 19
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 2
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 1
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 13
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 14
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 23
2020-12-17 14:20:33,291 DEBUG    [circus.clustering] Smart search is actived on channel 11
2020-12-17 14:20:33,292 DEBUG    [circus.clustering] Smart search is actived on channel 30
2020-12-17 14:20:33,298 DEBUG    [circus.clustering] Smart Search disabled on 15 electrodes
2020-12-17 14:20:33,298 DEBUG    [circus.clustering] Smart Search of good isolated spikes for the clustering (1/3)...
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 3 found not enough spikes: searching only 35 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 5 found not enough spikes: searching only 47 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 0 found not enough spikes: searching only 47 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 1 found not enough spikes: searching only 34 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 10 found not enough spikes: searching only 31 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 13 found not enough spikes: searching only 36 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 14 found not enough spikes: searching only 40 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 9 found not enough spikes: searching only 48 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 6 found not enough spikes: searching only 46 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 7 found not enough spikes: searching only 39 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 12 found not enough spikes: searching only 48 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 8 found not enough spikes: searching only 40 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 2 found not enough spikes: searching only 40 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 15 found not enough spikes: searching only 42 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 4 found not enough spikes: searching only 42 spikes instead of 16000
2020-12-17 14:20:33,311 DEBUG    [circus.clustering] Node 11 found not enough spikes: searching only 45 spikes instead of 16000
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 12 has collected 48 spikes and rejected 0 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 6 has collected 45 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 2 has collected 40 spikes and rejected 0 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 4 has collected 42 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 8 has collected 39 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 0 has collected 46 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 10 has collected 30 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 15 has collected 42 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 9 has collected 48 spikes and rejected 0 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 11 has collected 45 spikes and rejected 0 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 1 has collected 34 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 14 has collected 38 spikes and rejected 2 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 12 has ignored 15 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 6 has ignored 7 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 10 has ignored 8 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 7 has collected 39 spikes and rejected 0 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 13 has collected 36 spikes and rejected 1 spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 2 has ignored 3 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 4 has ignored 5 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 0 has ignored 7 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 8 has ignored 8 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 9 has ignored 14 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 15 has ignored 10 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 1 has ignored 1 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 11 has ignored 9 noisy spikes
2020-12-17 14:20:33,463 DEBUG    [circus.clustering] Node 14 has ignored 9 noisy spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Node 7 has ignored 8 noisy spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Node 13 has ignored 6 noisy spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Node 3 has collected 35 spikes and rejected 1 spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Node 5 has collected 46 spikes and rejected 1 spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Node 3 has ignored 8 noisy spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Node 5 has ignored 15 noisy spikes
2020-12-17 14:20:33,464 DEBUG    [circus.clustering] Found 653 isolated spikes over 256000 requested (12 rejected)
2020-12-17 14:20:33,488 DEBUG    [circus.clustering] Computing density estimations...
2020-12-17 14:20:33,489 DEBUG    [circus.clustering] Node 0 will use temp file /tmp/tmpvkirl4qh.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 10 will use temp file /tmp/tmpiiduo4da.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 12 will use temp file /tmp/tmpu7v6wdfq.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 8 will use temp file /tmp/tmpys4529_s.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 6 will use temp file /tmp/tmplo5enr8z.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 2 will use temp file /tmp/tmpiadefeq_.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 4 will use temp file /tmp/tmp8xubl4ky.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 1 will use temp file /tmp/tmpi29lspw3.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] Node 9 will use temp file /tmp/tmpb0skuqfi.hdf5
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 12 from 1 neg spikes is nan with 1 dimensions
2020-12-17 14:20:33,490 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 16 from 1 neg spikes is nan with 1 dimensions
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 7 will use temp file /tmp/tmplby5kyyj.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 13 will use temp file /tmp/tmpmddqa09t.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 5 will use temp file /tmp/tmpmu1173ts.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 3 will use temp file /tmp/tmp9ddrjqfi.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 11 will use temp file /tmp/tmpggt8txju.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 14 will use temp file /tmp/tmpfy5geo_9.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 1 from 4 neg spikes is 1 with 4 dimensions
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 8 from 19 neg spikes is 0.797678 with 10 dimensions
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] Node 15 will use temp file /tmp/tmp61m1uj4q.hdf5
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 10 from 54 neg spikes is 0.522232 with 10 dimensions
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 2 from 25 neg spikes is 0.732587 with 10 dimensions
2020-12-17 14:20:33,491 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 9 from 27 neg spikes is 0.68984 with 10 dimensions
2020-12-17 14:20:33,492 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 13 from 10 neg spikes is 1 with 10 dimensions
2020-12-17 14:20:33,492 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 23 from 10 neg spikes is 1 with 10 dimensions
2020-12-17 14:20:33,492 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 11 from 10 neg spikes is 1 with 10 dimensions
2020-12-17 14:20:33,492 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 3 from 4 neg spikes is 1 with 4 dimensions
2020-12-17 14:20:33,492 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 31 from 1 neg spikes is nan with 1 dimensions
2020-12-17 14:20:33,493 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 6 from 111 neg spikes is 0.308454 with 10 dimensions
2020-12-17 14:20:33,493 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 5 from 47 neg spikes is 0.645619 with 10 dimensions
2020-12-17 14:20:33,494 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 19 from 31 neg spikes is 0.659163 with 10 dimensions
2020-12-17 14:20:33,495 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 14 from 27 neg spikes is 0.630693 with 10 dimensions
2020-12-17 14:20:33,496 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 25 from 1 neg spikes is nan with 1 dimensions
2020-12-17 14:20:33,496 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 24 from 49 neg spikes is 0.577031 with 10 dimensions
2020-12-17 14:20:33,499 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 30 from 2 neg spikes is 1 with 2 dimensions
2020-12-17 14:20:33,500 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 21 from 100 neg spikes is 0.559383 with 10 dimensions
2020-12-17 14:20:33,510 DEBUG    [circus.clustering] The variance explained by local PCA on electrode 22 from 119 neg spikes is 0.50882 with 10 dimensions
2020-12-17 14:20:33,525 DEBUG    [circus.clustering] Searching random spikes to refine the clustering (2/3)...
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 10 has collected 1 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 4 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 1 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 11 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 14 has collected 2 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 2 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 8 has collected 1 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 0 has collected 1 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 12 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 6 has collected 1 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 9 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 15 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 13 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 7 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 5 has collected 1 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 3 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 10 has ignored 6 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 12 has ignored 15 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 4 has ignored 6 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 1 has ignored 1 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 11 has ignored 6 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 2 has ignored 4 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 14 has ignored 8 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 0 has ignored 6 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 8 has ignored 8 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 6 has ignored 7 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 13 has ignored 5 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 7 has ignored 7 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 9 has ignored 13 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 15 has ignored 10 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 5 has ignored 13 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Node 3 has ignored 6 noisy spikes
2020-12-17 14:20:33,610 DEBUG    [circus.clustering] Found 7 spikes over 256000 requested
2020-12-17 14:20:33,617 DEBUG    [circus.clustering] Refining density estimations...
2020-12-17 14:20:33,628 DEBUG    [circus.clustering] Searching random spikes to refine the clustering (3/3)...
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 12 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 11 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 8 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 2 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 4 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 10 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 1 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 15 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 9 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 0 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 6 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 14 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 12 has ignored 15 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 10 has ignored 6 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 11 has ignored 6 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 8 has ignored 8 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 2 has ignored 4 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 4 has ignored 6 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 1 has ignored 1 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 9 has ignored 13 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 15 has ignored 10 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 0 has ignored 6 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 6 has ignored 7 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 14 has ignored 8 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 7 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 13 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 5 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 3 has collected 0 spikes and rejected 0 spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 13 has ignored 5 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 7 has ignored 7 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 5 has ignored 13 noisy spikes
2020-12-17 14:20:33,709 DEBUG    [circus.clustering] Node 3 has ignored 6 noisy spikes
2020-12-17 14:20:33,710 DEBUG    [circus.clustering] Found 0 spikes over 256000 requested
2020-12-17 14:20:33,710 INFO     [circus.clustering] No more spikes in the recording, stop searching
2020-12-17 14:20:33,716 DEBUG    [circus.clustering] Refining density estimations...
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 4: not enough negative spikes on channel 4
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 12: not enough negative spikes on channel 12
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Running density-based clustering...
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 12: not enough negative spikes on channel 28
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 4: not enough negative spikes on channel 20
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 7: not enough negative spikes on channel 7
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 15: not enough negative spikes on channel 15
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 15: not enough negative spikes on channel 31
2020-12-17 14:20:33,717 DEBUG    [circus.clustering] Node 0: not enough negative spikes on channel 0
2020-12-17 14:20:33,718 DEBUG    [circus.clustering] Node 0: not enough negative spikes on channel 16
2020-12-17 14:20:33,722 DEBUG    [circus.clustering] Node 3: 1-0 negative templates on channel 3 from 4 spikes: []
2020-12-17 14:20:33,723 DEBUG    [circus.clustering] Node 1: 1-0 negative templates on channel 1 from 4 spikes: []
2020-12-17 14:20:33,723 DEBUG    [circus.clustering] Node 1: not enough negative spikes on channel 17
2020-12-17 14:20:33,724 DEBUG    [circus.clustering] Node 7: 1-0 negative templates on channel 23 from 10 spikes: []
2020-12-17 14:20:33,728 DEBUG    [circus.clustering] Node 13: 1-0 negative templates on channel 13 from 10 spikes: []
2020-12-17 14:20:33,728 DEBUG    [circus.clustering] Node 13: not enough negative spikes on channel 29
2020-12-17 14:20:33,728 DEBUG    [circus.clustering] Node 10: 1-0 negative templates on channel 10 from 54 spikes: [54]
2020-12-17 14:20:33,728 DEBUG    [circus.clustering] Node 10: not enough negative spikes on channel 26
2020-12-17 14:20:33,730 DEBUG    [circus.clustering] Node 11: 1-0 negative templates on channel 11 from 10 spikes: []
2020-12-17 14:20:33,730 DEBUG    [circus.clustering] Node 11: not enough negative spikes on channel 27
2020-12-17 14:20:33,730 DEBUG    [circus.clustering] Node 5: 1-0 negative templates on channel 5 from 47 spikes: [47]
2020-12-17 14:20:33,733 DEBUG    [circus.clustering] Node 8: 1-0 negative templates on channel 8 from 19 spikes: []
2020-12-17 14:20:33,733 DEBUG    [circus.clustering] Node 14: 1-0 negative templates on channel 14 from 27 spikes: [27]
2020-12-17 14:20:33,734 DEBUG    [circus.clustering] Node 9: 1-0 negative templates on channel 9 from 27 spikes: [27]
2020-12-17 14:20:33,734 DEBUG    [circus.clustering] Node 9: not enough negative spikes on channel 25
2020-12-17 14:20:33,735 DEBUG    [circus.clustering] Node 14: 1-0 negative templates on channel 30 from 2 spikes: []
2020-12-17 14:20:33,736 DEBUG    [circus.clustering] Node 2: 1-0 negative templates on channel 2 from 25 spikes: [25]
2020-12-17 14:20:33,736 DEBUG    [circus.clustering] Node 2: not enough negative spikes on channel 18
2020-12-17 14:20:33,744 DEBUG    [circus.clustering] Node 5: 1-0 negative templates on channel 21 from 100 spikes: [100]
2020-12-17 14:20:33,744 DEBUG    [circus.clustering] Node 6: 1-0 negative templates on channel 6 from 111 spikes: [111]
2020-12-17 14:20:33,745 DEBUG    [circus.clustering] Node 3: 1-0 negative templates on channel 19 from 31 spikes: [31]
2020-12-17 14:20:33,757 DEBUG    [circus.clustering] Node 8: 1-0 negative templates on channel 24 from 49 spikes: [49]
2020-12-17 14:20:33,767 DEBUG    [circus.clustering] Node 6: 1-0 negative templates on channel 22 from 119 spikes: [119]
2020-12-17 14:20:33,768 INFO     [circus.clustering] Number of clusters found : 10
2020-12-17 14:20:33,768 INFO     [circus.clustering] Number of local merges   : 0 (method nd-bhatta, param 2)
2020-12-17 14:20:33,768 INFO     [circus.clustering] Not enough spikes gathered: -put safety_space=False?
2020-12-17 14:20:33,769 INFO     [circus.clustering]                             -remove smart_search?
2020-12-17 14:20:33,769 DEBUG    [circus.clustering] Estimating the templates with the median-raw procedure ...
2020-12-17 14:20:33,769 DEBUG    [circus.clustering] Templates will be smoothed by Savitzky Golay Filtering ...
2020-12-17 14:20:34,680 DEBUG    [circus.clustering] Merging similar templates...
2020-12-17 14:20:34,723 DEBUG    [circus.shared.files] Overlaps computed, now gathering data by MPI
2020-12-17 14:20:35,164 DEBUG    [circus.shared.algorithms] Node 0 is slicing templates
2020-12-17 14:20:35,236 DEBUG    [circus.shared.algorithms] Node 0 is slicing clusters
2020-12-17 14:20:35,407 DEBUG    [circus.clustering] Removing mixtures of templates...
2020-12-17 14:20:35,468 DEBUG    [circus.shared.files] Overlaps computed, now gathering data by MPI
2020-12-17 14:20:36,159 INFO     [circus.clustering] Number of global merges    : 1
2020-12-17 14:20:36,159 INFO     [circus.clustering] Number of mixtures removed : 0
2020-12-17 14:20:36,159 DEBUG    [circus.clustering] Computing optimal amplitudes for the templates...
2020-12-17 14:20:37,252 DEBUG    [circus.shared.files] Pre-computing the overlaps of templates...
2020-12-17 14:20:37,263 DEBUG    [circus.shared.files] Overlaps computed, now gathering data by MPI
2020-12-17 14:20:37,564 DEBUG    [circus.shared.files] Overlaps gathered, now computing overlaps/lags
2020-12-17 14:20:38,311 DEBUG    [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2))
2020-12-17 14:20:41,718 DEBUG    [circus.shared.mpi] Setting data chunk size to 0.1 second
2020-12-17 14:20:41,723 DEBUG    [circus.fitting] nb_chances set automatically to 1
2020-12-17 14:20:41,841 DEBUG    [circus.fitting] Here comes the SpyKING CIRCUS using 16 CPUs and 9 templates...
2020-12-17 14:20:41,842 DEBUG    [circus.shared.utils] Removing .data for directory /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording
2020-12-17 14:20:41,846 DEBUG    [circus.files.datafile] There are 100 chunks of size 3200
2020-12-17 14:20:41,846 DEBUG    [circus.files.datafile] The last chunk has size 0
2020-12-17 14:20:42,082 DEBUG    [circus.shared.parser] Trying to read file /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording.npy as numpy
2020-12-17 14:20:42,082 DEBUG    [circus.files.datafile] sampling_rate is read from the params with a value of 32000.0
2020-12-17 14:20:42,082 DEBUG    [circus.files.datafile] dtype_offset is not set and has the default value of auto
2020-12-17 14:20:42,083 DEBUG    [circus.files.datafile] gain is not set and has the default value of 1.0
2020-12-17 14:20:42,085 DEBUG    [circus.files.datafile] nb_channels is read from the header with a value of 32
2020-12-17 14:20:42,085 DEBUG    [circus.files.datafile] data_dtype is read from the header with a value of float32
2020-12-17 14:20:42,085 DEBUG    [circus.files.datafile] data type offset for float32 is automatically set to 0
2020-12-17 14:20:42,087 DEBUG    [circus.shared.files] Gathering spikes from 16 nodes...
2020-12-17 14:20:42,137 INFO     [circus.shared.files] Number of spikes fitted : 795
2020-12-17 14:20:42,162 DEBUG    [circus.shared.utils] Removing .data for directory /net/bs-filesvr01/export/group/hierlemann/Temp/Alessio/make_test_sorted_data/sorting_output/spykingcircus/recording
2020-12-17 14:20:42,340 DEBUG    [circus.shared.mpi] MPI detected: ('MPICH', (3, 3, 2))
2020-12-17 14:20:50,527 DEBUG    [circus.merging] Launching the merging GUI...
2020-12-17 14:20:50,608 INFO     [circus.shared.gui] Automatic merging with a threshold of 0.75
2020-12-17 14:20:50,609 DEBUG    [circus.shared.gui] Updating the data...
2020-12-17 14:20:50,612 INFO     [circus.shared.gui] No pairs were found given the parameters
2020-12-17 14:20:50,618 DEBUG    [circus.shared.algorithms] Node 0 is slicing templates
2020-12-17 14:20:50,692 DEBUG    [circus.shared.algorithms] Node 0 is slicing clusters
2020-12-17 14:20:50,850 INFO     [circus.shared.gui] We kept 9 templates out of 9 after merging
2020-12-17 14:20:50,850 INFO     [circus.shared.gui] As meta merging is still experimental, you need
2020-12-17 14:20:50,850 INFO     [circus.shared.gui] to use the extension option to see its results
2020-12-17 14:20:50,850 INFO     [circus.shared.gui] >> circus-gui-matlab mydata.dat -e merged
2020-12-17 14:20:50,850 INFO     [circus.shared.gui] or
2020-12-17 14:20:50,850 INFO     [circus.shared.gui] >> spyking-circus mydata.dat -m converting -e merged