
Input data size [72,893500] = 72 channels, 893500 frames
Finding 72 ICA components using extended ICA.
Kurtosis will be calculated initially every 1 blocks using 6000 data points.
Decomposing 172 frames per ICA weight ((5184)^2 = 893500 weights, Initial learning rate will be 0.001, block size 69.
Learning rate will be multiplied by 0.98 whenever angledelta >= 60 deg.
More than 32 channels: default stopping weight change 1E-7
Training will end when wchange < 1e-07 or after 512 steps.
Online bias adjustment will be used.
Removing mean of each channel ...
Final training data range: -8.32987 to 9.52484
Computing the sphering matrix...
Starting weights are the identity matrix ...
Sphering the data ...
Beginning ICA training ... first training step may be slow ...
Lowering learning rate to 0.0009 and starting again.
Lowering learning rate to 0.00081 and starting again.
Lowering learning rate to 0.000729 and starting again.
Lowering learning rate to 0.0006561 and starting again.
Lowering learning rate to 0.00059049 and starting again.
Lowering learning rate to 0.000531441 and starting again.
Lowering learning rate to 0.000478297 and starting again.
Lowering learning rate to 0.000430467 and starting again.
Lowering learning rate to 0.00038742 and starting again.
Lowering learning rate to 0.000348678 and starting again.
Lowering learning rate to 0.000313811 and starting again.
Lowering learning rate to 0.00028243 and starting again.
Lowering learning rate to 0.000254187 and starting again.
Lowering learning rate to 0.000228768 and starting again.
Lowering learning rate to 0.000205891 and starting again.
Lowering learning rate to 0.000185302 and starting again.
Lowering learning rate to 0.000166772 and starting again.
Lowering learning rate to 0.000150095 and starting again.
Lowering learning rate to 0.000135085 and starting again.
Lowering learning rate to 0.000121577 and starting again.
Lowering learning rate to 0.000109419 and starting again.
Lowering learning rate to 9.84771e-05 and starting again.
Lowering learning rate to 8.86294e-05 and starting again.
Lowering learning rate to 7.97664e-05 and starting again.
Lowering learning rate to 7.17898e-05 and starting again.
Lowering learning rate to 6.46108e-05 and starting again.
Lowering learning rate to 5.81497e-05 and starting again.
Lowering learning rate to 5.23348e-05 and starting again.
Lowering learning rate to 4.71013e-05 and starting again.
Lowering learning rate to 4.23912e-05 and starting again.
Lowering learning rate to 3.8152e-05 and starting again.
Lowering learning rate to 3.43368e-05 and starting again.
Lowering learning rate to 3.09032e-05 and starting again.
Lowering learning rate to 2.78128e-05 and starting again.
Lowering learning rate to 2.50316e-05 and starting again.
Lowering learning rate to 2.25284e-05 and starting again.
Lowering learning rate to 2.02756e-05 and starting again.
step 1 - lrate 0.000020, wchange 5287675040911928.00000000, angledelta  0.0 deg
Lowering learning rate to 1.45984e-05 and starting again.
step 1 - lrate 0.000015, wchange 210690726336.12139893, angledelta  0.0 deg
Lowering learning rate to 1.05109e-05 and starting again.
step 1 - lrate 0.000011, wchange 142594382.91576207, angledelta  0.0 deg
step 2 - lrate 0.000011, wchange 20161550335688460.00000000, angledelta  0.0 deg
Lowering learning rate to 7.56781e-06 and starting again.
step 1 - lrate 0.000008, wchange 742351.61263307, angledelta  0.0 deg
step 2 - lrate 0.000008, wchange 552326845366.74182129, angledelta  0.0 deg
step 3 - lrate 0.000006, wchange 27013178442328988.00000000, angledelta  1.2 deg
Lowering learning rate to 4.35906e-06 and starting again.
step 1 - lrate 0.000004, wchange 2341.13288290, angledelta  0.0 deg
step 2 - lrate 0.000004, wchange 5584269.94658421, angledelta  0.0 deg
step 3 - lrate 0.000004, wchange 13470490127.66810417, angledelta  6.1 deg
step 4 - lrate 0.000003, wchange 6514081478144.61230469, angledelta  6.1 deg
step 5 - lrate 0.000003, wchange 876867608635413.37500000, angledelta  6.1 deg
Lowering learning rate to 2.00865e-06 and starting again.
step 1 - lrate 0.000002, wchange 50.68024878, angledelta  0.0 deg
step 2 - lrate 0.000002, wchange 911.20630109, angledelta  0.0 deg
step 3 - lrate 0.000002, wchange 32988.10745076, angledelta 45.2 deg
step 4 - lrate 0.000002, wchange 1194267.11348375, angledelta 45.2 deg
step 5 - lrate 0.000002, wchange 43236008.40981891, angledelta 45.2 deg
step 6 - lrate 0.000002, wchange 1565271645.63734794, angledelta 45.2 deg
step 7 - lrate 0.000002, wchange 23090813280.00219727, angledelta 45.2 deg
step 8 - lrate 0.000001, wchange 184424618052.76910400, angledelta 45.2 deg
step 9 - lrate 0.000001, wchange 897395214119.00427246, angledelta 45.2 deg
step 10 - lrate 0.000001, wchange 2928115520630.76855469, angledelta 45.2 deg
step 11 - lrate 0.000001, wchange 6924946444870.47949219, angledelta 45.2 deg
step 12 - lrate 0.000001, wchange 12641818743502.61523438, angledelta 45.2 deg
step 13 - lrate 0.000000, wchange 18743416198449.16406250, angledelta 45.2 deg
step 14 - lrate 0.000000, wchange 23514633255667.72265625, angledelta 45.2 deg
step 15 - lrate 0.000000, wchange 25799747520658.99609375, angledelta 45.2 deg
step 16 - lrate 0.000000, wchange 25422008971855.09765625, angledelta 45.2 deg
step 17 - lrate 0.000000, wchange 22982353641883.50390625, angledelta 45.2 deg
step 18 - lrate 0.000000, wchange 19391413891556.00390625, angledelta 45.2 deg
step 19 - lrate 0.000000, wchange 15482044257214.64648438, angledelta 45.2 deg
step 20 - lrate 0.000000, wchange 11826030301521.63671875, angledelta 45.2 deg
step 21 - lrate 0.000000, wchange 8719363253023.00585938, angledelta 45.2 deg
step 22 - lrate 0.000000, wchange 6249338937724.82421875, angledelta 45.2 deg
step 23 - lrate 0.000000, wchange 4378634491852.74462891, angledelta 45.2 deg
step 24 - lrate 0.000000, wchange 3012837784161.54541016, angledelta 45.2 deg
step 25 - lrate 0.000000, wchange 2043275335267.61962891, angledelta 45.2 deg
step 26 - lrate 0.000000, wchange 1369729166482.19677734, angledelta 45.2 deg
step 27 - lrate 0.000000, wchange 909742772316.86779785, angledelta 45.2 deg
step 28 - lrate 0.000000, wchange 599765472179.62878418, angledelta 45.2 deg
step 29 - lrate 0.000000, wchange 393064443460.76141357, angledelta 45.2 deg
step 30 - lrate 0.000000, wchange 256380083974.25946045, angledelta 45.2 deg
step 31 - lrate 0.000000, wchange 166592717794.53439331, angledelta 45.2 deg
step 32 - lrate 0.000000, wchange 107924763231.02522278, angledelta 45.2 deg
step 33 - lrate 0.000000, wchange 69744946263.83432007, angledelta 45.2 deg
step 34 - lrate 0.000000, wchange 44985201365.50345612, angledelta 45.2 deg
step 35 - lrate 0.000000, wchange 28970422854.48507309, angledelta 45.2 deg
step 36 - lrate 0.000000, wchange 18633685385.59726715, angledelta 45.2 deg
step 37 - lrate 0.000000, wchange 11972795604.72009659, angledelta 45.2 deg
step 38 - lrate 0.000000, wchange 7687062914.34513378, angledelta 45.2 deg
step 39 - lrate 0.000000, wchange 4932246521.39628887, angledelta 45.2 deg
step 40 - lrate 0.000000, wchange 3163111734.61759710, angledelta 45.2 deg
step 41 - lrate 0.000000, wchange 2027717407.80188298, angledelta 45.2 deg
step 42 - lrate 0.000000, wchange 1299408887.44890356, angledelta 45.2 deg
step 43 - lrate 0.000000, wchange 832497896.92138553, angledelta 45.2 deg
step 44 - lrate 0.000000, wchange 833261443.75966775, angledelta 45.2 deg
step 45 - lrate 0.000000, wchange 834033849.53541231, angledelta 45.2 deg
step 46 - lrate 0.000000, wchange 834820148.96083641, angledelta 45.2 deg
step 47 - lrate 0.000000, wchange 835601726.77813601, angledelta 45.2 deg
step 48 - lrate 0.000000, wchange 836358353.17287791, angledelta 45.2 deg
step 49 - lrate 0.000000, wchange 837130620.09208655, angledelta 45.2 deg
step 50 - lrate 0.000000, wchange 837921098.22017336, angledelta 45.2 deg
step 51 - lrate 0.000000, wchange 838690223.41839767, angledelta 45.2 deg
step 52 - lrate 0.000000, wchange 839461973.72223723, angledelta 45.2 deg
step 53 - lrate 0.000000, wchange 840240129.23002791, angledelta 45.2 deg
step 54 - lrate 0.000000, wchange 841028468.70842123, angledelta 45.2 deg
step 55 - lrate 0.000000, wchange 841814470.07487166, angledelta 45.2 deg
step 56 - lrate 0.000000, wchange 842574594.39048469, angledelta 45.2 deg
step 57 - lrate 0.000000, wchange 843366888.84898353, angledelta 45.2 deg
step 58 - lrate 0.000000, wchange 844147664.94593871, angledelta 45.2 deg
step 59 - lrate 0.000000, wchange 844943619.20640600, angledelta 45.2 deg
step 60 - lrate 0.000000, wchange 845718499.12722123, angledelta 45.2 deg
step 61 - lrate 0.000000, wchange 846509732.12718034, angledelta 45.2 deg
step 62 - lrate 0.000000, wchange 847299413.67673910, angledelta 45.2 deg
step 63 - lrate 0.000000, wchange 848072162.28870964, angledelta 45.2 deg
step 64 - lrate 0.000000, wchange 848864817.31274664, angledelta 45.2 deg
step 65 - lrate 0.000000, wchange 849650793.11744010, angledelta 45.2 deg
step 66 - lrate 0.000000, wchange 850430874.03384268, angledelta 45.2 deg
step 67 - lrate 0.000000, wchange 851232912.51543069, angledelta 45.2 deg
step 68 - lrate 0.000000, wchange 852023646.33603644, angledelta 45.2 deg
step 69 - lrate 0.000000, wchange 852801330.43289781, angledelta 45.2 deg
step 70 - lrate 0.000000, wchange 853603222.47697246, angledelta 45.2 deg
step 71 - lrate 0.000000, wchange 854392473.08288097, angledelta 45.2 deg
step 72 - lrate 0.000000, wchange 855183006.11765671, angledelta 45.2 deg
step 73 - lrate 0.000000, wchange 855963705.47308517, angledelta 45.2 deg
step 74 - lrate 0.000000, wchange 856763482.12862206, angledelta 45.2 deg
step 75 - lrate 0.000000, wchange 857572205.34761000, angledelta 45.2 deg
step 76 - lrate 0.000000, wchange 858360125.58397007, angledelta 45.2 deg
step 77 - lrate 0.000000, wchange 859164378.19366670, angledelta 45.2 deg
step 78 - lrate 0.000000, wchange 859962060.43506742, angledelta 45.2 deg
step 79 - lrate 0.000000, wchange 860752238.03981328, angledelta 45.2 deg
step 80 - lrate 0.000000, wchange 861555002.40785527, angledelta 45.2 deg
step 81 - lrate 0.000000, wchange 862343423.25830185, angledelta 45.2 deg
step 82 - lrate 0.000000, wchange 863131884.99228227, angledelta 45.2 deg
step 83 - lrate 0.000000, wchange 863954766.36104882, angledelta 45.2 deg
step 84 - lrate 0.000000, wchange 864754054.21133983, angledelta 45.2 deg
step 85 - lrate 0.000000, wchange 865544619.73522866, angledelta 45.2 deg
step 86 - lrate 0.000000, wchange 866348418.59028995, angledelta 45.2 deg
step 87 - lrate 0.000000, wchange 867160977.63523197, angledelta 45.2 deg
step 88 - lrate 0.000000, wchange 867961860.30829012, angledelta 45.2 deg
step 89 - lrate 0.000000, wchange 868767800.37035072, angledelta 45.2 deg
step 90 - lrate 0.000000, wchange 869592980.71460664, angledelta 45.2 deg
step 91 - lrate 0.000000, wchange 870383121.41341519, angledelta 45.2 deg
step 92 - lrate 0.000000, wchange 871183489.49539876, angledelta 45.2 deg
step 93 - lrate 0.000000, wchange 871997223.68203974, angledelta 45.2 deg
step 94 - lrate 0.000000, wchange 872806386.78977859, angledelta 45.2 deg
step 95 - lrate 0.000000, wchange 873620054.07334375, angledelta 45.2 deg
step 96 - lrate 0.000000, wchange 874435960.71590352, angledelta 45.2 deg
step 97 - lrate 0.000000, wchange 875242308.64242184, angledelta 45.2 deg
step 98 - lrate 0.000000, wchange 876058877.68750310, angledelta 45.2 deg
step 99 - lrate 0.000000, wchange 876862399.36623871, angledelta 45.2 deg
step 100 - lrate 0.000000, wchange 877672803.79547143, angledelta 45.2 deg
step 101 - lrate 0.000000, wchange 878489179.71607447, angledelta 45.2 deg
step 102 - lrate 0.000000, wchange 879303718.43619919, angledelta 45.2 deg
step 103 - lrate 0.000000, wchange 880118385.72287095, angledelta 45.2 deg
step 104 - lrate 0.000000, wchange 880930948.28677082, angledelta 45.2 deg
step 105 - lrate 0.000000, wchange 881760473.46768188, angledelta 45.2 deg
step 106 - lrate 0.000000, wchange 882562659.20922565, angledelta 45.2 deg
step 107 - lrate 0.000000, wchange 883379505.16975069, angledelta 45.2 deg
step 108 - lrate 0.000000, wchange 884207688.77327466, angledelta 45.2 deg
step 109 - lrate 0.000000, wchange 885033806.05554318, angledelta 45.2 deg
step 110 - lrate 0.000000, wchange 885844975.98776829, angledelta 45.2 deg
step 111 - lrate 0.000000, wchange 886675609.65184414, angledelta 45.2 deg
step 112 - lrate 0.000000, wchange 887485371.83739936, angledelta 45.2 deg
step 113 - lrate 0.000000, wchange 888309789.84688771, angledelta 45.2 deg
step 114 - lrate 0.000000, wchange 889136296.38684928, angledelta 45.2 deg
step 115 - lrate 0.000000, wchange 889965100.32494247, angledelta 45.2 deg
step 116 - lrate 0.000000, wchange 890785153.02921343, angledelta 45.2 deg
step 117 - lrate 0.000000, wchange 891612021.06820858, angledelta 45.2 deg
step 118 - lrate 0.000000, wchange 892445856.44425368, angledelta 45.2 deg
step 119 - lrate 0.000000, wchange 893264938.99297965, angledelta 45.2 deg
step 120 - lrate 0.000000, wchange 894095702.99847341, angledelta 45.2 deg
step 121 - lrate 0.000000, wchange 894942651.04351187, angledelta 45.2 deg
step 122 - lrate 0.000000, wchange 895750962.84011757, angledelta 45.2 deg
step 123 - lrate 0.000000, wchange 896586340.06241500, angledelta 45.2 deg
step 124 - lrate 0.000000, wchange 897402505.95642889, angledelta 45.2 deg
step 125 - lrate 0.000000, wchange 898257144.31463349, angledelta 45.2 deg
step 126 - lrate 0.000000, wchange 899079342.83266008, angledelta 45.2 deg
step 127 - lrate 0.000000, wchange 899915153.04613984, angledelta 45.2 deg
step 128 - lrate 0.000000, wchange 900745957.62864590, angledelta 45.2 deg
step 129 - lrate 0.000000, wchange 901600961.52251279, angledelta 45.2 deg
step 130 - lrate 0.000000, wchange 902422631.41348505, angledelta 45.2 deg
step 131 - lrate 0.000000, wchange 903267334.29197860, angledelta 45.2 deg
step 132 - lrate 0.000000, wchange 904110251.77108479, angledelta 45.2 deg
step 133 - lrate 0.000000, wchange 904953068.36162436, angledelta 45.2 deg
step 134 - lrate 0.000000, wchange 905777642.63205719, angledelta 45.2 deg
step 135 - lrate 0.000000, wchange 906622022.96608078, angledelta 45.2 deg
step 136 - lrate 0.000000, wchange 907469933.25766861, angledelta 45.2 deg
step 137 - lrate 0.000000, wchange 908316879.59133184, angledelta 45.2 deg
step 138 - lrate 0.000000, wchange 909148506.92452443, angledelta 45.2 deg
step 139 - lrate 0.000000, wchange 910006799.32312799, angledelta 45.2 deg
step 140 - lrate 0.000000, wchange 910843718.82726288, angledelta 45.2 deg
step 141 - lrate 0.000000, wchange 911673526.52449596, angledelta 45.2 deg
step 142 - lrate 0.000000, wchange 912506712.38795650, angledelta 45.2 deg
step 143 - lrate 0.000000, wchange 913381190.22542775, angledelta 45.2 deg
step 144 - lrate 0.000000, wchange 914207459.93710935, angledelta 45.2 deg
step 145 - lrate 0.000000, wchange 915053676.57624912, angledelta 45.2 deg
step 146 - lrate 0.000000, wchange 915914346.41431499, angledelta 45.2 deg
step 147 - lrate 0.000000, wchange 916755998.26800787, angledelta 45.2 deg
step 148 - lrate 0.000000, wchange 917616729.72688293, angledelta 45.2 deg
step 149 - lrate 0.000000, wchange 918448260.00886881, angledelta 45.2 deg
step 150 - lrate 0.000000, wchange 919330867.59428036, angledelta 45.2 deg
step 151 - lrate 0.000000, wchange 920171512.69342220, angledelta 45.2 deg
step 152 - lrate 0.000000, wchange 921017420.13779020, angledelta 45.2 deg
step 153 - lrate 0.000000, wchange 921876423.53437400, angledelta 45.2 deg
step 154 - lrate 0.000000, wchange 922748848.40193677, angledelta 45.2 deg
step 155 - lrate 0.000000, wchange 923578911.04473734, angledelta 45.2 deg
step 156 - lrate 0.000000, wchange 924439654.04025769, angledelta 45.2 deg
step 157 - lrate 0.000000, wchange 925296555.87539744, angledelta 45.2 deg
step 158 - lrate 0.000000, wchange 926152528.51045501, angledelta 45.2 deg
step 159 - lrate 0.000000, wchange 927007100.97316945, angledelta 45.2 deg
step 160 - lrate 0.000000, wchange 927871239.70437980, angledelta 45.2 deg
step 161 - lrate 0.000000, wchange 928729708.20649481, angledelta 45.2 deg
step 162 - lrate 0.000000, wchange 929603932.66264653, angledelta 45.2 deg
step 163 - lrate 0.000000, wchange 930452864.01217890, angledelta 45.2 deg
step 164 - lrate 0.000000, wchange 931297871.57740521, angledelta 45.2 deg
step 165 - lrate 0.000000, wchange 932171921.88667357, angledelta 45.2 deg
step 166 - lrate 0.000000, wchange 933027922.39592099, angledelta 45.2 deg
step 167 - lrate 0.000000, wchange 933904461.28965867, angledelta 45.2 deg
step 168 - lrate 0.000000, wchange 934752422.11211014, angledelta 45.2 deg
step 169 - lrate 0.000000, wchange 935623915.27731442, angledelta 45.2 deg
step 170 - lrate 0.000000, wchange 936524491.07488525, angledelta 45.2 deg
step 171 - lrate 0.000000, wchange 937382556.24745476, angledelta 45.2 deg
step 172 - lrate 0.000000, wchange 938253167.60135031, angledelta 45.2 deg
step 173 - lrate 0.000000, wchange 939144171.01883686, angledelta 45.2 deg
step 174 - lrate 0.000000, wchange 939985666.92222214, angledelta 45.2 deg
step 175 - lrate 0.000000, wchange 940843410.86183023, angledelta 45.2 deg
step 176 - lrate 0.000000, wchange 941745244.52009714, angledelta 45.2 deg
step 177 - lrate 0.000000, wchange 942617330.08755112, angledelta 45.2 deg
step 178 - lrate 0.000000, wchange 943468176.23445523, angledelta 45.2 deg
step 179 - lrate 0.000000, wchange 944340479.43677247, angledelta 45.2 deg
step 180 - lrate 0.000000, wchange 945216427.26710844, angledelta 45.2 deg
step 181 - lrate 0.000000, wchange 946092558.81239653, angledelta 45.2 deg
step 182 - lrate 0.000000, wchange 946987563.91330397, angledelta 45.2 deg
step 183 - lrate 0.000000, wchange 947870826.99672306, angledelta 45.2 deg
step 184 - lrate 0.000000, wchange 948731151.93767321, angledelta 45.2 deg
step 185 - lrate 0.000000, wchange 949622029.27640676, angledelta 45.2 deg
step 186 - lrate 0.000000, wchange 950497849.84940231, angledelta 45.2 deg
step 187 - lrate 0.000000, wchange 951382097.27904403, angledelta 45.2 deg
step 188 - lrate 0.000000, wchange 952250610.28066111, angledelta 45.2 deg
step 189 - lrate 0.000000, wchange 953141759.29741669, angledelta 45.2 deg
step 190 - lrate 0.000000, wchange 954014682.22706437, angledelta 45.2 deg
step 191 - lrate 0.000000, wchange 954901315.14242089, angledelta 45.2 deg
step 192 - lrate 0.000000, wchange 955796408.87161803, angledelta 45.2 deg
step 193 - lrate 0.000000, wchange 956694532.78918815, angledelta 45.2 deg
step 194 - lrate 0.000000, wchange 957567026.77753448, angledelta 45.2 deg
step 195 - lrate 0.000000, wchange 958470861.57695365, angledelta 45.2 deg
step 196 - lrate 0.000000, wchange 959342402.08087540, angledelta 45.2 deg
step 197 - lrate 0.000000, wchange 960235265.03750956, angledelta 45.2 deg
step 198 - lrate 0.000000, wchange 961124913.91496241, angledelta 45.2 deg
step 199 - lrate 0.000000, wchange 962034086.20512307, angledelta 45.2 deg
step 200 - lrate 0.000000, wchange 962926427.65570724, angledelta 45.2 deg
step 201 - lrate 0.000000, wchange 963814525.04230440, angledelta 45.2 deg
step 202 - lrate 0.000000, wchange 964703527.52777648, angledelta 45.2 deg
step 203 - lrate 0.000000, wchange 965593603.31990266, angledelta 45.2 deg
step 204 - lrate 0.000000, wchange 966467980.95179260, angledelta 45.2 deg
step 205 - lrate 0.000000, wchange 967383031.60326791, angledelta 45.2 deg
step 206 - lrate 0.000000, wchange 968274111.61013448, angledelta 45.2 deg
step 207 - lrate 0.000000, wchange 969154367.91875350, angledelta 45.2 deg
