Benchmark Report [Results .csv]

Configuration

Length of signals: 256

Repetitions: 2000

SNRin values: -5, 0, 5, 10,

Methods

• monte_carlo_test

• global_mad_test

• global_rank_env_test

Signals

• LinearChirp

Mean results tables:

The results shown here are the average and 95% Clopper-Pearson CI of the estimated detection power with Bonferroni correction. Best performances are bolded.

Signal: LinearChirp [View Plot] [Get .csv]

	Method + Param	SNRin=-5dB (average)	SNRin=-5dB (CI)	SNRin=0dB (average)	SNRin=0dB (CI)	SNRin=5dB (average)	SNRin=5dB (CI)	SNRin=10dB (average)	SNRin=10dB (CI)
0	monte_carlo_test{‘statistic’: ‘Frs’, ‘pnorm’: 2, ‘rmax’: 2.0, ‘MC_reps’: 2499}	0.06	[‘0.05’, ‘0.08’]	0.17	[‘0.15’, ‘0.20’]	0.65	[‘0.62’, ‘0.68’]	1.00	[‘1.00’, ‘1.00’]
1	monte_carlo_test{‘statistic’: ‘Frs_vs’, ‘pnorm’: 2, ‘rmax’: 2.0, ‘MC_reps’: 2499}	0.07	[‘0.06’, ‘0.09’]	0.27	[‘0.25’, ‘0.30’]	0.94	[‘0.92’, ‘0.95’]	1.00	[‘1.00’, ‘1.00’]
2	global_mad_test{‘statistic’: ‘Frs’, ‘MC_reps’: 2499}	0.06	[‘0.04’, ‘0.07’]	0.16	[‘0.14’, ‘0.18’]	0.65	[‘0.62’, ‘0.67’]	1.00	[‘1.00’, ‘1.00’]
3	global_mad_test{‘statistic’: ‘Frs_vs’, ‘MC_reps’: 2499}	0.07	[‘0.05’, ‘0.08’]	0.27	[‘0.24’, ‘0.30’]	0.96	[‘0.95’, ‘0.97’]	1.00	[‘1.00’, ‘1.00’]
4	global_rank_env_test{‘fun’: ‘Fest’, ‘correction’: ‘rs’}	0.07	[‘0.05’, ‘0.08’]	0.20	[‘0.17’, ‘0.22’]	0.91	[‘0.89’, ‘0.92’]	1.00	[‘1.00’, ‘1.00’]
5	global_rank_env_test{‘fun’: ‘Fest’, ‘correction’: ‘rs’, ‘rmin’: 0.65, ‘rmax’: 1.05}	0.09	[‘0.07’, ‘0.11’]	0.34	[‘0.31’, ‘0.37’]	0.97	[‘0.96’, ‘0.98’]	1.00	[‘1.00’, ‘1.00’]
6	global_rank_env_test{‘fun’: ‘Fest’, ‘correction’: ‘rs’, ‘transform’: ‘asin(sqrt(.))’}	0.06	[‘0.05’, ‘0.08’]	0.20	[‘0.18’, ‘0.23’]	0.91	[‘0.89’, ‘0.92’]	1.00	[‘1.00’, ‘1.00’]
7	global_rank_env_test{‘fun’: ‘Fest’, ‘correction’: ‘rs’, ‘rmin’: 0.65, ‘rmax’: 1.05, ‘transform’: ‘asin(sqrt(.))’}	0.09	[‘0.07’, ‘0.11’]	0.34	[‘0.31’, ‘0.37’]	0.97	[‘0.96’, ‘0.98’]	1.00	[‘1.00’, ‘1.00’]