better debug system to allow worker to control analysis debug level
new batch_size method will use avg_msec_per_job to calculate batch_size on the fly
  if analysis_stat.batch_size==0