Hi,
I am running Haplotypecaller for ~600 bams to perform gVCF call on a cluster (SGE qsub system). Each node has 32 cores, 256 GB RAM. I am running 8 tasks pernode, so each task has 4 cores and 32GB memories.
It's been running ~30 hours now (a single BAM needs ~5 hours), out of the ~500 finished tasks there are 24 quit with error showing below. I am not sure if it is an error caused by my command or something else. Can someone give any suggestions?
The command:
java -Xmx32G GATK3.0 \
-T HaplotypeCaller \
-ERC gVCF -L EZ_Exome_v2.bed \
-variant_index_type LINEAR \
-variant_index_parameter 128000 \
-R ucsc.hg19.fasta \
-nct 4 \
--dbsnp dbsnp_138.hg19.vcf \
-I 1.recalibrated.bam \
-o 1.recalibrated.vcf
ERROR ------------------------------------------------------------------------------------------
ERROR stack trace
java.util.ConcurrentModificationException
at java.util.LinkedHashMap$LinkedHashIterator.nextEntry(LinkedHashMap.java:394)
at java.util.LinkedHashMap$EntryIterator.next(LinkedHashMap.java:413)
at java.util.LinkedHashMap$EntryIterator.next(LinkedHashMap.java:412)
at org.broadinstitute.sting.gatk.walkers.haplotypecaller.GenotypingEngine.addMiscellaneousAllele(GenotypingEngine.java:257)
at org.broadinstitute.sting.gatk.walkers.haplotypecaller.GenotypingEngine.assignGenotypeLikelihoods(GenotypingEngine.java:227)
at org.broadinstitute.sting.gatk.walkers.haplotypecaller.HaplotypeCaller.map(HaplotypeCaller.java:872)
at org.broadinstitute.sting.gatk.walkers.haplotypecaller.HaplotypeCaller.map(HaplotypeCaller.java:141)
at org.broadinstitute.sting.gatk.traversals.TraverseActiveRegions$TraverseActiveRegionMap.apply(TraverseActiveRegions.java:708)
at org.broadinstitute.sting.gatk.traversals.TraverseActiveRegions$TraverseActiveRegionMap.apply(TraverseActiveRegions.java:704)
at org.broadinstitute.sting.utils.nanoScheduler.NanoScheduler$ReadMapReduceJob.run(NanoScheduler.java:471)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)