]> git.donarmstrong.com Git - samtools.git/log
samtools.git
13 years agoIn merging, if -R is specified, do not abort if the sequence dictionary is different.
Heng Li [Sat, 20 Nov 2010 03:26:36 +0000 (03:26 +0000)]
In merging, if -R is specified, do not abort if the sequence dictionary is different.

13 years agoWhen merging BAM headers, compare the list of target reference sequences
On behalf of John Marshall [Sat, 20 Nov 2010 02:24:28 +0000 (02:24 +0000)]
When merging BAM headers, compare the list of target reference sequences
strictly (and fail/abort if there is a mismatch), but allow one list to be a
prefix of the other.  (i.e., check that the lists are identical up until the
shorter runs out, and add the excess targets from the longer to the output.)

13 years ago * samtools-0.1.10 (r841)
Heng Li [Fri, 19 Nov 2010 19:49:27 +0000 (19:49 +0000)]
 * samtools-0.1.10 (r841)
 * fixed a bug in pileup when the first CIGAR operation is D
 * fixed a bug in view with range query

13 years ago * samtools-0.1.10-4 (r840)
Heng Li [Fri, 19 Nov 2010 18:45:51 +0000 (18:45 +0000)]
 * samtools-0.1.10-4 (r840)

 * drop the MNP caller. It is slow while does not diliver too much
   benefit. Possibly I will work on it in future given more time.

 * there is a segfault in pileup

 * someone has reported segfault from view/index/sort

13 years ago * samtools-0.1.10-6 (r839)
Heng Li [Thu, 18 Nov 2010 22:30:11 +0000 (22:30 +0000)]
 * samtools-0.1.10-6 (r839)

 * call MNPs without realignment because it seems to me that it is not
   worthwhile to significantly slow down SNP calling.

 * the result looks quite different from the previous version. I have
   work to do...

13 years agoApply a patch by Rob Davis, which improves fault detection.
Heng Li [Thu, 18 Nov 2010 16:26:09 +0000 (16:26 +0000)]
Apply a patch by Rob Davis, which improves fault detection.

13 years ago * samtools-r836
Heng Li [Thu, 18 Nov 2010 16:09:23 +0000 (16:09 +0000)]
 * samtools-r836
 * initiate MNP realignment when the MNP has at least 0.2% frequency (otherwise too slow)

13 years ago * modify the filtering rule: also filter SNPs around filtered indels
Heng Li [Thu, 18 Nov 2010 05:25:13 +0000 (05:25 +0000)]
 * modify the filtering rule: also filter SNPs around filtered indels
 * added MNP filter

13 years ago * samtools-0.1.10-4 (r834)
Heng Li [Thu, 18 Nov 2010 04:13:52 +0000 (04:13 +0000)]
 * samtools-0.1.10-4 (r834)
 * fixed a silly bug in printing MNP
 * restrict to at most 1 alternative allele

13 years agofixed a bug in printing MNPs
Heng Li [Thu, 18 Nov 2010 02:58:58 +0000 (02:58 +0000)]
fixed a bug in printing MNPs

13 years agominor change to how seqQ is applied
Heng Li [Thu, 18 Nov 2010 02:47:20 +0000 (02:47 +0000)]
minor change to how seqQ is applied

13 years ago * samtools-0.1.10 (r831)
Heng Li [Thu, 18 Nov 2010 02:41:12 +0000 (02:41 +0000)]
 * samtools-0.1.10 (r831)
 * initial MNP caller

13 years agoRelease samtools-0.1.10 (r829)
Heng Li [Wed, 17 Nov 2010 04:14:15 +0000 (04:14 +0000)]
Release samtools-0.1.10 (r829)

13 years agoupdate version information: samtools-0.1.9-20 (r828)
Heng Li [Wed, 17 Nov 2010 01:48:49 +0000 (01:48 +0000)]
update version information: samtools-0.1.9-20 (r828)

13 years agobcftools: allow to skip indels
Heng Li [Tue, 16 Nov 2010 20:32:50 +0000 (20:32 +0000)]
bcftools: allow to skip indels

13 years agoremove ZQ if both BQ and ZQ are present
Heng Li [Tue, 16 Nov 2010 19:11:58 +0000 (19:11 +0000)]
remove ZQ if both BQ and ZQ are present

13 years ago * samtools-0.1.9-18 (r825)
Heng Li [Tue, 16 Nov 2010 18:51:33 +0000 (18:51 +0000)]
 * samtools-0.1.9-18 (r825)
 * change the behaviour of calmd such that by default it does not change the base quality

13 years ago * samtools-0.1.9-17 (r824)
Heng Li [Tue, 16 Nov 2010 04:31:53 +0000 (04:31 +0000)]
 * samtools-0.1.9-17 (r824)
 * added command line options to change the default parameters in indel calling
 * update the manual

13 years ago * samtools-0.1.9-r823
Heng Li [Mon, 15 Nov 2010 17:20:13 +0000 (17:20 +0000)]
 * samtools-0.1.9-r823
 * the BQ tag is now 64 shifted, not 33 shifted

13 years ago * samtools-0.1.9-16 (r822)
Heng Li [Mon, 15 Nov 2010 05:30:18 +0000 (05:30 +0000)]
 * samtools-0.1.9-16 (r822)
 * keep the raw depth because in indel calling, DP4 may be way off the true depth

13 years ago * samtools-0.1.9-15 (r821)
Heng Li [Sat, 13 Nov 2010 06:18:31 +0000 (06:18 +0000)]
 * samtools-0.1.9-15 (r821)
 * calmd: write BQ
 * skip realignment if BQ is present

13 years ago * samtools-0.1.9-14 (r820)
Heng Li [Sat, 13 Nov 2010 06:08:26 +0000 (06:08 +0000)]
 * samtools-0.1.9-14 (r820)
 * penalize reads with excessive differences in indel calling

13 years ago * samtools-0.1.9-13 (r819)
Heng Li [Sat, 13 Nov 2010 02:36:27 +0000 (02:36 +0000)]
 * samtools-0.1.9-13 (r819)
 * fixed a bug in pileup given refskip

13 years ago * samtools-r818
Heng Li [Fri, 12 Nov 2010 18:04:53 +0000 (18:04 +0000)]
 * samtools-r818
 * for indel calling, do two rounds of probabilistic realignments

13 years ago * samtools-0.1.19-11 (r817)
Heng Li [Fri, 12 Nov 2010 01:04:07 +0000 (01:04 +0000)]
 * samtools-0.1.19-11 (r817)
 * only initiate indel calling when 0.2% of reads contain a gap

13 years ago * samtools-0.1.9-10 (r816)
Heng Li [Thu, 11 Nov 2010 06:22:59 +0000 (06:22 +0000)]
 * samtools-0.1.9-10 (r816)

 * I know why the forward method fails. it is because of zero base
   qualities. when that is fixed, the forward method seems to give
   better results than Viterbi, as it should be. I am tired...

13 years agoeffectively revert to the viterbi version. The forward realignment gives too many...
Heng Li [Thu, 11 Nov 2010 05:57:15 +0000 (05:57 +0000)]
effectively revert to the viterbi version. The forward realignment gives too many false positives.

13 years ago * samtools-0.1.9-9 (r810)
Heng Li [Thu, 11 Nov 2010 05:18:02 +0000 (05:18 +0000)]
 * samtools-0.1.9-9 (r810)
 * use forward, instead of viterbi, for realignment
 * realignment is now quality aware

13 years ago * prepare to replace kaln with kprobaln in realignment
Heng Li [Thu, 11 Nov 2010 03:45:24 +0000 (03:45 +0000)]
 * prepare to replace kaln with kprobaln in realignment

13 years agofixed a typo
Heng Li [Wed, 10 Nov 2010 22:28:50 +0000 (22:28 +0000)]
fixed a typo

13 years agouse zlib for direct reading when BCF_LITE is in use
Heng Li [Wed, 10 Nov 2010 21:54:46 +0000 (21:54 +0000)]
use zlib for direct reading when BCF_LITE is in use

13 years ago * do not use reads containing too many mismatches for indel calling
Heng Li [Wed, 10 Nov 2010 21:32:13 +0000 (21:32 +0000)]
 * do not use reads containing too many mismatches for indel calling
 * fixed a trivial bug in case of multi-allelic indels

13 years ago * samtools-0.1.9-8 (r809)
Heng Li [Wed, 10 Nov 2010 18:23:02 +0000 (18:23 +0000)]
 * samtools-0.1.9-8 (r809)
 * fixed a bug in the indel caller

13 years agominor change to makefile
Heng Li [Wed, 10 Nov 2010 17:24:10 +0000 (17:24 +0000)]
minor change to makefile

13 years ago * samtools-0.1.9-8 (r807)
Heng Li [Wed, 10 Nov 2010 17:10:21 +0000 (17:10 +0000)]
 * samtools-0.1.9-8 (r807)
 * collect indel candidates only from specified platforms (@RG-PL)
 * merge varFilter and filter4vcf in vcfutils.pl

13 years agobcftools: compute equal-tail (Bayesian) credible interval
Heng Li [Wed, 10 Nov 2010 03:05:46 +0000 (03:05 +0000)]
bcftools: compute equal-tail (Bayesian) credible interval

13 years agoadded a double-hit filter to avoid overestimated indel likelihood
Heng Li [Tue, 9 Nov 2010 21:28:39 +0000 (21:28 +0000)]
added a double-hit filter to avoid overestimated indel likelihood

13 years ago * samtools-0.1.9-7 (r804)
Heng Li [Tue, 9 Nov 2010 19:12:06 +0000 (19:12 +0000)]
 * samtools-0.1.9-7 (r804)
 * fixed a bug in the gap caller

13 years ago * samtools-0.1.9-6 (r803)
Heng Li [Tue, 9 Nov 2010 15:45:33 +0000 (15:45 +0000)]
 * samtools-0.1.9-6 (r803)
 * mpileup: apply homopolymer correction when calculating GL, instead of before
 * bcftools: apply a different prior to indels

13 years ago * samtools-0.1.9-5 (r802)
Heng Li [Tue, 9 Nov 2010 04:53:15 +0000 (04:53 +0000)]
 * samtools-0.1.9-5 (r802)
 * relax tandem penalty. this will be made a command-line option in future.

13 years ago * samtools-0.1.9-4 (r801)
Heng Li [Tue, 9 Nov 2010 04:35:52 +0000 (04:35 +0000)]
 * samtools-0.1.9-4 (r801)
 * fixed a minor issue in printing indel VCF

13 years agofixed another silly bug in mpileup's indel caller
Heng Li [Mon, 8 Nov 2010 20:28:14 +0000 (20:28 +0000)]
fixed another silly bug in mpileup's indel caller

13 years agofixed a silly bug in the indel caller
Heng Li [Mon, 8 Nov 2010 19:28:27 +0000 (19:28 +0000)]
fixed a silly bug in the indel caller

13 years agoIncorporate patches by Marcel Martin for read counting.
Heng Li [Mon, 8 Nov 2010 19:07:33 +0000 (19:07 +0000)]
Incorporate patches by Marcel Martin for read counting.

13 years ago * samtools-0.1.9-2 (r797)
Heng Li [Mon, 8 Nov 2010 18:39:52 +0000 (18:39 +0000)]
 * samtools-0.1.9-2 (r797)
 * mpileup: indel calling seems to be working

13 years agoindel calling is apparently working, but more information needs to be collected
Heng Li [Mon, 8 Nov 2010 15:54:46 +0000 (15:54 +0000)]
indel calling is apparently working, but more information needs to be collected

13 years agofixed a few bugs in the indel caller. Probably there are more.
Heng Li [Mon, 8 Nov 2010 05:39:18 +0000 (05:39 +0000)]
fixed a few bugs in the indel caller. Probably there are more.

13 years agoprepare for the indel caller. It is not ready yet.
Heng Li [Mon, 8 Nov 2010 03:23:16 +0000 (03:23 +0000)]
prepare for the indel caller. It is not ready yet.

13 years agoRevert to r790. The recent changes are not good...
Heng Li [Fri, 5 Nov 2010 15:28:23 +0000 (15:28 +0000)]
Revert to r790. The recent changes are not good...

13 years ago * this revision is UNSTABLE
Heng Li [Fri, 5 Nov 2010 04:19:14 +0000 (04:19 +0000)]
 * this revision is UNSTABLE

 * indel caller seems working, but it is very insensitive and has
   several things I do not quite understand.

13 years agofor backup. no effective changes
Heng Li [Fri, 5 Nov 2010 02:58:43 +0000 (02:58 +0000)]
for backup. no effective changes

13 years agofixed a minor problem in the example coming with kprobaln.c
Heng Li [Wed, 3 Nov 2010 19:51:24 +0000 (19:51 +0000)]
fixed a minor problem in the example coming with kprobaln.c

13 years agoSeparate kaln and kprobaln as I am preparing further changes. At
Heng Li [Tue, 2 Nov 2010 19:41:27 +0000 (19:41 +0000)]
Separate kaln and kprobaln as I am preparing further changes. At
present, the results should be identical to the previous.

13 years agoAdded -b option: read file names from a file
Petr Danecek [Tue, 2 Nov 2010 16:19:04 +0000 (16:19 +0000)]
Added -b option: read file names from a file

13 years ago * samtools-0.1.9-2 (r787)
Heng Li [Sat, 30 Oct 2010 03:17:22 +0000 (03:17 +0000)]
 * samtools-0.1.9-2 (r787)

 * Allow to set a maximum per-sample depth to reduce memory. However,
   BAQ computation is still applied to every read. The speed is not
   improved.

13 years ago * samtools-0.1.9-1 (r786)
Heng Li [Fri, 29 Oct 2010 16:10:40 +0000 (16:10 +0000)]
 * samtools-0.1.9-1 (r786)
 * samtools: optionally perform exact test for each sample

13 years agoOptionally output "DP", the individual read depth
Heng Li [Fri, 29 Oct 2010 13:42:25 +0000 (13:42 +0000)]
Optionally output "DP", the individual read depth

13 years agoacknowledge Petr and John who have greatly contributed to the project.
Heng Li [Thu, 28 Oct 2010 03:10:27 +0000 (03:10 +0000)]
acknowledge Petr and John who have greatly contributed to the project.

13 years agoRelease samtools-0.1.9 (r783)
Heng Li [Thu, 28 Oct 2010 02:47:47 +0000 (02:47 +0000)]
Release samtools-0.1.9 (r783)

13 years agofixed a silly bug in pileup
Heng Li [Wed, 27 Oct 2010 23:58:54 +0000 (23:58 +0000)]
fixed a silly bug in pileup

13 years ago * samtools-0.1.8-22 (r781)
Heng Li [Wed, 27 Oct 2010 18:39:48 +0000 (18:39 +0000)]
 * samtools-0.1.8-22 (r781)
 * made BAQ the default behavior of mpileup
 * updated manual
 * in merge, force to exit given inconsistent header when "-R" is not in use.

13 years ago * samtools-0.1.8-21 (r780)
Heng Li [Wed, 27 Oct 2010 15:01:11 +0000 (15:01 +0000)]
 * samtools-0.1.8-21 (r780)
 * minor speedup to pileup

13 years agoimprove pileup a little bit
Heng Li [Wed, 27 Oct 2010 13:58:56 +0000 (13:58 +0000)]
improve pileup a little bit

13 years ago * samtools-0.1.8-20 (r778)
Heng Li [Wed, 27 Oct 2010 04:14:43 +0000 (04:14 +0000)]
 * samtools-0.1.8-20 (r778)
 * speed up pileup, although I do not know how much is the improvement

13 years ago * samtools-0.1.8-19 (r777)
Heng Li [Tue, 26 Oct 2010 21:26:04 +0000 (21:26 +0000)]
 * samtools-0.1.8-19 (r777)
 * integrate mpileup features to pileup: min_baseQ, capQ, prob_realn, paired-only and biased prior

13 years agoremove local realignment (probabilistic realignment is still there)
Heng Li [Tue, 26 Oct 2010 19:27:46 +0000 (19:27 +0000)]
remove local realignment (probabilistic realignment is still there)

13 years agoAdd the relevant filename or region to error messages, and cause a failure
On behalf of John Marshall [Thu, 21 Oct 2010 10:52:38 +0000 (10:52 +0000)]
Add the relevant filename or region to error messages, and cause a failure
exit status where appropriate.  Based on a patch provided by Marcel Martin.

13 years ago * Minor code changes. No real effect.
Heng Li [Tue, 19 Oct 2010 23:44:31 +0000 (23:44 +0000)]
 * Minor code changes. No real effect.
 * change quality to 30 in toy.sam

13 years agoadded another toy example
Heng Li [Tue, 19 Oct 2010 03:40:13 +0000 (03:40 +0000)]
added another toy example

13 years agoimprove the LD statistics
Heng Li [Thu, 14 Oct 2010 03:32:12 +0000 (03:32 +0000)]
improve the LD statistics

13 years ago * a minor fix to the -L option
Heng Li [Wed, 13 Oct 2010 03:49:26 +0000 (03:49 +0000)]
 * a minor fix to the -L option
 * add ldstats to vcfutils.pl

13 years agoa minor change
Heng Li [Tue, 12 Oct 2010 19:51:57 +0000 (19:51 +0000)]
a minor change

13 years agoforget to add the key file
Heng Li [Tue, 12 Oct 2010 19:49:06 +0000 (19:49 +0000)]
forget to add the key file

13 years ago * vcfutils.pl: fixed a typo in help message
Heng Li [Tue, 12 Oct 2010 19:48:46 +0000 (19:48 +0000)]
 * vcfutils.pl: fixed a typo in help message
 * added APIs: bcf_append_info() and bcf_cpy()
 * calculate adjacent LD

13 years agoadded filter for samtools/bcftools genetated VCFs
Heng Li [Mon, 11 Oct 2010 15:06:40 +0000 (15:06 +0000)]
added filter for samtools/bcftools genetated VCFs

13 years ago * removed a comment line in kaln.c
Heng Li [Tue, 5 Oct 2010 18:05:18 +0000 (18:05 +0000)]
 * removed a comment line in kaln.c
 * vcfutils.pl fillac works when GT is not the first field

13 years agoConvert VCF output of "bcftools view -bgcv" to a valid VCF file
Petr Danecek [Tue, 5 Oct 2010 12:59:36 +0000 (12:59 +0000)]
Convert VCF output of "bcftools view -bgcv" to a valid VCF file

13 years ago * samtools-0.1.8-18 (r763)
Heng Li [Sun, 3 Oct 2010 02:51:03 +0000 (02:51 +0000)]
 * samtools-0.1.8-18 (r763)
 * added bcftools manual page
 * minor fix to mpileup and view command lines

13 years ago * vcfutils.pl qstats: calculate marginal ts/tv
Heng Li [Sun, 3 Oct 2010 01:46:25 +0000 (01:46 +0000)]
 * vcfutils.pl qstats: calculate marginal ts/tv
 * allow to call genotypes at variant sites

13 years agoI am changing the gap open probability back to 0.001. It seems that
Heng Li [Fri, 1 Oct 2010 04:29:55 +0000 (04:29 +0000)]
I am changing the gap open probability back to 0.001. It seems that
being conservative here is a good thing...

13 years ago * samtools-0.1.8-17 (r760)
Heng Li [Fri, 1 Oct 2010 04:11:27 +0000 (04:11 +0000)]
 * samtools-0.1.8-17 (r760)
 * the default gap open penalty is too small (a typo)
 * added comments on hmm_realn
 * Java implementation

13 years agomark samtools-0.1.8-16 (r759)
Heng Li [Thu, 30 Sep 2010 14:12:54 +0000 (14:12 +0000)]
mark samtools-0.1.8-16 (r759)

13 years agoround to the nearest integer
Heng Li [Thu, 30 Sep 2010 14:12:02 +0000 (14:12 +0000)]
round to the nearest integer

13 years agoI was trying to accelerate ka_prob_glocal() as this will be the
Heng Li [Tue, 28 Sep 2010 21:16:43 +0000 (21:16 +0000)]
I was trying to accelerate ka_prob_glocal() as this will be the
bottleneck. After an hour, the only gain is to change division to
multiplication. OK. I will stop.

13 years agothis is interesting. multiplication is much faster than division, at least on my Mac
Heng Li [Tue, 28 Sep 2010 20:57:49 +0000 (20:57 +0000)]
this is interesting. multiplication is much faster than division, at least on my Mac

13 years agominor changes
Heng Li [Tue, 28 Sep 2010 20:19:13 +0000 (20:19 +0000)]
minor changes

13 years agoprob_realn() seems working!
Heng Li [Tue, 28 Sep 2010 19:44:16 +0000 (19:44 +0000)]
prob_realn() seems working!

13 years agominor
Heng Li [Tue, 28 Sep 2010 16:48:23 +0000 (16:48 +0000)]
minor

13 years agoConvert phredQ to probabilities
Heng Li [Tue, 28 Sep 2010 16:47:41 +0000 (16:47 +0000)]
Convert phredQ to probabilities

13 years agoImplement the glocal HMM; discard the extention HMM
Heng Li [Tue, 28 Sep 2010 16:32:08 +0000 (16:32 +0000)]
Implement the glocal HMM; discard the extention HMM

13 years agoimprove numerical stability
Heng Li [Tue, 28 Sep 2010 04:06:11 +0000 (04:06 +0000)]
improve numerical stability

13 years agomore comments
Heng Li [Tue, 28 Sep 2010 03:27:54 +0000 (03:27 +0000)]
more comments

13 years agofixed a bug in banded DP
Heng Li [Tue, 28 Sep 2010 03:17:16 +0000 (03:17 +0000)]
fixed a bug in banded DP

13 years ago * fixed that weird issue.
Heng Li [Tue, 28 Sep 2010 03:05:12 +0000 (03:05 +0000)]
 * fixed that weird issue.
 * the banded version is NOT working

13 years agoMore comments. This version seems working, but something is a little weird...
Heng Li [Tue, 28 Sep 2010 02:57:05 +0000 (02:57 +0000)]
More comments. This version seems working, but something is a little weird...

13 years agoA little code cleanup. Now the forward and backback algorithms give
Heng Li [Mon, 27 Sep 2010 21:21:40 +0000 (21:21 +0000)]
A little code cleanup. Now the forward and backback algorithms give
nearly identical P(x), which means both are close to the correct
forms. However, I have only tested on toy examples. Minor errors in
the implementation may not be obvious.

13 years ago...
Heng Li [Mon, 27 Sep 2010 20:55:15 +0000 (20:55 +0000)]
...

13 years agoAbort if merge -h's INH.SAM cannot be opened, just as we abort
On behalf of John Marshall [Mon, 27 Sep 2010 12:19:06 +0000 (12:19 +0000)]
Abort if merge -h's INH.SAM cannot be opened, just as we abort
if any of the IN#.BAM input files cannot be opened.

Also propagate any error indication returned by bam_merge_core()
to samtools merge's exit status.

13 years agoUse bam_validate1() to detect garbage records in the event of a corrupt
On behalf of John Marshall [Fri, 24 Sep 2010 15:08:24 +0000 (15:08 +0000)]
Use bam_validate1() to detect garbage records in the event of a corrupt
BAI index file that causes a bam_seek() to an invalid position.  At most
one record (namely, the bam_iter_read terminator) is tested per bam_fetch()
call, so the cost is insignificant in the normal case.

13 years agoAdd bam_validate1().
On behalf of John Marshall [Fri, 24 Sep 2010 15:00:19 +0000 (15:00 +0000)]
Add bam_validate1().