Friday, April 1, 2016

The popularity of phylogenetic programs over the years

Some time ago a colleague commented on this blog that "Bayesian (MrBayes/Beast) analyses have become almost stand-alone standard". My feeling is that the situation is much more mixed, with many palaeontologists still using parsimony, people with very big datasets using RAxML, some fields sticking to MEGA, and so on.

I got curious: What is the actual market share of different phylogenetics programs? How has it developed over time?

The following are the programs I considered:

Hennig86: A parsimony analysis program from the 1980ies. It cost money and could not really do a lot, but it was the first program I was exposed to in an undergraduate course.

Phylip: This package offers parsimony, likelihood and distance. I never understood its popularity as I find its interface very off-putting, but I guess traditionally the advantage over PAUP was that it was available for free.

PAUP: PAUP was the first program I used seriously and it was generally popular in my institute during my Diplom and Doctorate time. It offers parsimony, likelihood and distance analyses, but it is rather slow with likelihood and had to be paid for. A new version is in the works, with its command line version to be made available for free.

MEGA: Not quite comparable to the others as it is also used by many people for sequence alignment instead of phylogenetic analysis. But it does offer likelihood, parsimony and distance and is freely available. As mentioned above, it seems to be very popular in some specific areas of systematics. For example I know a nematode researcher who told me that virtually all his colleagues use it, whereas I would at the moment not be able to recall a single botanist who does so. One of its attractions might be the GUI environment and the combination of alignment and phylogenetic analysis under one roof.

Mesquite: Likewise a program that is used for much more than phylogenetic analysis, although in this case it is more downstream analyses in evolutionary biology rather than sequence alignment. Freely available, but I am not entirely sure what phylogenetic tree searches it can do beyond parsimony. The options are a bit confusing, to be honest. I have included it here because I use it for character tracing and parsimony species trees.

TNT: Freely available, can only do parsimony. It is ludicrously fast even for large datasets, but as most molecular phylogeneticists have moved to model-based methods it ironically appears to be used in large part by palaeontologists with fairly small datasets. That being said, I see anecdotally that it may be picked up a bit more by at least a subset of the new generation of people working with huge genomic data and a tolerance for scripting.

PhyML: Can only do likelihood. I have never used it as a stand-alone version, my only exposure to it is through SeaView.

RAxML: Can only do likelihood but is optimised for doing it really, really fast. Kind of the TNT for likelihood (or vice versa). Freely available, more and more important with big datasets, but perhaps not entirely the most user-friendly option.

GARLI: Likelihood analysis software with a claim to high speed. I have never used it but am afraid that it tried to compete for the exact same market niche as RAxML at around the same time and lost (see numbers below).

MrBayes: The first Bayesian phylogenetics tool I ever used, back in my doctorate time. Freely available, not very user-friendly, produces phylograms. At least that is true for the versions I am familiar with.

BEAST: The other well-known Bayesian phylogenetics software package, also freely available. Uses a coalescent approach and therefore produces ultrametric trees. As far as I can tell it is faster than MrBayes and also relatively user-friendly thanks to its GUI. (Which is called BEAUTi. Aren't bioinformaticians' jokes hilarious?)

I may have forgotten some, especially if they had only a small niche in the 1990ies and then disappeared, but I feel it catches all the important players in the field.

I used SCOPUS to query the number of papers each year that cited the software in question. Because some names, especially BEAST, MEGA, Mesquite and TNT, are probably too unspecific and could produce lots of false positives, I combined them with the author name, e.g. by using the search term "TNT Goloboff" instead of just TNT. MrBayes, for example, I felt confident enough to query on its own.

The first graph shows the absolute number of references.


So what do we see? I am a bit worried about that massive peak for MEGA around 2011 being partly false positives, but the others make sense.

The 1990s and first half of the 2000s were the time of Phylip and PAUP. Both started to be widely used in the mid-1990s and peaked around 2004/5. Their decline afterwards coincides beautifully with the rise of PhyML. Although I am speculating here it is possible that this represents users switching over who did likelihood analyses and found PhyML to be either faster or more user-friendly. In contrast to Phylip, PAUP recovered in absolute terms until 2010. It declined again after that year in the face of a diversifying competition but still has a large pool of users.

Although MrBayes started its meteoric rise a few years earlier, the time since about 2007 is what I would consider the era of Bayesian phylogenetics as it started to overtake PAUP. Shortly thereafter BEAST took off, apparently making the first dent in MrBayes use only in the past year. Entirely parallel to BEAST the likelihood phylogenetics tool RAxML is growing in popularity for analyses where speed is of the essence.

There is a small market for the parsimony software TNT that does not appear to be impressed by the availability of other options.

One problem with absolute numbers is that phylogenetic software is used much more widely now than it was in the 1990ies, so that it is harder to see what exactly was going on then. Another way of expressing these trends is as 'market share', in other words what percentage of references in the year were to each program.


Here we see that Hennig86 was relatively popular in the early 1990s, reaching as much as 10% of end users in 1991. It has flatlined since about the turn of the century. The shifts between PAUP and Phylip are interesting to see. The same goes for the rather impressive-looking dent in the market share of MrBayes after 2008, which was entirely invisible on the graph for absolute numbers because the market as a whole grew so much.

To what degree are changes in popularity perhaps driven by method preference? In the following, I have presented market share of the programs by the methods they offer: red for parsimony, yellow for likelihood, appropriately orange for both, and blue for Bayesian.


This makes it look very much as if there is a trend towards specialised software in the last few years, contrasting with the big, flexible packages of earlier years. Although Bayesian phylogenetics is clearly on the rise, this graph also shows that it is still far from the "stand-alone standard". In fact the share has hardly risen above what it was 2007.

It also has to be noted that for many colleagues in my area it was standard operating procedure in the last few years to do a Bayesian analysis with MrBayes, a parsimony analysis in PAUP, and then perhaps also a likelihood analysis in PAUP on the same dataset. They then generally showed the Bayesian tree decorated with its own support values and the bootstrap values from likelihood and parsimony. I know because these "they" include me and many papers I have reviewed.

Unfortunately, none of these graphs show well what is going on for the less popular programs. So here a graph that shows their waxing and waning in relative terms. The maximum value of one is their highest ever market share (in fraction of the references in a year), so that other years show where they were relative to the biggest share they ever managed to capture in their existence.


Peak market share: PAUP in 1988, Hennig86 in 1991, Phylip in 1994. Note however that before 1996 hardly counts because the overall market size was minuscule until then; it would perhaps be more appropriate to locate the peaks in popularity for PAUP in 2002 and for Phylip in 1999, but the one for Hennig86 looks right either way. Moving on, peak market share for MrBayes and PhyML in 2007, GARLI in 2009, MEGA in 2012 (if that isn't noise in my search). The others - Mesquite, BEAST, RAxML, and even parsimony-only TNT - have actually achieved their highest ever market shares in the past year.

That is another signal for two developments: Usage of phylogenetics software is still growing overall, and a market that was long dominated by two to three multi-purpose programs is increasingly atomised into many niche programs with their distinct user communities.

-------

Updated 6 April 2016, and again 10 April 2016: As this has suddenly found so much unexpected interest, I felt I should do a bit better. Below three new graphs.


This is a stacked plot of absolute references now taking into account six additional programs:

POY: An unusual program that I had never heard of before, suggested by a commenter. It accepts unaligned data and allows parsimony or likelihood analyses. Interestingly searching for "POY Wheeler" produces 90% false positives (engineering etc.). I added the term phylogenetic to the search key to get only the correct references.

Treecon: Bit of an embarrassment that I didn't put it in right away as I have used it myself, but it only occurred to me after the comment on distance methods. As the previous sentence implies, it does only distance.

NONA: Another specialised parsimony software that bridges between Hennig86 of the early 1990s and today's TNT. Never used it myself.

PAML: As the ML in the name indicates, this is specialised likelihood phylogenetics software, and perhaps the biggest player I had been missing. Never used it myself.

Tree-puzzle: Likewise offers only likelihood, never used it myself.

Treefinder: Was in the news last year when its author forbade scientists in the USA and much of Europe to use the program because he disagrees with various policies, in particular immigration. Likelihood only, never used it myself.

In addition I have redone the MEGA references after I found that I got about 10% false positives there, but it doesn't really change much in the big picture. No idea, by the way, why overall references are going downhill after 2012. Maybe I am missing some very new software that I am not yet aware of?


Here the same in percentages. Again note that the idea of a market share is a bit misleading given that many of the papers in question may have used two competing programs for the same study. I just reviewed a paper that cited PAUP, RAxML and MrBayes although the trees from the third are the only ones shown.


Finally, the methods graph redone to reflect that PAUP originally offered only parsimony. I am given to understand that version 4.0 was actually the first to add likelihood. As far as I can tell it appears to have come out in 1998, but I am happy to be corrected (the one I bought was already 4.0b10).

This graph says nothing about what methods were used from the orange block, although obviously everybody who cited a program from the other blocks would have used that method.

Note how the addition of NONA and Treecon really makes a difference here, with NONA having served the same community that now uses TNT, and the likelihood only sector is larger after the addition of three more likelihood programs.

15 comments:

  1. Excellent! Really cool graphics too. I made a point on twitter about author career stage seems to be (negatively) correlated with the popularity of the program. More precisely, the popularity trend of a program seems to track (negatively) the career stage of the author. Both PAUP and Phylip's authors are at a very late stage of their career, and these two show a clear declining trend (also because the are simply there for a longer time). Interesting to see that GARLI never quite gained traction and MEGA crashed like on a roller coaster.

    ReplyDelete
  2. Interesting post, thank you.

    In the method preference graph, distance-methods (mostly Neighbor-Joining) are missing. A lot of molecular phylogenies used NJ before PhyML in my experience, including its implementation in Phylip.

    ReplyDelete
  3. MEGA gets re-released and published every 3 years or so. You need to include all MEGA papers. Des Higgins

    ReplyDelete
  4. Marc RR,

    Thanks. The graph in question is not based on separate data but merely on the same program references as the others, because I was interested in the use of programs by the method(s) they offered. And none of the programs I looked at are for distance only, so that usage would fall under the "offering both parsimony and likelihood" category (PAUP, Phylip, MEGA all include distance methods, in the case of PAUP at least after a certain version).

    Des Higgins,

    Likewise thanks for the comment. I queried for "MEGA Kumar" after verifying that Kumar was author on all versions since 4.0, so at least all of those are in. If there were earlier publications without this author then they would have been missed, but none of them are cited on the MEGA website.

    But yes, this quick graphing exercise was not undertaken with a claim to a review paper level of accuracy. For starters, I probably missed a bunch of programs; Treecon and NONA have since come to mind.

    ReplyDelete
  5. Hi, Alex! Very nice your results! So, do you know something about the use & popularity of POY?

    Many thanks!

    Annelise

    ReplyDelete
    Replies
    1. Thanks. I must admit I had never heard of POY! Honestly that is one of the most fascinating things about our area: how certain programs or lab practices sweep one lab, and then when one moves to another everybody there does things differently.

      Google-scholared POY now, and it seems to have picked up only less than 300 citations as a program and another 123 for the methodology paper.

      Maybe I should redo this exercise with a few more programs, especially Treecon.

      Delete
    2. Hi Alex!
      Many thanks for reply! Yes, this program is little used, but it use a very interesting model for find homology, the dynamic homology (proposed by Ward Wheeler in 1990s). I also never used this program, but I know a lot of people that use, my zoologists friends. When you have time, try see something about that =)

      Delete
  6. I'm afraid I have to apologize for this sudden glut of comments and traffic! I had this post open for more than a week with the intent of tweeting out a link with your 'market share' figure which I really enjoyed (looks like a stacked diversity curve in Paleobiology), and when I finally posted the tweet, it got 65 re-tweets in 24 hours.

    ...I guess people really like the idea behind your post!

    ReplyDelete
    Replies
    1. Well, that plus ASPT linked to this post on Facebook!

      Considering that I usually get no more than 50 visitors per day and see this mostly as a repository of things people can find if they google for "how to use this software" or "what is the difference between these types of identification keys", the sudden influx of 1,200 sure feels odd!

      But glad to have produced something of interest.

      Delete
  7. Thanks for this. I particularly like the variety of different ways you have plotted the results. I did a similar set of searches in about 2011 for a talk I gave at the Evolution meetings, using searches in Web of Science, and getting similar results. I think at that time I found the most-used programs were, in order, MrBayes, PAUP*, RAxML, Phyml, PHYLIP, and MEGA. I never published this list and right now I cannot find the graphs, so I am probably getting the order a bit wrong.

    Sorry you don't like PHYLIP's interface. There will be a new version within the next year with a menu-driven Java GUI which drives the C programs, not very elegant but a bit better than our character-mode interface. Current operating systems do not make it easy to do a cross-platform GUI interface, the best we could do was use Java. PHYLIP's users seem to like it better than you do, but of course that is a self-selected sample.

    ReplyDelete
    Replies
    1. Thanks for your kind comment. I may not have given PHYLIP enough of a chance when I tried it, as a colleague recently told me that there are other ways of using the programs than the "press 3 to do..." interface. But looking back it is fairly clear that I mostly picked up programs because I saw others around me use them, without a lot of rational deliberation involved, so if the department where I did my Diplom degree had had any PHYLIP users my perception might have turned out vastly different.

      Delete
    2. To build a better cross-platform interface, try Qt

      https://en.wikipedia.org/wiki/Qt_%28software%29

      Delete
  8. Thanks for this interesting post. I am curious how Geneious would behave in your graphs. It would also be interesting to see if online tools, such as www.phylogeny.fr, are gaining in popularity.

    ReplyDelete
  9. Hey Alex,

    What program did you use to create the plot for the market share?

    Thanks!

    ReplyDelete
    Replies
    1. It has been some time, but if memory serves I simply used Excel or LibreOffice Calc to make the graphs and then edited them in Inkscape.

      Delete